A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- Gather 'Round the Drool Log with Beef. It's What's For Dinner. This Holiday Seasonon November 19, 2019 at 5:28 am
"Real beef's great taste and 'drool worthiness' cannot be replicated, which is why we think sizzle videos resonate so well with consumers," said Season Solorio, Senior Executive Director of brand ...
- EarthCam's A.I. Technology Advances Autodesk Integration with Improved 3D Model and 360° Reality Capture Alignmenton November 19, 2019 at 4:30 am
EarthCam's Control Center 8 software-as-a-service platform leverages A.I. technology to align 360° images with associated 3D BIM models. The resulting uniformly acquired data ... "BIM is all about ...
- CNBC EXCLUSIVE: CNBC TRANSCRIPT: SNAP CEO EVAN SPIEGEL SPEAKS WITH CNBC'S JULIA BOORSTIN TODAY ON CNBC'S "SQUAWK ALLEY"on November 18, 2019 at 5:41 pm
Following is a link to the video on CNBC.com: https://www.cnbc.com/video/2019/11/18/watch-cnbcs-full-interview ... ALL DAY EVERY DAY AND SO SPECTACLES IS REALLLY WITH AN EVENT BASED PRODUCT ON THE ...
- Grinning Faces And Smiling Eyes: Why Use Emojis?on November 18, 2019 at 12:00 pm
Maybe you’re one of those misfits who find emojis annoying -- a dumbing down of human communication ... Meanwhile, Mojichat is offering animated 3D, personalized, full-body emojis. These are dubbed ...
- Why Your Payment Apps Are Driving You Mad (Part 2)on November 18, 2019 at 9:54 am
However, some issuers have already started bolstering authentication for online purchases and many have gone down the route of introducing a smartphone element into the 3D secure (3DS) process ... the ...
- A mind-blowing 8K holographic display makes 3D look awesome againon November 16, 2019 at 2:00 am
Perhaps the closest comparison would be virtual worlds in a multiplayer video game, in which each player experiences the same shared world ... They could use this to communicate sophisticated concepts ...
- Geek of the Week: If there’s roadwork ahead, Kurt Stiles uses 3D modeling and more to drive projecton November 15, 2019 at 8:00 pm
Learn more about this week’s Geek of the Week, Kurt Stiles: What do you do, and why do you do it? I built and lead a visual communication content development group that is centered in 3D computer ...
- New imaging technique unlocks secrets of the zebrafish hearton November 15, 2019 at 6:32 am
In a new paper published today in the journal Nature Communications, researchers from the Universities of Glasgow and Edinburgh describe how they have developed a new method to capture 3-D video ...
- Real-time 3-D reconstruction of complex scenes from long distances are shaping our present and futureon November 15, 2019 at 6:04 am
Nature Communications. One of these researchers, Prof. Stephen McLaughlin, head of the School of Engineering and Physical Sciences spoke of the research. He said: "The ability to deliver real time 3-D ...
- Visualization and 3D Rendering Software Market by Technology Innovations and Global Demand 2019on November 13, 2019 at 9:47 pm
video games, architecture and product visualization. Visualization and 3D Rendering software can have several benefits including improved visual communication, cost effectiveness, precise and accurate ...
via Google News and Bing News