A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- The Next Generation of Office Communication Techon October 9, 2020 at 5:12 am
With a mouse click, teammates can instantly turn a snapshot into a live video call. Online platforms ... to a more immersive full-size format; 3-D printers that will allow design teams to ...
- BAE Systems Maritime Services Selects DTC for Unmanned Surface Commson October 6, 2020 at 5:00 am
PRNewswire/ -- DTC Communications (DTC) is proud to announce BAE Systems, Portsmouth, UK has chosen DTC's Phase 4 Radio for the comms on their latest ...
- 3D Printed Video Terminal Dials C For Cyberpunkon October 5, 2020 at 5:00 pm
Created for the Disobey 2020 hacker conference in Finland, this Blade Runner inspired communications terminal ... to do now is figure out how to make video calls with it.
- Avaya Spaces Collaboration App Enables Better Video Conferencing Experiences With NVIDIA AIon October 5, 2020 at 6:01 am
Avaya (NYSE: AVYA), a global leader in solutions to enhance and simplify communications and collaboration, is integrating powerful cloud AI solutions from NVIDIA to increase the impact and value of ...
- Cypress's EZ-USB CX3 Camera Controller Delivers 5-Gbps USB 3.0 Performance To New 3-D Camera from Raytrixon October 4, 2020 at 5:00 pm
Cypress Semiconductor Corp. (NASDAQ: CY) today announced that Raytrix GmbH has selected Cypress’s EZ-USB® CX3™ USB 3.0 camera controller for its new 3-D camera. The EZ-USB CX3 ... of streaming ...
- Videos most effective in communicating with parents about secondhand smoke riskson September 29, 2020 at 5:00 pm
The best way to communicate with parent smokers about the risks of secondhand smoke to their children is to use videos depicting the risks, as well as solutions to reduce those risks. Those were ...
- David’s Bridal Is Betting On 3-D Tech To Get More Brides To Say Yes To The Dresson September 29, 2020 at 4:15 am
Here is a video that demonstrates the new technology: Vertebrae has worked with fashion brands such as Coach, Kate Spade and Adidas to capture 3-D images and intricate details of handbags and ...
- Illuminate grant gives 3-D design lab a new update for virtual reality skillson September 21, 2020 at 7:27 pm
Joshua Wilson and David Meyer of the School of Communication and the Arts, graphic design students will get a taste of the most current 3-D technology. Seeing a need for updated technology in the ...
- Wireless Communications Researchon September 19, 2020 at 3:52 pm
Cognitive Radio and Ubiquitous 3-D Wireless Communications One of the major ... aerial imaging, and video streaming. UAVs can also be used as an aerial communication platform to provide ...
- Police leaders pressed Rochester to keep Prude video secreton September 15, 2020 at 2:55 pm
Rochester police commanders urged city officials to hold off on publicly releasing body camera footage of Daniel Prude's suffocation death because they feared violent blowback if the video ...
via Google News and Bing News