A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- A digital creator comes to print: Hank Green’s debut novel comments on life in the digital age on October 6, 2018 at 6:25 am
Vlogbrothers began in 2007 as an alternative method of communication between Hank and John. The brothers, who live in separate U.S. states, begin each video by greeting one another and then proceed to ... […]
- Motorola Solutions Advances First Responder End-to-End Software Experience on October 5, 2018 at 6:28 pm
About Motorola Solutions Motorola Solutions (NYSE: MSI) creates mission-critical communications solutions, including devices, networks, software and video, that help public safety and commercial custo... […]
- The FreeWheel Council for Premium Video Launches a “Buyer’s Guide to the New Living Room” on October 3, 2018 at 9:05 am
The FWC is comprised of today’s leading premium video publishers including ABC, A+E Networks, Comcast, Discovery Communications, ESPN, Fox, NBC Universal, Turner Broadcasting System and Univision Comm... […]
- Iran airs video said to show March encounter with US carrier on September 29, 2018 at 2:01 pm
The TV agency says the video was aired Saturday as part of a ... Iranian sailors then warn the Americans over radio communication to "keep well clear" of the Guard patrol boats and say they ... […]
- Video shared of 2 students engaging in sexual act at New Britain High on September 29, 2018 at 10:51 am
Principal Damon Pearce said in an e-mail to staff that a video of the sexual act between a male and ... a quick reminder to folks regarding these types of incidents and communication with the public: ... […]
- More than 380 killed as Indonesia tsunami and earthquake devastate coast on September 29, 2018 at 3:34 am
Indonesian TV showed a smartphone video of a powerful wave hitting Palu, with people screaming and running in fear. The water smashed into buildings and the damaged mosque. Communications with the ... […]
- Axis Communications Receives Innovative Product Award at GSX 2018 on September 26, 2018 at 10:32 am
CHELMSFORD, Mass.--(BUSINESS WIRE)--Sep 26, 2018--Axis Communications, the global leader in network video, today was honored with an Innovative Product Award for its AXIS Device Manager at the 2018 Gl... […]
- These Researchers Turned 2D Videos Into 3D Motion Sculptures on September 25, 2018 at 11:31 am
MoSculpt uses an algorithm that takes 2D videos and turns them into 3D printed motion sculptures. The 3D motion sculptures show how a body moves through space. In a press release, Courtney Brigham, Co... […]
- Video communication system approved for juvenile detainees on September 25, 2018 at 8:40 am
Stay with this story by gaining full access to The Eastern Arizona Courier’s award-winning journalism as a contributing online member. Learn about your neighbors, what’s going on with local government... […]
- Video from station close to Iran's Revolutionary Guard threatens missile strikes on UAE, Saudi Arabia over parade attack on September 25, 2018 at 5:46 am
TEHRAN, Iran — An Iranian media outlet close to the country’s hard-line Revolutionary Guard published a video Tuesday threatening ... confiscated ammunition and communication equipment. […]
via Google News and Bing News