A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- Verizon Media Opens 8 Studios Globally, Including 5G Studio in Los Angeles (EXCLUSIVE) on April 18, 2019 at 6:04 am
Verizon Media, the telco’s content subsidiary formerly known as Oath, has been busy building out its network of video production ... equipment for motion and 3-D capture, the Verizon Media ... […]
- Husson University to Demonstrate New Augmented Reality App for Theatrical Set Designers on April 17, 2019 at 4:36 am
App for iPhone and iPad created through interdepartmental experiential learning initiative by students from the College of Business and the New England School of Communications Thanks to ... […]
- LIFEWTR Series 7 bottle illustrations on April 12, 2019 at 12:22 am
3-D printing and enhanced reality. Through a QR code or by accessing ar.LIFEWTR.com, consumers nationwide will be able to bring bottle art to life. Reasoning: LIFEWTR believes inspiration is as ... […]
- Augmented Reality and the Smart Factory on April 9, 2019 at 8:54 am
The AR application allows customers to see 3-D representations of the unit’s internal pump and cooling options in multiple configurations and how the subsystems fit together. Technicians can also take ... […]
- Web series looks at video-game streamers on April 8, 2019 at 1:34 pm
live video-game streaming. "Streamers," a new web series from the National Film Board of Canada and ARTE France, examines the growing phenomenon in which participants can build an online community, ... […]
- ARRIS Offers RDK Lab Accelerator to Support the Rapid Development of New Video Applications on April 8, 2019 at 3:36 am
Now, service providers and development partners can rapidly come to market with new services and applications, including popular premium video streaming apps ... by shaping the future of wired and ... […]
- Photo and Video Sharing App FamilyAlbum Honored for Best User Experience in the 23rd Annual Webby Awards on April 5, 2019 at 12:02 pm
... highlight the best photos and videos you have shared. They are automatically created every three months. Since 1997 mixi Group has created communication services for friends and family to ... […]
- The Chrysler MyGIG Automotive Infotainment System on September 22, 2018 at 5:00 pm
It has both 2-D and 3-D bird’s ... DVD audio and video from either the head unit or an external DVD player. Chrysler Group is the only company offering completely integrated audio, navigation, ... […]
- Samsung patent suggests video chatting with AR Emoji on April 24, 2018 at 10:51 pm
The patent states, “Existing video communication systems typically require high bandwidth and are inherently high latency as entire image sequences need to be generated and compressed before ... […]
- Video Conferencing is very important in Business Communication on January 10, 2018 at 3:29 am
In order to communication there is need to make change like using Video conferencing for better transformation of knowledge of our products and services. It is very important to improved relationship ... […]
via Google News and Bing News