A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- Will ScanSource NASDAQ:SCSC meet your expectations?on August 17, 2019 at 2:44 am
The 3D printing solutions print real parts directly ... Its business units offer voice, video conferencing, wireless, data networking and converged communications solutions in North America, Latin ...
- Auden accelerates deployments for 5G, RF explosive growthson August 14, 2019 at 8:33 pm
Other than 5G communication, radio frequency (RF ... Horng designed a coordinate calibration algorithm for 3D hand gesture trajectory, wherein pixel-based 2D coordinates are converted to coordinates ...
- Digital Trends Live: Snapchat’s 3D video camera, LG’s Z-fold phone, and moreon August 14, 2019 at 1:55 pm
Stories include Snapchat’s announcement of their new Spectacles 3 sunglasses that have microphones and cameras to let you capture your world in 3D and the Tron-inspired ... In other news, a new ...
- The Future of Communication Is Rooted In The Paston August 14, 2019 at 8:02 am
For most of human history, communication has been face-to-face ... The next generation of “face to face” conversations and meetings promise to bring holograms, 3D technology and virtual reality to ...
- The Secret To Snap's Successon August 14, 2019 at 5:32 am
By using camera effects to allow users to easily enhance and editorialize images and videos, Snap supercharged UGC ... World Lenses launched in 2017 and allowed users to place 3D objects or characters ...
- THE RIOT BALLET Begins Performances Next Weekon August 13, 2019 at 7:07 pm
Drew can't wait for The Riot Ballet to start, "At moments, it will feel like being inside a huge, 3D video game, at other moments it ... Martin Andrews (co-writer/the role of Director of ...
- San Jose holographic TV startup scores funding from Verizon, Comcast, Samsungon August 12, 2019 at 12:42 pm
A San Jose startup that's developing 3D holographic TVs said on Monday that it raised a $28 million Series A round from investors who include Verizon Communications Inc ... market that we are ...
- ADM Tronics Announces Alvio Respiratory Technology FCC Certificationon August 12, 2019 at 9:35 am
For me personally, it is especially rewarding to know that Alvio can help children with asthma who can now ‘play their way to better health’ by interacting with their breath on the video games in ...
- Interview with Rize’s Julie Reece On Marketing and Understanding 3D Printingon August 9, 2019 at 11:13 pm
I joined the 3D printing industry in 2008 as the Director of Marketing Communications for Z Corporation ... which we demonstrated on video in our office. The idea was so far-fetched to the ...
- 3D Gaming Console Market 2019-2024: Microsoft Corporation, Nintendo Co. Limited, Sony Corporation, Apple, Logitech, Oculus VRon August 9, 2019 at 5:13 am
Innovative features and the incorporation of advanced technologies such as multi-screen displays, motion sensors, and intelligent communication ... of advanced 3D smartphones poses a strong threat to ...
via Google News and Bing News