A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
Review: Hooke Verse headset gives you 3D audio with no extra steps
on August 17, 2018 at 10:24 pm
Pop on whatever headphones you've got, and have a look at this video for a very quick snapshot of the difference ... The answer is in the software, specifically the Bluetooth communication codec the V... […]
AP source: Omarosa has video, audio, texts
on August 17, 2018 at 10:06 pm
Omarosa Manigault Newman has a stash of video, emails, text messages and other documentation ... Manigault Newman was director of communications for a White House office that networks with various con... […]
Sophia Might Be Saudi but This Robot Nails the Dialect
on August 17, 2018 at 4:01 pm
Read More Robot Sophia Opens Creative Industry Summit in Egypt Video: Will Smith Goes on a Date With Sophia ... Dr. Alsarheed worked in collaboration with Namthaja, a local 3-D company run by Saudi en... […]
19 AI Technologies That Are Currently Dominating
on August 17, 2018 at 8:12 am
Companies offering speech recognition services include NICE, Nuance Communications, OpenText and Verint Systems ... but the most elaborate versions look like 3-D computer-aided design drawings full of ... […]
IMVU: The Leading Avatar-Based 3D Social Network Acquires StayUp, Inc.
on August 14, 2018 at 10:30 am
Previous to StayUp, Gary was the President at Tango, a mobile messaging company with over 400 million users and a pioneer in mobile video-chat ... social immersion and virtual reality to real-time com... […]
Governor Reynolds Celebrates Deployment of Iowa Statewide Radio System
on August 14, 2018 at 6:12 am
Learn more about ISICS. About Motorola Solutions Motorola Solutions (NYSE: MSI) creates mission-critical communications solutions, including devices, networks, software and video, that help public saf... […]
Six Tips for Transitioning into Full-Time Remote Work
on August 13, 2018 at 2:45 pm
Here are six things I’ve done to make my transition to the remote lifestyle a little bit smoother: People always say that communication is key… and ... purpose of getting to know each other over a vid... […]
Venezuelan officials release video from jailed lawmaker
on August 10, 2018 at 1:08 pm
Communications Minister Jorge Rodriguez said Friday the tape ... Officials jailed Requesens and ordered the arrest of Julio Borges, an opposition lawmaker living in Bogota. The video shows Requesens m... […]
Higher Education M-learning Market Growth Analysis By Top Leading Players - Adobe Systems, Blackboard, D2L, LearnCast, Adrenna, Aptara, City & Guilds
on August 10, 2018 at 8:38 am
Furthermore the applications such as video lectures, audio & video course material ... in the market is the rise in gamification of m-learning. With the integration of 3-D characters into the e-learni... […]
Seequent opens up 3D modelling world
on August 10, 2018 at 12:03 am
Seequent opens up 3D modelling world to improve geological risk management (+ VIDEO ) Central single source management ... but also a very effective tool for communication and visualisation of the lat... […]
via Google News and Bing News