A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- Terrorists and Technological Innovationon February 2, 2020 at 7:37 am
Often when terrorists use new technology, they bungle it—the new bomb design does not detonate or the new video technology fails to upload ... Bruce Hoffman and Jacob Ware note that Baillet “allegedly ...
- 'It's not just - you didn't pay your rent': Exhibit at downtown library tells stories behind Richmond's sky-high eviction rateon February 1, 2020 at 2:40 pm
Mike Burnette, a director of communications, and Kelly Barnum, a communications and outreach specialist of Housing Opportunities Made Equal of Virginia, are shown at the exhibit about evictions at ...
- Thomas Jefferson High School offers students first-hand experiences before graduationon January 31, 2020 at 5:27 pm
DENVER — Thomas Jefferson High School created a four year comprehensive elective program called Center for Communication Technology Magnet (CCTM ... digital media production and 3D animation. The high ...
- Why Tech Workers Need a Union: a Q&A with the CWA’s Emma Kinemaon January 31, 2020 at 10:15 am
Earlier this month, the Communication Workers of America launched a new initiative ... an artist is working in Photoshop or some kind of 3-D software package, and programmers are writing code and ...
- Medical Animation Market Growth, Ongoing Trends, Technological Innovation, Opportunities and Forecast to 2026on January 31, 2020 at 8:24 am
Such videos are developed for educational videos, 3D animations, and medical illustrations ... Top Companies in the Global Medical Animation Market Research Report: Invivo Communications, Inc., ...
- Optus showcases 5G mixed reality sports streaming use caseson January 30, 2020 at 7:53 pm
Read More In the showcase, Optus partnered with Unbnd, an augmented reality (AR) and virtual reality (VR) company, to demonstrate a 360-degree 'virtual theatre' that allows viewers to experience ...
- Advertisers are using lifelike avatars to drum up brand awarenesson January 29, 2020 at 8:00 pm
Today, avatars have become a more personable and shorthand form of communication that people ... It lets users build their own 3-D animated Genie, or avatar, in their own likeness, and that ...
- 3D Telepresence Market And Top Key Players are Avaya, AVer Information, Cisco Systems, Highfive, Huaweion January 27, 2020 at 11:12 pm
3D Telepresence has the potential to dominate this market in near future ... Panasonic, Polycom, Sony, Trueconf, Vidyo, Zoom Video Communications.
- Global 3D Dental Scanners Market 2020-2024| Evolving Opportunities with 3M Co. and 3Shape AS| Technavioon January 27, 2020 at 1:22 pm
It is making communication between dentists and patients faster ... which is a digital impression system that offers superior full-arch accuracy and features 3D-in-motion video technology that ...
- Claytronics Market Restraints, market demands And forecast 2017-2022on January 26, 2020 at 10:11 pm
Claytronics is an emerging technology which is increasingly being used to create 3 D objects now a days. It is based upon the application of Nano scale robots, called as claytronics atoms or catoms ...
via Google News and Bing News