A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- (Video) In Cameroon, journalists are being jailed on charges of 'fake news' on December 17, 2018 at 12:49 am
"It's a terrible problem for us - fake news, disinformation, poisoning," Issa Tchiroma Bakary, Cameroon's minister of communications, said in his office in the capital of Yaoundé. "We are confronted b... […]
- Game on for Chinese 5G firms on December 16, 2018 at 4:20 pm
On Nov 30, about 10 engineers employed with smartphone maker Oppo and based in China, Japan and the United States made what they claimed is the world's first 5G-enabled cross-continent video call ... ... […]
- Drone Applications in the Construction Industry on December 16, 2018 at 12:09 pm
Most construction firms use drone technology for quick and safe progress monitoring and real-time communication, with applications ... With real-time FPV video capabilities, project managers have full ... […]
- Alleged Russian spy Maria Butina pleads guilty to engaging in conspiracy against US on December 13, 2018 at 10:27 am
"Butina sought to establish unofficial lines of communication with Americans having power and influence over US politics," the prosecutor said in a Washington courtroom. Her guilty plea and ... […]
- Global Satellite Transponder Market 2018-2022 | Advent of Next Generation MBH to Boost Growth | Technavio on December 12, 2018 at 8:28 am
The adoption of HTS using spot beam technology is increasing in commercial satellite communications. In recent years ... the growth of the market is the increasing demand for HDTVs and video broadcast... […]
- Our view: Speak up to protect your cable access voice on December 10, 2018 at 8:03 pm
Now, after decades of investment, those local voices are at risk of being silenced as the Federal Communications Commission appears ... eliminating the payments would “keep in check consumer video pri... […]
- Micro 3D printing mined for future 5G mobile connections on December 10, 2018 at 7:26 am
5G, the future of mobile communications, ultra-fast video streaming and autonomous car radar, is seeking precision 3D printing methods for its circuitry. In a University of Birmingham project set ... […]
- Bengals hang with Bolts, but fall short as skid hits 5 games on December 9, 2018 at 7:43 pm
Except the officials took the touchdown off the board after video review in accordance with this ... The Bengals even had problems with their communication headsets in the first half. The offense mana... […]
- Vesper Hu Introduces the Marketing and Branding Strategy of Heilind Asia Pacific on December 7, 2018 at 6:58 pm
Interviewee: Vesper Hu, Marketing & Corporate Communications Manager APAC ... in this phase we built Asia website, made corporate video, conducted lots of interviews and attended many large-scale trad... […]
- Millro Chooses ZW3D CAD/CAM for its Excellent Performance in Automating Robot Milling on December 7, 2018 at 8:42 am
(Watch Video to Learn More) Millro stands above the average in ... We use ZW3D especially in product development, as well as for visualization, communication and creation of programs for the robot its... […]
via Google News and Bing News