A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
- Lieutenant ordered to stop communication as Portland police investigates text messages with Joey Gibson on February 15, 2019 at 8:52 pm
“Regardless of where you are on this, these text messages can only confirm those worst fears,” Wheeler said. In a video posted on Facebook, Gibson said the conversations between him and Niiya were lik... […]
- 3-D protein structure reveals a new mechanism for future anti-cancer drugs on February 15, 2019 at 8:05 am
Their findings, published in Nature Communications ... is a 3-D model that allows them to visualize the interaction of potential drug compounds with target proteins (see accompanying video). […]
- A new pipeline for 3-D video recording, compression, transmission and decompression on February 15, 2019 at 5:26 am
"Now, we have come up with a platform that enables high-quality 3D video communication on mobile devices through standard wireless networks." The platform, called Holostream, drastically reduces the d... […]
- Relieving the pain and time of sharing 3D video content on February 14, 2019 at 10:57 am
“Now, we have come up with a platform that enables high-quality 3D video communication on mobile devices through standard wireless networks.” The platform, called Holostream, drastically reduces the d... […]
- Jussie Smollett Case Update: Police Questioning Two ‘Persons Of Interest’ Seen On Video Near Alleged Attack on February 14, 2019 at 8:21 am
CHICAGO (CBS) — Chicago police are questioning two “persons of interest” who were seen on video near the spot where “Empire ... currently being questioned by detectives. We remain in communication wit... […]
- Maritime's Amazing World of Mixed Reality on February 14, 2019 at 4:25 am
Fostech’s mixed reality technology allows you to view not just a whole ship in 3-D, but by clicking with your fingers ... to deliver solutions include sales and marketing, maritime video communication... […]
- EYE ON ART: COUPLES Come Together At Long Beach City College on February 13, 2019 at 6:31 am
The selected works include drawing, ceramics, graphic design, painting, photography, printmaking, sculpture and video created by artist couples ... a table-top miniature gallery, featuring 3-D charact... […]
- TigerConnect and OpenTempo Partner to Drive Role-based Communication for Accelerated Care on February 13, 2019 at 4:33 am
This ensures secure messages, voice calls, and video conversations are directed to the right ... “At TigerConnect we are on a mission to radically improve healthcare communications, but this is a miss... […]
- CLX Communications AB (publ): CLX Communications unifies its business under a shared identity and rebrands as Sinch on February 12, 2019 at 11:41 pm
Although the brand, visuals and corporate identity are new, CLX Communications AB has used the Sinch trading name for its real-time voice and video products since the acquisition of Sinch AB in Decemb... […]
- With arrest warrant pending, California sheriff says Maurice Washington 'should be held accountable' if guilty on February 12, 2019 at 5:30 pm
A search warrant affidavit obtained by The World-Herald detailed Washington's communications with the girl before he sent her the explicit video. Washington and the girl had dated in eighth and ninth ... […]
via Google News and Bing News