A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.
“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.
The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.
It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.
“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab.
Findings are detailed in a research paper to be presented during the Electronic Imaging 2018 conference, Jan. 28-Feb. 2 in Burlingame, Calif. The paper was authored by doctoral student Tyler Bell; Jan P. Allebach, Purdue’s Hewlett-Packard Distinguished Professor of Electrical and Computer Engineering; and Zhang. (A YouTube video is available at https://www.youtube.com/watch?v=NhSbWqEcmQg)
Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.
“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”
The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.
“This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”
The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.
Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.
The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.
The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.
The Latest on: 3-D video communication
Virtual Reality: Changing The Game At Penn State
on June 13, 2018 at 1:06 am
But whether it’s through VR headset gaming, augmented reality tools like Google Glass, or 360-degree video, much of this technology is ... The facility features several 3-D printers, space for curious students to fool around with VR headsets, and ... […]
The Father of VOIP Assembles Dream Team to Create the Workplace of the…
on June 12, 2018 at 10:43 am
PROVO, Utah (PRWEB) June 12, 2018 The “Father of VoIP”, Richard Platt, worked in enterprise communications for over 30 years ... they’d be swimming through it in 3-D, completely immersed in its intricacies like Tony Stark in Iron Man. […]
‘Eternally Confident, Totally Fearless’ Cincinnati Marketing Agency DeanHouston Celebrates 30 Years In Business
on June 12, 2018 at 9:21 am
DeanHouston Inc., a full-service, business-to-business, integrated marketing communications firm ... media and publicity, video production and 3-D animation. DeanHouston also is at the forefront of virtual and augmented reality, which is rapidly being ... […]
The Coming Sad Decline of the Post–Net Neutrality Internet
on June 11, 2018 at 11:52 am
The Federal Communications Commission’s repeal of net neutrality ... 6/4/2018 at 3:47 p.m. Apple’s Memoji Lets You Create Personal Animoji, So Basically a 3-D Bitmoji Animoji will now also have “tongue detection.” 6/4/2018 at 3:36 p.m. Apple ... […]
BlueCross and MP&F Win the Nation’s Most Prestigious Communications Honor
on June 8, 2018 at 8:58 am
internal communications, media relations, public relations, research and analytics, video, and website development services. The team has extensive experience across a number of sectors, including health care, automotive, technology, education, lifestyle ... […]
Janesville companies getting it done with fun
on June 3, 2018 at 3:25 am
3-D wall panels made of bamboo. The office is outfitted with quiet meeting space; a gym and shower room; and break areas with lounge chairs TVs, tea tables, video games, virtual reality headsets, toy drones and other gadgets. Along with soda, the office ... […]
Glance Technologies Co-Founder Penny Green Launches Video as Momentum Builds to Change Board
on June 1, 2018 at 10:13 am
The video, along with other materials related to the annual ... ADVISORSKingsdale Advisors is acting as strategic shareholder and communications advisor and Koffman Kalef LLP is acting as legal advisor to Ms. Green. Forward-Looking Statements Certain ... […]
Technological Advancements Can Be Stranger Than Fiction
on May 31, 2018 at 3:42 pm
The book eerily and accurately anticipated such technologies as using computers to predict that a person might commit a crime, iris recognition, e-readers, 3-D videos ... “written communication [including] any communication by audio or video recording ... […]
There's Nothing Artificial About How AI Is Changing The Workplace
on May 31, 2018 at 4:52 am
Yuan is the Founder and CEO of Zoom Video Communications. Prior to Zoom ... that let you use augmented reality in video conferencing to share and manipulate 3-D virtual holograms in real time and allow others to interact with them as well. […]
via Google News and Bing News