An interactive swarm of flying 3D pixels (voxels) developed at Queen’s University’s Human Media Lab is set to revolutionize the way people interact with virtual reality. The system, called BitDrones, allows users to explore virtual 3D information by interacting with physical self-levitating building blocks.
Queen’s professor Roel Vertegaal and his students are unveiling the BitDrones system on Monday, Nov. 9 at the ACM Symposium on User Interface Software and Technology in Charlotte, North Carolina. BitDrones is the first step towards creating interactive self-levitating programmable matter – materials capable of changing their 3D shape in a programmable fashion – using swarms of nano quadcopters. The work highlights many possible applications for the new technology, including real-reality 3D modeling, gaming, molecular modeling, medical imaging, robotics and online information visualization.
“BitDrones brings flying programmable matter, such as featured in the futuristic Disney movie Big Hero 6, closer to reality,” says Dr. Vertegaal. “It is a first step towards allowing people to interact with virtual 3D objects as real physical objects.”
Dr. Vertegaal and his team at the Human Media Lab created three types of BitDrones, each representing self-levitating displays of distinct resolutions. “PixelDrones” are equipped with one LED and a small dot matrix display. “ShapeDrones” are augmented with a light-weight mesh and a 3D printed geometric frame, and serve as building blocks for complex 3D models. “DisplayDrones” are fitted with a curved flexible high resolution touchscreen, a forward-facing video camera and Android smartphone board. All three BitDrone types are equipped with reflective markers, allowing them to be individually tracked and positioned in real time via motion capture technology. The system also tracks the user’s hand motion and touch, allowing users to manipulate the voxels in space.
“We call this a Real Reality interface rather than a Virtual Reality interface. This is what distinguishes it from technologies such as Microsoft HoloLens and the Oculus Rift: you can actually touch these pixels, and see them without a headset,” says Dr. Vertegaal.
Dr. Vertegaal and his team describe a number of possible applications for this technology. In one scenario, users could physically explore a file folder by touching the folder’s associated PixelDrone. When the folder opens, its contents are shown by other PixelDrones flying in a horizontal wheel below it. Files in this wheel are browsed by physically swiping drones to the left or right.
Users would also be able to manipulate ShapeDrones to serve as building blocks for a real-time 3D model. Finally, the BitDrone system will allow for remote telepresence by allowing users to appear locally through a DisplayDrone with Skype. The DisplayDrone would be capable of automatically tracking and replicating all of the remote user’s head movements, allowing a remote user to virtually inspect a location and making it easier for the local user to understand the remote user’s actions.
While their system currently only supports dozens of comparatively large 2.5” – 5” sized drones, the team at the Human Media Lab are working to scale up their system to support thousands of drones. These future drones would measure no more than a half inch in size, allowing users to render more seamless, high resolution programmable matter.
The Latest on: Virtual Reality
via Google News
The Latest on: Virtual Reality
- F1 Racers Go Head to Head in Virtual Reality Racingon March 23, 2020 at 8:24 pm
Since the F1 races have been cancelled, the Formula 1 team announced the launch of a new F1 Esports Virtual Grand Prix series, featuring a number of current F1 drivers. The series was released to ...
- IDTechEx Research on Virtual Reality: To Be or Not to Beon March 23, 2020 at 5:18 pm
XR is a term which has become more prominent in the last few years. It encapsulates virtual, augmented, and mixed reality topics. The definition of each of these has become saturated in the past ...
- Review: ‘Half-Life: Alyx’ is a return to form for Valve, and a must-have for virtual reality fanson March 23, 2020 at 1:47 pm
Half-Life: Alyx, like Half-Life before it, feels like it’s going to end up as a necessary purchase for anyone who’s into virtual reality. (Valve Images) If you own a virtual reality headset, you’re ...
- Half-Life: Alyx is a watershed moment for virtual realityon March 23, 2020 at 10:00 am
At some point during the 12 years that we’ve spent waiting for another Half-Life game, there came a sense of acceptance. As the hope of Half-Life 3 went from a tantalizing reality to an overwrought ...
- Virtual Reality’s Role in Global Real Estate Market Expands Due to Coronaviruson March 23, 2020 at 7:58 am
Virtual reality and virtual tours provide a way for buyers to continue their property search from their homes. “Real estate agents and brokerages are chameleons and entrepreneurial by nature, so we’re ...
- St. Scholastica's virtual reality is an antidote for shuttered classroomson March 23, 2020 at 4:16 am
In response to the recent declarations regarding COVID-19, all of St. Scholastica Academy’s academics and events are going virtual in order to protect our community. All upcoming events, including ...
- Virtual Reality Market 2016-2022 / Size, Share, Revenue, Regions And Top Key Playerson March 23, 2020 at 1:07 am
Naturally, the definition of Virtual Reality is 'Near-Reality' although technically we can say that Virtual Reality describes a three-dimensional world which is generated by a computer-generated ...
- Mayweather Boxing + Fitness CEO On New Locations, Virtual Reality Product: 'It's More Than Just A Workout'on March 22, 2020 at 3:10 pm
Mayweather Boxing + Fitness, a group exercise experience created by World Champion boxer Floyd Joy Mayweather Jr., announced the launch of over 135 franchise locations earlier this month.CEO James ...
- I ate a meal in virtual reality. Here's what it tasted likeon March 21, 2020 at 2:01 pm
The fine-dining sector is beginning to experiment with eating in virtual reality. Will food taste better in a VR mask?
- The Virtual Reality Market is expected to grow by USD 6.34 bn during 2020-2024, progressing at a CAGR of 59% during the forecast periodon March 20, 2020 at 3:29 pm
Global Virtual Reality Market In Education Sector 2020-2024 The analyst has been monitoring the global virtual reality market in education sector 2020-2024 and it is poised to grow by USD 6. New York, ...
via Bing News