An interactive swarm of flying 3D pixels (voxels) developed at Queen’s University’s Human Media Lab is set to revolutionize the way people interact with virtual reality. The system, called BitDrones, allows users to explore virtual 3D information by interacting with physical self-levitating building blocks.
Queen’s professor Roel Vertegaal and his students are unveiling the BitDrones system on Monday, Nov. 9 at the ACM Symposium on User Interface Software and Technology in Charlotte, North Carolina. BitDrones is the first step towards creating interactive self-levitating programmable matter – materials capable of changing their 3D shape in a programmable fashion – using swarms of nano quadcopters. The work highlights many possible applications for the new technology, including real-reality 3D modeling, gaming, molecular modeling, medical imaging, robotics and online information visualization.
“BitDrones brings flying programmable matter, such as featured in the futuristic Disney movie Big Hero 6, closer to reality,” says Dr. Vertegaal. “It is a first step towards allowing people to interact with virtual 3D objects as real physical objects.”
Dr. Vertegaal and his team at the Human Media Lab created three types of BitDrones, each representing self-levitating displays of distinct resolutions. “PixelDrones” are equipped with one LED and a small dot matrix display. “ShapeDrones” are augmented with a light-weight mesh and a 3D printed geometric frame, and serve as building blocks for complex 3D models. “DisplayDrones” are fitted with a curved flexible high resolution touchscreen, a forward-facing video camera and Android smartphone board. All three BitDrone types are equipped with reflective markers, allowing them to be individually tracked and positioned in real time via motion capture technology. The system also tracks the user’s hand motion and touch, allowing users to manipulate the voxels in space.
“We call this a Real Reality interface rather than a Virtual Reality interface. This is what distinguishes it from technologies such as Microsoft HoloLens and the Oculus Rift: you can actually touch these pixels, and see them without a headset,” says Dr. Vertegaal.
Dr. Vertegaal and his team describe a number of possible applications for this technology. In one scenario, users could physically explore a file folder by touching the folder’s associated PixelDrone. When the folder opens, its contents are shown by other PixelDrones flying in a horizontal wheel below it. Files in this wheel are browsed by physically swiping drones to the left or right.
Users would also be able to manipulate ShapeDrones to serve as building blocks for a real-time 3D model. Finally, the BitDrone system will allow for remote telepresence by allowing users to appear locally through a DisplayDrone with Skype. The DisplayDrone would be capable of automatically tracking and replicating all of the remote user’s head movements, allowing a remote user to virtually inspect a location and making it easier for the local user to understand the remote user’s actions.
While their system currently only supports dozens of comparatively large 2.5” – 5” sized drones, the team at the Human Media Lab are working to scale up their system to support thousands of drones. These future drones would measure no more than a half inch in size, allowing users to render more seamless, high resolution programmable matter.
The Latest on: Virtual Reality
via Google News
The Latest on: Virtual Reality
- 3 Virtual Reality Stocks to Buy Before Next-Gen Consoles Hiton August 13, 2020 at 9:15 am
Stock Market News, Stock Advice & Trading Tips Virtual reality is a subject that has captured the imaginations of most ...
- Virtual Reality In Healthcare Market 2020-2027 / Historical Analysis, Competitive Landscape and Regional Forecaston August 12, 2020 at 11:59 pm
The report covers the forecast and analysis of the virtual reality in healthcare market on a global and regional level.
- Covid-19 Impact on Global Virtual Reality (VR) in Healthcare Market 2020 Segmentation, Demand, Growth, Trend, Opportunity and Forecast to 2024on August 12, 2020 at 9:29 pm
Updated Research Report of Virtual Reality (VR) in Healthcare Market 2020-2024: Summary: Wiseguyreports.Com Adds “Virtual Reality (VR) in Healthcare - ...
- Labster lands new cash to bring its virtual reality science lab software to Asiaon August 12, 2020 at 2:06 pm
You could Zoom call into your science class, or you could conduct a lab experiment in virtual reality. The global need for learning solutions beyond Zoom is precisely why Labster, a Copenhagen-based ...
- Squanch Games Brings Rick and Morty Co-Creator’s Humor to Virtual Realityon August 12, 2020 at 7:04 am
When Justin Roiland announced the launch of Squanch Games (originally proposed as Squanchtendo) in 2016, it wasn’t immediately clear how the co-creator and primary voice actor of Rick and Morty was ...
- ‘Why I recreated my local pub in virtual reality’on August 11, 2020 at 5:30 pm
The coronavirus lockdown has seen pubs and bars closed in the UK, but one man has missed his local pub so much that he decided to recreate it in virtual reality. Tristan Cross taught himself how to ...
- Jessica Brillhart discusses the power of immersive virtual realityon August 11, 2020 at 8:23 am
Through her recently established XR content studio Vrai Pictures, Jessica Brillhart is looking to change how we perceive reality.
- Augmented Reality and Virtual Reality in the Global Healthcare Market 2020-2025: Increasing Demand for Robotic Surgeries is Driving Growthon August 11, 2020 at 2:58 am
The major drivers for Augmented Realty and Virtual Reality in the healthcare market are the increasing demand for robotic surgeries instead of by-pass surgeries. Rising demand for ...
- Webinar Invite: How Virtual Reality Is Reimagining Healthcareon August 10, 2020 at 7:31 pm
Catch this Entrepreneur Middle East Live discussion that will be staged on Zoom on Wednesday, August 12, 2020 at 2pm (UAE).
- KT to Launch In-flight Virtual Reality Entertainment Service on Jin Airon August 10, 2020 at 5:00 pm
South Korean low cost carrier Jin Air is preparing to launch a new in-flight virtual reality (VR) entertainment service on international routes by the end of the year, under a new partnership with KT ...
via Bing News