Jun 192017

A glove powered by soft robotics is allowing these Ph.D. students to play piano in VR.

Engineers at UC San Diego are using soft robotics technology to make light, flexible gloves that allow users to feel tactile feedback when they interact with virtual reality environments.  The researchers used the gloves to realistically simulate the tactile feeling of playing a virtual piano keyboard.

Engineers recently presented their research, which is still at the prototype stage, at the Electronic Imaging, Engineering Reality for Virtual Reality conference in Burlingame, Calif.

Currently, VR user interfaces consist of remote-like devices that vibrate when a user touches a virtual surface or object. “They’re not realistic,” said Jurgen Schulze, a researcher at the Qualcomm Institute at UC San Diego and one of the paper’s senior authors. “You can’t touch anything, or feel resistance when you’re pushing a button. By contrast, we are trying to make the user feel like they’re in the actual environment from a tactile point of view.”

Other research teams and industry have worked on gloves as VR interfaces. But these are bulky and made from heavy materials, such as metal. The glove the engineers developed has a soft exoskeleton equipped with soft robotic muscles that make it much lighter and easier to use.

“This is a first prototype but it is surprisingly effective,” said Michael Tolley, a mechanical engineering professor at the Jacobs School of Engineering at UC San Diego and also a senior author.

Click Here for a HighResolution Version
One of the glove’s key components are soft robotic muscles.

One key element in the gloves’ design is a type of soft robotic component called a McKibben muscle, essentially latex chambers covered with braided fibers. The muscles respond like springs to apply force when the user moves their fingers. The board controls the muscles by inflating and deflating them.The system involves three main components: a Leap Motion sensor that detects the position and movement of the user’s hands; a custom fluidic control board that controls the gloves’ movements; and soft robotic components in the glove that individually inflate or deflate to mimic the forces that the user would encounter in the VR environment. The system interacts with a computer that displays a virtual piano keyboard with a river and trees in the background.

Researchers 3D-printed a mold to make the gloves’ soft exoskeleton. This will make the devices easier to manufacture and suitable for mass production, they said. Researchers used silicone rubber for the exoskeleton, with Velcro straps embedded at the joints.

Engineers conducted an informal pilot study of 15 users, including two VR interface experts. All tried the demo which allowed them to play the piano in VR. They all agreed that the gloves increased the immersive experience. They described it as “mesmerizing” and “amazing.”

The engineers are working on making the glove cheaper, less bulky and more portable. They also would like to bypass the Leap Motion device altogether to make system more compact.

“Our final goal is to create a device that provides a richer experience in VR,” Tolley said. “But you could imagine it being used for surgery and video games, among other applications.”

Tolley is a faculty member in the Contextual Robotics Institute at UC San Diego. Schulze is an adjust professor in computer science, where he teaches courses on VR.


Learn more: A glove powered by soft robotics to interact with virtual reality environments


The Latest on: VR interfaces
  • InstaVR Unveils Cross-Platform Guided VR Co-Viewing
    on October 19, 2017 at 12:32 am

    Similar to Yo Yo Games’ GameMaker software, users can take advantage of an easy point and click interface, and can even develop experiences in VR, using platforms like Samsung’s Gear VR to control placement and behaviors while walking around the ... […]

  • New VR Tech Aims to Take Surround-Sound to the Next Level
    on October 18, 2017 at 11:41 pm

    For VR to really take hold of a person ... Cross and his team took those lessons into account when designing the interface for Microsoft’s new consumer headset. Instead of presenting users with a start menu or screen when they don the device, they ... […]

  • AR/VR Weekly: the view from Oculus Connect 4
    on October 18, 2017 at 1:47 pm

    a lower price for the Rift VR gear (and a more intense price war with HTC), a new Minority Report-like interface, and a partnership with the studio that makes Titanfall, a blockbuster shooter video game series from EA. Looking from that vantage point ... […]

  • News: Plugin Alliance And Dear Reality Release Immersive 3D Audio Plugins For DAW-Driven VR And AR Applications
    on October 18, 2017 at 1:27 pm

    dearVR pro is the ultimate solution for professionals working with VR and AR needing no-compromise, state-of-the-art performance with all the workflow advantages of a self-contained plugin. Its powerful, yet intuitive, GUI (Graphical User Interface ... […]

  • Adobe Premiere Pro Receives VR Editing Interface – Project CloverVR
    on October 18, 2017 at 6:56 am

    Adobe has today rolled out a new update to its Adobe Premiere Pro video editing application bringing with it the highly anticipated Project CloverVR enhancements which now include a VR editing interface. After originally being previewed this time last year ... […]

  • Adobe Premiere Pro Now Includes VR Editing Interface ‘Project CloverVR’
    on October 18, 2017 at 5:59 am

    The Daily Roundup is our comprehensive coverage of the VR industry wrapped up into one daily email, delivered directly to your inbox. Adobe’s VR editing interface for Premiere Pro is now available as part of this week’s Creative Cloud release. […]

  • Facebook’s Oculus VR Is Growing Up
    on October 15, 2017 at 2:38 pm

    In 2018 the Rift user interface will also be getting an upgrade to make the Oculus Home easier to use; you'll even be able to use your desktop while in VR. Usability of high-end VR has been a challenge since Oculus Rift and Vive were launched, so making it ... […]

  • This VR Experience is Powered By Positive Thinking
    on October 14, 2017 at 1:00 am

    Positivity Moves The World brings brain-controlled interface technology to the GearVR via a headband. There’s no shortage of bizarre control schemes for VR experiences these days. After all, developers are still experimenting with various methods they ... […]

  • Developers get a broader VR market with Oculus Go
    on October 11, 2017 at 2:20 pm

    and three facial interfaces. They also come with dedicated customer support and special extended licenses and warranties. "This is a great opportunity--not only for businesses, but for the long-term viability of VR," Oculus said in a blog post. […]

  • Oculus debuts Dash ?and Home ?software interface for better control around VR apps
    on October 11, 2017 at 11:52 am

    Oculus reveals ?a n?ew VR interface that lets users use hand controllers to move around in a VR app's menu. […]

via Google News and Bing News

Other Interesting Posts

Leave a Reply

%d bloggers like this: