Jun 192017

A glove powered by soft robotics is allowing these Ph.D. students to play piano in VR.

Engineers at UC San Diego are using soft robotics technology to make light, flexible gloves that allow users to feel tactile feedback when they interact with virtual reality environments.  The researchers used the gloves to realistically simulate the tactile feeling of playing a virtual piano keyboard.

Engineers recently presented their research, which is still at the prototype stage, at the Electronic Imaging, Engineering Reality for Virtual Reality conference in Burlingame, Calif.

Currently, VR user interfaces consist of remote-like devices that vibrate when a user touches a virtual surface or object. “They’re not realistic,” said Jurgen Schulze, a researcher at the Qualcomm Institute at UC San Diego and one of the paper’s senior authors. “You can’t touch anything, or feel resistance when you’re pushing a button. By contrast, we are trying to make the user feel like they’re in the actual environment from a tactile point of view.”

Other research teams and industry have worked on gloves as VR interfaces. But these are bulky and made from heavy materials, such as metal. The glove the engineers developed has a soft exoskeleton equipped with soft robotic muscles that make it much lighter and easier to use.

“This is a first prototype but it is surprisingly effective,” said Michael Tolley, a mechanical engineering professor at the Jacobs School of Engineering at UC San Diego and also a senior author.

Click Here for a HighResolution Version
One of the glove’s key components are soft robotic muscles.

One key element in the gloves’ design is a type of soft robotic component called a McKibben muscle, essentially latex chambers covered with braided fibers. The muscles respond like springs to apply force when the user moves their fingers. The board controls the muscles by inflating and deflating them.The system involves three main components: a Leap Motion sensor that detects the position and movement of the user’s hands; a custom fluidic control board that controls the gloves’ movements; and soft robotic components in the glove that individually inflate or deflate to mimic the forces that the user would encounter in the VR environment. The system interacts with a computer that displays a virtual piano keyboard with a river and trees in the background.

Researchers 3D-printed a mold to make the gloves’ soft exoskeleton. This will make the devices easier to manufacture and suitable for mass production, they said. Researchers used silicone rubber for the exoskeleton, with Velcro straps embedded at the joints.

Engineers conducted an informal pilot study of 15 users, including two VR interface experts. All tried the demo which allowed them to play the piano in VR. They all agreed that the gloves increased the immersive experience. They described it as “mesmerizing” and “amazing.”

The engineers are working on making the glove cheaper, less bulky and more portable. They also would like to bypass the Leap Motion device altogether to make system more compact.

“Our final goal is to create a device that provides a richer experience in VR,” Tolley said. “But you could imagine it being used for surgery and video games, among other applications.”

Tolley is a faculty member in the Contextual Robotics Institute at UC San Diego. Schulze is an adjust professor in computer science, where he teaches courses on VR.


Learn more: A glove powered by soft robotics to interact with virtual reality environments


The Latest on: VR interfaces
  • Barely into Beta, Sansar is making social VR look good
    on August 19, 2017 at 7:44 am

    and viewed either with VR headsets like the HTC VIVE or Oculus as well as on ... It has a drag-and-drop editing interface that makes it much easier to create scenes either by importing assets from common 3D modeling tools or purchased from the Sansar ... […]

  • How To Get Started With Developing For Windows Mixed Reality And VR Platforms
    on August 18, 2017 at 1:00 am

    Both the HP and Acer Windows VR headset devkits are on the market and available for ... Once you get your hands on one and start exploring the Windows Mixed Reality home interface, this is what you’ll see: Microsoft designed the home space to look ... […]

  • Tech start up Neurable creates world's first brain-controlled VR system
    on August 17, 2017 at 2:54 am

    “In the long run, we expect that AR/VR headset companies will integrate brain sensors directly into their products. “What the touch interface became to smart phones, BCIs will become to mixed reality headsets.” Holovis has debuted a new virtual ... […]

  • New App Lets You Control Ableton Live Music Software In VR
    on August 14, 2017 at 1:00 am

    One of music production’s most popular programs comes to VR in the form of a 3D sample and mixing interface. As VR continues its infiltration into mainstream technology, developers are scrambling to discover that “it” factor that will send the humble ... […]

  • ‘Star Citizen’ Devs Affirm Eventual VR Support, Say New UI is Designed With VR in Mind
    on August 12, 2017 at 8:09 am

    So at least for the game’s interface, the developers are thinking a bit about how to approach it to ensure it makes sense for eventual VR support. Of course, there’s much more to Star Citizen than just the interface, and much to sort out in order to ... […]

  • This VR Interface For Ableton Live Will Blow Your Mind
    on August 10, 2017 at 1:00 am

    VR is touted as the next big thing with all the large tech companies pouring investment into it. But for music creators, its a slow burner, though there are projects that utilize the new hardware (DeepMind editor for Microsoft Hololens), its not taken hold ... […]

  • Crash Course: VR Design for N00bs
    on August 9, 2017 at 7:15 am

    Specifically, read Mike Alger’s paper on Visual Design Methods for VR. It’s the most comprehensive resource for volumetric user interfaces. While this paper primarily explores interface design of a VR-based operating system, his theories around content ... […]

  • Virtual reality games you can control with your MIND: Startup unveils the world's first brain-controlled VR interface
    on August 9, 2017 at 4:59 am

    A startup has created the world's first brain-controlled virtual reality game. The VR game from Boston-based company Neurable lets you navigate and play along in a virtual worlds, controlling the experience using only your thoughts. The company unveiled ... […]

  • Brain-controlled VR game hints at a hands-free future
    on August 8, 2017 at 5:28 am

    However, the company clearly has larger ambitions. It sees brain control as a big step up in VR interfaces. When done well, it both eliminates the learning curve (you just think about what you want to do) and allows for input that's difficult or impossible ... […]

  • Neurable ushers in age of hands-free gaming with brain-controlled VR
    on August 8, 2017 at 1:00 am

    Boston-based startup Neurable has recently jumped to the head of the innovation pack with the launch of the first brain-controlled interface for VR. Neurable's brain computer interface (BCI) technology identifies brain activity through ... […]

via Google News and Bing News

Other Interesting Posts

Leave a Reply

%d bloggers like this: