Jun 192017

A glove powered by soft robotics is allowing these Ph.D. students to play piano in VR.

Engineers at UC San Diego are using soft robotics technology to make light, flexible gloves that allow users to feel tactile feedback when they interact with virtual reality environments.  The researchers used the gloves to realistically simulate the tactile feeling of playing a virtual piano keyboard.

Engineers recently presented their research, which is still at the prototype stage, at the Electronic Imaging, Engineering Reality for Virtual Reality conference in Burlingame, Calif.

Currently, VR user interfaces consist of remote-like devices that vibrate when a user touches a virtual surface or object. “They’re not realistic,” said Jurgen Schulze, a researcher at the Qualcomm Institute at UC San Diego and one of the paper’s senior authors. “You can’t touch anything, or feel resistance when you’re pushing a button. By contrast, we are trying to make the user feel like they’re in the actual environment from a tactile point of view.”

Other research teams and industry have worked on gloves as VR interfaces. But these are bulky and made from heavy materials, such as metal. The glove the engineers developed has a soft exoskeleton equipped with soft robotic muscles that make it much lighter and easier to use.

“This is a first prototype but it is surprisingly effective,” said Michael Tolley, a mechanical engineering professor at the Jacobs School of Engineering at UC San Diego and also a senior author.

Click Here for a HighResolution Version
One of the glove’s key components are soft robotic muscles.

One key element in the gloves’ design is a type of soft robotic component called a McKibben muscle, essentially latex chambers covered with braided fibers. The muscles respond like springs to apply force when the user moves their fingers. The board controls the muscles by inflating and deflating them.The system involves three main components: a Leap Motion sensor that detects the position and movement of the user’s hands; a custom fluidic control board that controls the gloves’ movements; and soft robotic components in the glove that individually inflate or deflate to mimic the forces that the user would encounter in the VR environment. The system interacts with a computer that displays a virtual piano keyboard with a river and trees in the background.

Researchers 3D-printed a mold to make the gloves’ soft exoskeleton. This will make the devices easier to manufacture and suitable for mass production, they said. Researchers used silicone rubber for the exoskeleton, with Velcro straps embedded at the joints.

Engineers conducted an informal pilot study of 15 users, including two VR interface experts. All tried the demo which allowed them to play the piano in VR. They all agreed that the gloves increased the immersive experience. They described it as “mesmerizing” and “amazing.”

The engineers are working on making the glove cheaper, less bulky and more portable. They also would like to bypass the Leap Motion device altogether to make system more compact.

“Our final goal is to create a device that provides a richer experience in VR,” Tolley said. “But you could imagine it being used for surgery and video games, among other applications.”

Tolley is a faculty member in the Contextual Robotics Institute at UC San Diego. Schulze is an adjust professor in computer science, where he teaches courses on VR.


Learn more: A glove powered by soft robotics to interact with virtual reality environments


The Latest on: VR interfaces
  • A Year Later, What Oculus Touch Has Meant For VR
    on December 9, 2017 at 7:47 pm

    In VR, this has become an expected way of interaction, whether you’re using the Touch or HTC Vive controllers. To mark the occasion, Oculus has released the beta version of Rift Core 2.0, an update to the Rift user interface that streamlines navigation. […]

  • New Oculus Rift Core 2.0 lets you build a VR home of your own
    on December 8, 2017 at 2:39 pm

    Facebook's VR subsidiary Oculus has announced the launch of Rift Core 2.0, a new interface for the Oculus Rift headset that essentially overhauls the system. It's only in beta for now, so you'll need to opt in via the Public Test Channel if you want to try ... […]

  • VR pioneer Jaron Lanier on dystopia, empathy, and the future of the internet
    on December 8, 2017 at 9:37 am

    But yeah, it’s one of the many wonderful VR devices lost to the sands of time. That does sound really disgusting. It is absolutely the most repulsive user interface item I have ever seen. Well, it’s got some competition. But it’s up there. […]

  • VR transforms health care: 3D human model coming to a school near you
    on December 8, 2017 at 7:30 am

    Once this has been completed, the user interface is constructed and the content is formatted ... This would then allow for more precise targeting of tumors within the body. VR projects like the “3D Definitive Human” are a great stride forward but ... […]

  • These are the 9 Cutting Edge VR/AR Startups that Rocked the Stage at Exploring Future Reality
    on December 8, 2017 at 5:27 am

    Recently, the NYC Media Lab presented an outstanding VR/AR event called Exploring Future Reality ... Brought to life in Columbia University’s Computer Graphics and User Interfaces Lab in conjunction with the knowledge of current Columbia MD students ... […]

  • Daydream App Now Lets You Find Content Outside VR
    on December 7, 2017 at 3:52 pm

    On top of the new interface rolling out, Google has posted up a rundown of a few notable VR experiences that you can download through the new face of the Daydream app, and even put a few of those on sale at a discount for the holidays. On special sale ... […]

  • Oculus Rift Core 2.0 tries to push VR forward
    on December 7, 2017 at 12:00 am

    Oculus, perhaps the pioneer of this VR renaissance, wants to at least change the latter ... This time, it’s going after the software side with Rift Core 2.0. Specifically, the new Dash interface that lets you use your Windows software inside the virtual ... […]

  • Yi’s 360 VR Pocket Camera Shoots Up To 5.7k And Has Built-in 4K Stitching
    on December 4, 2017 at 12:00 am

    That is why we worked so hard to perfect YI 360 VR. By combining the best components, rigorous industrial design and many years of testing, we eliminated the cables, confusing interfaces and bulky components and added 5.7K fidelity, 4K in-device stitching ... […]

  • How NVIDIA Research is Reinventing the Display Pipeline for the Future of VR, Part 1
    on December 1, 2017 at 8:02 am

    Our vision is that VR will be the interface to all computing. It will replace cell phone displays, computer monitors and keyboards, televisions and remotes, and automobile dashboards. To keep terminology simple, we use VR as shorthand for supporting all ... […]

  • Oculus' reworked VR interfaces will be ready to test in December
    on November 28, 2017 at 1:35 pm

    Rift Core 2.0 and the desktop app are arriving in beta. If you happen to have an Oculus Rift headset and want to try its big interface makeovers, you won't have to wait long. As promised, Oculus has confirmed that both its Rift Core 2.0 VR interface and ... […]

via Google News and Bing News

Other Interesting Posts

Leave a Reply

%d bloggers like this: