Imagine holding hands with a loved one on the other side of the world. Or feeling a pat on the back from a teammate in the online game “Fortnite.”
Northwestern University researchers have developed a new thin, wireless system that adds a sense of touch to any virtual reality (VR) experience. Not only does this platform potentially add new dimensions to our long-distance relationships and entertainment, the technology also provides prosthetics with sensory feedback and imparts telemedicine with a human touch.
Referred to as an “epidermal VR” system, the device communicates touch through a fast, programmable array of miniature vibrating actuators embedded into a thin, soft, flexible material. The 15-centimeter-by-15-centimeter sheet-like prototypes comfortably laminate onto the curved surfaces of the skin without bulky batteries and cumbersome wires.
“People have contemplated this overall concept in the past, but without a clear basis for a realistic technology with the right set of characteristics or the proper form of scalability. Past designs involve manual assemblies of actuators, wires, batteries and combined internal and external control hardware,” said Northwestern’s John A. Rogers, a bioelectronics pioneer. “We leveraged our knowledge in stretchable electronics and wireless power transfer to put together a superior collection of components, including miniaturized actuators, in an advanced architecture designed as a skin-interfaced wearable device — with almost no encumbrances on the user. We feel that it’s a good starting point that will scale naturally to full-body systems and hundreds or thousands of discrete, programmable actuators.”
“We are expanding the boundaries and capabilities of virtual and augmented reality,” said Northwestern’s Yonggang Huang, who co-led the research with Rogers. “By comparison to the eyes and the ears, the skin is a relatively underexplored sensory interface that could significantly enhance experiences.”
The research will be published on Nov. 21 in the journal Nature.
How it works
Rogers and Huang’s most sophisticated device incorporates a distributed array of 32 individually programmable, millimeter-scale actuators, each of which generates a discrete sense of touch at a corresponding location on the skin. Each actuator resonates most strongly at 200 cycles per second, where the skin exhibits maximum sensitivity.
“We can adjust the frequency and amplitude of each actuator quickly and on-the-fly through our graphical user interface,” Rogers said. “We tailored the designs to maximize the sensory perception of the vibratory force delivered to the skin.”
The patch wirelessly connects to a touchscreen interface (on a smartphone or tablet). When a user touches the touchscreen, that pattern of touch transmits to the patch. If the user draws an “X” pattern on the touchscreen, for example, the devices produce a sensory pattern, simultaneously and in real-time, in the shape of an “X” through the vibratory interface to the skin.
When video chatting from different locations, friends and family members can reach out and virtually touch each other — with negligible time delay and with pressures and patterns that can be controlled through the touchscreen interface.
“You could imagine that sensing virtual touch while on a video call with your family may become ubiquitous in the foreseeable future,” Huang said.
The actuators are embedded into an intrinsically soft and slightly tacky silicone polymer that adheres to the skin without tape or straps. Wireless and battery-free, the device communicates through near-field communication (NFC) protocols, the same technology used in smart phones for electronic payments.
You could imagine that sensing virtual touch while on a video call with your family may become ubiquitous in the foreseeable future.”
“With this wireless power delivery scheme, we completely avoid the need for batteries, with their weight, size, bulk and limited operating lifetimes,” Rogers said. “The result is a thin, lightweight system that can be worn and used without constraint, indefinitely.”
Veteran describes importance of sensory feedback
Everyone can imagine how this type of technology could be combined with a VR headset to create more interactive and immersive gaming or entertainment experiences. But for U.S. Army veteran Garrett Anderson, epidermal VR might provide a much-needed solution to a real-life problem.
At 4 a.m. on Oct. 15, 2005, Anderson was ambushed during his deployment in the Iraq War and lost his right arm just below the elbow.
“A bomb exploded under my truck,” Anderson said. “It blew the entire engine out of the vehicle. Then shrapnel came through the vehicle and severed my arm, which was hanging on by tendons.”
Anderson recently tried Northwestern’s system, integrated with his prosthetic arm. When wearing the patch on his upper arm, Anderson could feel sensations from his prosthetic fingertips transmitted to his arm. The vibrations felt more or less intense, depending on the firmness of his grip.
I need to know the amount of grip that I’m applying, so that I don’t hurt something or someone.”
Sgt. Garrett Anderson
U.S. Army veteran
“Say that I’m grabbing an egg or something fragile,” said Anderson, who is now the outreach coordinator at the University of Illinois’ Chez Veterans Center. “If I can’t adjust my grip, then I might crush the egg. I need to know the amount of grip that I’m applying, so that I don’t hurt something or someone.”
‘I have never felt them with my right arm’
As people who have had amputations use the device, the experience could become more seamless.
“Users develop an ability to sense touch at the fingertips of their prosthetics through the sensory inputs on the upper arm,” Rogers explained. “Overtime, your brain can convert the sensation on your arm to a surrogate sense of feeling in your fingertips. It adds a sensory channel to reproduce the sense of touch.”
Anderson believes this device could potentially “trick” his brain in a way that relieves phantom pain. He also imagines that it could allow him to interact with his children in a new way.
“I lost my arm 15 years ago,” he said. “My kids are 13 and 10, so I have never felt them with my right arm. I don’t know what it’s like when they grab my right hand.”
‘A starting point’
Rogers views the current device as a starting point. “This is our first attempt at a system of this type,” he said. “It could be very powerful for social interactions, clinical medicine and applications that we cannot conceive of today, beyond the obvious opportunities in gaming and entertainment.”
He and Huang are already working to make the current device slimmer and lighter. They also plan to exploit different types of actuators, including those that can produce heating and stretching sensations. With thermal inputs, for example, a person might be able to sense how hot a cup of coffee is through prosthetic fingertips.
The Northwestern team believes the overall engineering framework can accommodate hundreds of actuators with dimensions significantly smaller than those used currently, which have diameters of 18 millimeters and thicknesses of 2.5 millimeters.
Eventually, the devices could be thin and flexible enough to be woven into clothes. People with prosthetics could wear VR shirts that communicate touch through their fingertips. And along with VR headsets, gamers could wear full VR suits to become fully immersed into fantastical landscapes.
“Virtual reality is a very important emerging area of technology,” Rogers said. “Currently, we’re just using our eyes and our ears as the basis for those experiences. The community has been comparatively slow to exploit the body’s largest organ: the skin. Our sense of touch provides the most profound, deepest, emotional connection between people.”
Learn more: ‘Epidermal VR’ gives technology a human touch
The Latest on: Virtual reality
- The Best Black Friday virtual reality headset deals in 2019on November 29, 2019 at 8:27 am
Virtual reality didn’t take off quite as quickly as the early hype led many to believe it would, but in recent years, there have been some great developments in the world of VR. From new-and-improved ...
- Virtual reality helps ease trauma for patients at Tampa veterans hospitalon November 29, 2019 at 8:05 am
Recreation therapist James Kaplan sat Stewart down in a comfortable chair and handed him a virtual reality headset. Stewart, 59, had heard about virtual reality as therapy for veterans like him with ...
- Virtual reality won't make cows happier, but it might help us see them differentlyon November 29, 2019 at 7:43 am
Earlier this week, Russian farmers announced they are testing virtual reality (VR) for dairy cows. Conducted at the RusMoloko farm near Moscow, the trials supposedly use specially adapted goggles to ...
- Virtual Reality Used To Relax Cows Into Producing More Milkon November 29, 2019 at 5:17 am
Cows have been given VR headsets to help them forget about the cold weather during Russia's long ... [+] winters. (Photo by John Milner/SOPA Images/LightRocket via Getty Images) Virtual reality is ...
- Virtual Reality Software Market Size, Status, Benefits, Business Opportunities and Future Scope, Forecast to 2025on November 29, 2019 at 2:12 am
Nov 29, 2019 (Market Insight Reports via COMTEX) -- The global Virtual Reality Software Market research report covering growth prospects, market development potential, profitability, supply and demand ...
- Virtual Reality Gaming Market 2019 Global Industry Trends, Growth, Share, Size and 2026 Forecast Research Reporton November 28, 2019 at 11:33 pm
Nov 29, 2019 (The Expresswire) -- Top Players in Virtual Reality Gaming Market are Electronic Arts Inc., Google, HTC Corporation, Oculus VR, LLC, SAMSUNG Group, Sony Corporation, ZEISS International, ...
- Worldwide Spending on Augmented and Virtual Reality Expected to Reach $18.8 Billion in 2020, According to IDCon November 27, 2019 at 4:11 pm
Worldwide spending on augmented reality and virtual reality (AR/VR) is forecast to be $18.8 billion in 2020, an increase of 78.5% over the $10.5 billion International Data Corporation (IDC) expects ...
- Updated: PAR, Inc. invests in virtual reality training start-up Immertecon November 27, 2019 at 4:11 pm
LUTZ, Fla., Nov. 27, 2019 /PRNewswire/ -- PAR, Inc. announced recently it has invested in local start-up Immertec, a company that applies virtual reality technology to medical and surgical training.
- Valve's "Half-Life: Alyx" Will Be Virtual Reality's First Killer Appon November 27, 2019 at 12:16 pm
Steep hardware prices and a lack of big-budget, must-have content have been key limiting factors in the growth of virtual reality (VR). However, headset prices are starting to come down, and VR's ...
- Enter The Tomb Of King Tut Through An Astonishing Virtual Reality Experienceon November 27, 2019 at 8:35 am
1342 – c. 1325 BC) in Egypt’s Valley of the Kings. The largest collection of King Tut’s treasures ever to travel outside of Egypt is on display until next spring, along with a brilliant virtual ...
via Bing News
The Latest on: Epidermal VR
- A hug thanks to haptic VR device; Membrane protects pacemakerson November 29, 2019 at 2:24 am
Referred to as an epidermal VR system, the device communicates touch through a fast, programmable array of miniature vibrating actuators embedded into a thin, soft, flexible material. The 15cm x 15cm ...
- Watch: ‘Epidermal VR’ brings a sense of human touch to virtual reality [video]on November 25, 2019 at 8:22 am
Up until now, though, VR sensory input has been limited to sight and sound. Researchers at Illinois’ Northwestern University and the City University of Hong Kong have developed a prototype of a new ...
- 'Epidermal VR' | Now users can touch each other during video call: Studyon November 24, 2019 at 8:32 am
In a similar manner, mo-pictures running on screen can also be felt while playing a movie. Also Read: Vivo U20, with 5000 mAh battery, launched in India; check price, specs and details here ...
- Epidermal VR Gives Technology a Human Touch | IDTechEx Research Articleon November 23, 2019 at 12:01 am
Eventually, the devices could be thin and flexible enough to be woven into clothes. People with prosthetics could wear VR shirts that communicate touch through their fingertips. And along with VR ...
- ‘Epidermal VR’ gives technology human touchon November 21, 2019 at 2:17 am
Referred to as an “epidermal VR” system, the device communicates touch through a fast, programmable array of miniature vibrating actuators embedded into a thin, soft, flexible material. These ...
- New skin patch provides VR experience via touch: Studyon November 21, 2019 at 12:44 am
Washington, Nov 21 (PTI) Researchers have developed a new thin, wireless system that adds a sense of touch to any virtual reality (VR) experience, an advance that may lead to new dimensions in ...
- 'Epidermal VR' gives technology a human touchon November 20, 2019 at 12:28 pm
Referred to as an "epidermal VR" system, the device communicates touch through a fast, programmable array of miniature vibrating actuators embedded into a thin, soft, flexible material. The ...
- New Epidermal Virtual Reality System Gives Technology a Human Touchon November 20, 2019 at 11:06 am
‘New virtual reality system has applications in social interactions, prosthetics, telemedicine and entertainment.’ Show Full Article Referred to as an "epidermal VR" system, the device communicates ...
- Artificial skin that can sense TOUCH could allow you to embrace a loved one thousands of miles awayon November 20, 2019 at 10:10 am
Described as an 'epidermal VR' system, the artificial skin consists of a six-inch-square sheet of thin, soft, flexible material, embedded with 32 tiny vibrating actuators. The frequency and amplitude ...
- Skin-integrated wireless haptic interfaces for virtual and augmented realityon November 20, 2019 at 10:05 am
Fig. 1: Design and architecture of an epidermal VR system. Fig. 2: Optimized operation of key electrical and mechanical components of an epidermal VR system. Kapur, P., Jensen, M., Buxbaum, L. J., Jax ...
via Bing News