Engineers at the University of California San Diego have developed a smart glove that wirelessly translates the American Sign Language alphabet into text and controls a virtual hand to mimic sign language gestures. The device, which engineers call “The Language of Glove,” was built for less than $100 using stretchable and printable electronics that are inexpensive, commercially available and easy to assemble.
The work was published on July 12 in the journal PLOS ONE.
In addition to decoding American Sign Language gestures, researchers are developing the glove to be used in a variety of other applications ranging from virtual and augmented reality to telesurgery, technical training and defense.
“Gesture recognition is just one demonstration of this glove’s capabilities,” said Timothy O’Connor, a nanoengineering Ph.D. student at UC San Diego and the first author of the study. “Our ultimate goal is to make this a smart glove that in the future will allow people to use their hands in virtual reality, which is much more intuitive than using a joystick and other existing controllers. This could be better for games and entertainment, but more importantly for virtual training procedures in medicine, for example, where it would be advantageous to actually simulate the use of one’s hands.”
The glove is unique in that it has sensors made from stretchable materials, is inexpensive and simple to manufacture. “We’ve innovated a low-cost and straightforward design for smart wearable devices using off-the-shelf components. Our work could enable other researchers to develop similar technologies without requiring costly materials or complex fabrication methods,” said Darren Lipomi, a nanoengineering professor who is a member of the Center for Wearable Sensors at UC San Diego and the study’s senior author.
The ‘Language of Glove’
The team built the device using a leather athletic glove and adhered nine stretchable sensors to the back at the knuckles — two on each finger and one on the thumb. The sensors are made of thin strips of a silicon-based polymer coated with a conductive carbon paint. The sensors are secured onto the glove with copper tape. Stainless steel thread connects each of the sensors to a low power, custom-made printed circuit board that’s attached to the back of the wrist.
The sensors change their electrical resistance when stretched or bent. This allows them to code for different letters of the American Sign Language alphabet based on the positions of all nine knuckles. A straight or relaxed knuckle is encoded as “0” and a bent knuckle is encoded as “1”. When signing a particular letter, the glove creates a nine-digit binary key that translates into that letter. For example, the code for the letter “A” (thumb straight, all other fingers curled) is “011111111,” while the code for “B” (thumb bent, all other fingers straight) is “100000000.” Engineers equipped the glove with an accelerometer and pressure sensor to distinguish between letters like “I” and “J”, whose gestures are different but generate the same nine-digit code.
The low power printed circuit board on the glove converts the nine-digit key into a letter and then transmits the signals via Bluetooth to a smartphone or computer screen. The glove can wirelessly translate all 26 letters of the American Sign Language alphabet into text. Researchers also used the glove to control a virtual hand to sign letters in the American Sign Language alphabet.
Moving forward, the team is developing the next version of this glove — one that’s endowed with the sense of touch. The goal is to make a glove that could control either a virtual or robotic hand and then send tactile sensations back to the user’s hand, Lipomi said. “This work is a step toward that direction.”
The Latest on: smart glove
- Washable smart fabric uses magnetic thread to store data on November 16, 2017 at 10:29 pm
Examples of this that have recently been featured by Springwise include a glasses add-on that improves situational awareness for deaf and hard-of-hearing individuals, and a bionic smart glove that increases hand strength for the wearer. Which parts of the ... […]
- Wear next for smart technology? on November 16, 2017 at 7:13 am
Current uses of smart textiles include ‘smart gloves’ which monitor Parkinson’s disease patients and potential developments in the future could see wearable-displays or sensors printed onto fabrics. “Thanks to nanotechnology, in the future our ... […]
- Why Sign-Language Gloves Don't Help Deaf People on November 10, 2017 at 11:51 am
On July 12, the UCSD news office promoted Lipomi’s publication with a story proclaiming, “Low-cost smart glove translates American Sign Language alphabet and controls virtual objects.” The next day, the online outlet Medgadget lopped “alphabet ... […]
- The Best Touchscreen Gloves on November 7, 2017 at 7:09 am
So, in the interest of helping you stay both connected and warm, we’ve compiled a list of all the best touchscreen gloves you should totally get your hands on (and in) this winter. Over the past week, I’ve tried out a lot of smart gloves, and Mujjo’s ... […]
- The Nuada smart glove gives your hand bionic powers on September 18, 2017 at 2:35 pm
In the future, said Andy Warhol, everyone will be bionic for fifteen minutes. I’m paraphrasing, but it looks like a Portuguese company called Nuada is about to give us that opportunity. Created by Filipe Quinaz and Vitor Crespo, the seed-funded company ... […]
- New low-cost smart glove can translate sign language on July 17, 2017 at 3:37 am
Scientists have created a low-cost smart glove that can wirelessly translate sign language into text and control objects in virtual reality games. The device, called “The Language of Glove,” was built for less than USD 100 using stretchable and ... […]
- 'Smart glove' can translate sign language on July 15, 2017 at 4:28 pm
(KPBS) UC San Diego researchers have designed a “smart glove” that can turn sign language into text that can be wirelessly transmitted to mobile devices, all for less than $100. The glove is outfitted with sensors that stretch over the user’s ... […]
- A New ‘Smart Glove’ Converts Sign Language Into Digital Text on July 12, 2017 at 11:50 pm
As detailed in the journal PLOS One, researchers at UC San Diego have developed a low-cost smart glove that automatically translates ... Get six of our favorite Motherboard stories every day by signing up for our newsletter. […]
- Low-Cost Smart Glove Translates American Sign Language Alphabet and Controls Virtual Objects on July 11, 2017 at 2:05 pm
Newswise — Engineers at the University of California San Diego have developed a smart glove that wirelessly translates the American Sign Language alphabet into text and controls a virtual hand to mimic sign language gestures. The device, which engineers ... […]
- Smart glove helps stroke patients rehabilitate on January 5, 2017 at 12:59 am
After his father and two uncles suffered strokes, Hoyoung Ban decided to develop a device to help people regain control of their hands. Called the Rapael Smart Glove from Neofect, the white glove wraps around a patient's hand and has movement and position ... […]
via Google News and Bing News