Engineers at the University of California San Diego have developed a smart glove that wirelessly translates the American Sign Language alphabet into text and controls a virtual hand to mimic sign language gestures. The device, which engineers call “The Language of Glove,” was built for less than $100 using stretchable and printable electronics that are inexpensive, commercially available and easy to assemble.
The work was published on July 12 in the journal PLOS ONE.
In addition to decoding American Sign Language gestures, researchers are developing the glove to be used in a variety of other applications ranging from virtual and augmented reality to telesurgery, technical training and defense.
“Gesture recognition is just one demonstration of this glove’s capabilities,” said Timothy O’Connor, a nanoengineering Ph.D. student at UC San Diego and the first author of the study. “Our ultimate goal is to make this a smart glove that in the future will allow people to use their hands in virtual reality, which is much more intuitive than using a joystick and other existing controllers. This could be better for games and entertainment, but more importantly for virtual training procedures in medicine, for example, where it would be advantageous to actually simulate the use of one’s hands.”
The glove is unique in that it has sensors made from stretchable materials, is inexpensive and simple to manufacture. “We’ve innovated a low-cost and straightforward design for smart wearable devices using off-the-shelf components. Our work could enable other researchers to develop similar technologies without requiring costly materials or complex fabrication methods,” said Darren Lipomi, a nanoengineering professor who is a member of the Center for Wearable Sensors at UC San Diego and the study’s senior author.
The ‘Language of Glove’
The team built the device using a leather athletic glove and adhered nine stretchable sensors to the back at the knuckles — two on each finger and one on the thumb. The sensors are made of thin strips of a silicon-based polymer coated with a conductive carbon paint. The sensors are secured onto the glove with copper tape. Stainless steel thread connects each of the sensors to a low power, custom-made printed circuit board that’s attached to the back of the wrist.
The sensors change their electrical resistance when stretched or bent. This allows them to code for different letters of the American Sign Language alphabet based on the positions of all nine knuckles. A straight or relaxed knuckle is encoded as “0” and a bent knuckle is encoded as “1”. When signing a particular letter, the glove creates a nine-digit binary key that translates into that letter. For example, the code for the letter “A” (thumb straight, all other fingers curled) is “011111111,” while the code for “B” (thumb bent, all other fingers straight) is “100000000.” Engineers equipped the glove with an accelerometer and pressure sensor to distinguish between letters like “I” and “J”, whose gestures are different but generate the same nine-digit code.
The low power printed circuit board on the glove converts the nine-digit key into a letter and then transmits the signals via Bluetooth to a smartphone or computer screen. The glove can wirelessly translate all 26 letters of the American Sign Language alphabet into text. Researchers also used the glove to control a virtual hand to sign letters in the American Sign Language alphabet.
Moving forward, the team is developing the next version of this glove — one that’s endowed with the sense of touch. The goal is to make a glove that could control either a virtual or robotic hand and then send tactile sensations back to the user’s hand, Lipomi said. “This work is a step toward that direction.”
The Latest on: smart glove
- This Is the Smart Home of the Future on February 16, 2018 at 6:10 am
They will actually interact with you, tracking health markers and habits. Among them: MadeWithGlove’s still-in-development smart gloves, which promise to detect skin temperature and provide heat accordingly. Your clothes might even change shape or color ... […]
- Wearable Sensors Measure Water Use in Crops on February 16, 2018 at 5:09 am
The graphene-on-tape technology in this study has also been used to produce wearable strain and pressure sensors, including sensors built into a “smart glove” that measures hand movements. Researchers describe the various sensors and the “simple and ... […]
- Kjus BT 2.0 Glove review: ski gloves with Bluetooth and OLED display on February 10, 2018 at 12:00 pm
Gloves have a simple, yet critical mission: to protect and warm your hands. But the Kjus BT 2.0 Gloves do more. These smart gloves with an OLED display serve as an extension of the smartphone, so that you can always be connected while skiing without having ... […]
- NapoSpy Smart Leather Gloves Launch On KickStarter on February 6, 2018 at 6:21 pm
NapoSpy Gloves are a unique glove enabled with smart touch technology and tracking to prevent loss. NapoSpy Gloves come with a smartphone application to help find missing gloves and trigger a buzzer for easy location. Made with Ethiopian lambskin leather ... […]
- Smart biometric gloves to help teams monitor F1 drivers’ stress on February 5, 2018 at 11:01 pm
The smart gloves will store encrypted health data during the race and make it available to teams after the race. The idea is to help the teams regulate the health of their drivers in F1’s ultra stressy environment. Motorsports is considered one of the ... […]
- F1’s new smart gloves to help teams monitor drivers’ stress on February 5, 2018 at 11:00 pm
The smart gloves will store encrypted health data during the race and make it available to teams after the race. Motorsports is considered one of the most dangerous yet exciting forms of sports in the world, Formula 1 represents the most technologically ... […]
- New low-cost smart glove can translate sign language on July 17, 2017 at 3:37 am
Scientists have created a low-cost smart glove that can wirelessly translate sign language into text and control objects in virtual reality games. The device, called “The Language of Glove,” was built for less than USD 100 using stretchable and ... […]
- This ‘Smart Glove’ Can Translate Sign Language on July 12, 2017 at 3:07 pm
You have heard of smartphones and smart watches. Now, UC San Diego researchers have built a "smart glove" that can translate sign language gestures into text displayed on a mobile device — all for less than $100. UC San Diego researchers have designed a ... […]
- Smart glove helps stroke patients rehabilitate on January 5, 2017 at 12:59 am
After his father and two uncles suffered strokes, Hoyoung Ban decided to develop a device to help people regain control of their hands. Called the Rapael Smart Glove from Neofect, the white glove wraps around a patient's hand and has movement and position ... […]
- ProGlove brings smart gloves to the factory floor on June 28, 2016 at 8:07 am
It’s not often you hear of a start-up product that emerged from a student working in a car factory. But ProGlove’s co-founder Paul Günther’s foray into the startup world was preceded by employment at BMW. During his studies, he was in touch daily ... […]
via Google News and Bing News