Robot avatars programmed to talk with their hands to be understood better
In the world of robot communication, it seems actions speak louder than words. Scientists in the UK have discovered that by getting robot avatars to “talk with their hands,” we understand them as well as we do our fellow human beings.
Avatars have been in existence since the 1980s and today are used by millions of people across the globe. They are big business too: from artificial intelligence to social media and psychotherapy to high-end video games, they are used to sell things, to solve problems, to teach us and to entertain us. As avatars become more sophisticated, and their use in society grows, research is focusing on how to improve communication with them. Getting your message across with your avatar is more important than ever, and learning how to improve this communication is a big deal.
Scientists Paul Bremner and Ute Leonards took on this challenge in a recent study published in Frontiers in Psychology. They built their study around the hypothesis that if avatars were to use “iconic” hand gestures together with speech, we would understand them more easily. Iconic gestures have a distinct meaning, like opening a door or a book, and using gestures together with speech is known as “multi-modal communication.” The aim of the study was to discover if people could understand avatars performing multi-modal communication as well as they could a human actor. The study also investigated if multi-modal communication by an avatar was more understandable than speech alone.
To test their theory, the scientists filmed an actor reading out a series of phrases whilst performing specific iconic gestures. They then filmed an avatar using these recorded phrases and mimicking the gestures. Films of both the actor and avatar were then shown to the experiment participants, who had to identify what the human and avatar were trying to communicate. The research was a success: the scientists were able to prove that multi-modal communication by avatars is indeed more understandable than speech alone. Not only that, but when using multi-modal communication, we understand them as well as we do humans.
Getting avatars to talk with their hands in the same way that humans do was a challenge in itself. Whilst performing the gestures, the actor used state-of-the-art technology. His movements were tracked using a Microsoft Kinect sensor so that his arm gestures could be recorded as data. The avatar used this data to mimic his gestures. The equipment did have some limitations however; the avatar does not have the same hand shape or degree of movement available as a human – something the pair plans to work on in the future.
Despite the limitations, the scientists’ research showed that their method of translating human gestures to an avatar was successful. More importantly, they are confident that the avatar gestures, when used with speech, are as easily understood as from a human. Now that this is established, the pair plans to carry out more research in the field.
Future work will involve looking at more types of gestures and in different settings, plus how to make the translation of gestures from human to avatar more efficient. There will be plenty of work to keep them going – they have yet to take on different cultures, and Italy, a nation of people famed for expressive hand gestures, is still on the horizon.
The Latest on: Robot communications
via Google News
The Latest on: Robot communications
- UNDP presents robots help protect frontline health workerson June 27, 2020 at 3:49 am
The United National Development Programme (UNDP) has donated three Ohmni Robots to the National Hospital for Tropical Diseases to help protect frontline doctors and nurses from COVID-19 and other ...
- Cheetah Mobile's Robots Help Healthcare Professionals Combat COVID-19on June 26, 2020 at 11:33 am
in addition to several other functions using natural voice communication, facial recognition and hospital navigation. The robots also help guide preliminary diagnosis and treatment, primary disclosure ...
- What would robot vs robot war look like?on June 26, 2020 at 10:58 am
The Chinese Army is preparing to deploy small, new, tracked war-robots armed with machine guns, night vision, missile loaders and camera sensors to conduct attacks while leaving manned systems at ...
- Medical Robots Market Worth $20.70 Billion, Globally, by 2027 at 14.2% CAGR: Verified Market Researchon June 26, 2020 at 7:35 am
The robot-assisted operation allows the doctors ... Automotive & Transportation, Information & Communication Technology, Software & Services, Information Security, Mining, Minerals & Metals ...
- Birmingham security firm marketing semi-autonomous robot guardson June 25, 2020 at 4:20 pm
The company says the unit provides real-time video feeds along with AI powered image classification and an IP based two-way communications platform.
- Don't fear the robots: Helping future workers learn how to innovateon June 18, 2020 at 5:52 am
Flinders University's Professor Giselle Rampersad has undertaken a study to investigate key factors that drive innovation among Worker Integrated Learning students and has found that upskilling ...
- 5G is coming to robots and drones with Qualcomm's new RB5 systemon June 17, 2020 at 4:32 am
The technology, which combines hardware and software, will make it possible for places like factories to roll out super responsive machines.
- Touching the social robot PARO reduces pain perception and salivary oxytocin levelson June 17, 2020 at 2:28 am
Human-human social touch improves mood and alleviates pain. No studies have so far tested the effect of human-robot emotional touch on experimentally induced pain ratings, on mood and on oxytocin ...
- Nanomaterial gives robots chameleon skinon June 17, 2020 at 12:32 am
A new film made of gold nanoparticles changes color in response to any type of movement. Its unprecedented qualities could allow robots to mimic chameleons and octopi—among other futuristic ...
- Terrifying robot dog now available for private useon June 16, 2020 at 12:30 pm
Now Spot, the robotic quadruped that's starred in recent videos, is available for sale commercially. Best telepresence robots for business in 2020: Double Robotics, OhmniLabs, Meeting Owl, and more ...
via Bing News