A new computer software programme has the potential to lip-read more accurately than people and to help those with hearing loss, Oxford University researchers have found.
Watch, Attend and Spell (WAS), is a new artificial intelligence (AI) software system that has been developed by Oxford, in collaboration with the company DeepMind.
The AI system uses computer vision and machine learning methods to learn how to lip-read from a dataset made up of more than 5,000 hours of TV footage, gathered from six different programmes including Newsnight, BBC Breakfast and Question Time. The videos contained more than 118,000 sentences in total, and a vocabulary of 17,500 words.
The research team compared the ability of the machine and a human expert to work out what was being said in the silent video by focusing solely on each speaker’s lip movements. They found that the software system was more accurate compared to the professional. The human lip-reader correctly read 12 per cent of words, while the WAS software recognised 50 per cent of the words in the dataset, without error. The machine’s mistakes were small, including things like missing an “s” at the end of a word, or single letter misspellings.
The software could support a number of developments, including helping the hard of hearing to navigate the world around them. Speaking on the tech’s core value, Jesal Vishnuram, Action on Hearing Loss Technology Research Manager, said: ‘Action on Hearing Loss welcomes the development of new technology that helps people who are deaf or have a hearing loss to have better access to television through superior real-time subtitling.
‘It is great to see research being conducted in this area, with new breakthroughs welcomed by Action on Hearing Loss by improving accessibility for people with a hearing loss. AI lip-reading technology would be able to enhance the accuracy and speed of speech-to-text especially in noisy environments and we encourage further research in this area and look forward to seeing new advances being made.’
Commenting on the potential uses for WAS Joon Son Chung, lead-author of the study and a graduate student at Oxford’s Department of Engineering, said: ‘Lip-reading is an impressive and challenging skill, so WAS can hopefully offer support to this task – for example, suggesting hypotheses for professional lip readers to verify using their expertise. There are also a host of other applications, such as dictating instructions to a phone in a noisy environment, dubbing archival silent films, resolving multi-talker simultaneous speech and improving the performance of automated speech recognition in general.’
Receive an email update when we add a new ARTIFICIAL INTELLIGENCE article.
The Latest on: Artificial intelligence
via Google News
The Latest on: Artificial intelligence
- Global Artificial Intelligence (AI) In Agriculture Market Growth, Insights and Research Forecasts 2019-2028on August 17, 2019 at 12:15 am
Aug 17, 2019 (WiredRelease via COMTEX) -- The report attempts to offer high-quality and accurate analysis of the Global Artificial Intelligence (AI) in Agriculture Market, keeping in view market ...
- Jeffrey Tarrant Saw Artificial Intelligence as the Future of Managing Moneyon August 16, 2019 at 12:30 pm
Even while being treated for the brain cancer that would cut his life short, Jeffrey Tarrant was searching for the next frontier in investing. He figured it would involve the use of artificial ...
- Artificial Intelligence (AI) Robots Market with Growing CAGR in Forecast Period 2019 to 2026on August 16, 2019 at 6:30 am
Aug 16, 2019 (Global QYResearch via COMTEX) -- A new research report titled “Global Artificial Intelligence (AI) Robots Market” successfully exhibits the complete scenario of the global and an ...
- New York-based artificial intelligence unicorn co. hires 71 for Houston office, aims to hire moreon August 16, 2019 at 6:26 am
New York-based UiPath Inc., one of the world’s largest artificial intelligence-focused startups, is officially opening its Houston office Aug. 22. Marie Myers, the Houston-based CFO of UiPath and a ...
- 'Stereotyping' emotions is getting in the way of artificial intelligence. Scientists say they've discovered a better way.on August 16, 2019 at 5:07 am
If you want to understand what people are feeling, you have to look beyond surface-level cues. Technology like AI could fall short without this.
- Staying Smart: How artificial intelligence could impact companies, customers and competitionon August 16, 2019 at 4:00 am
Until recently, artificial intelligence (AI) was limited to movies and science fiction. That’s rapidly changing however as advances in computing power and the creation of massive data sets have made ...
- Artificial Intelligence Technology Solutions Receives PO for High End Retail Location Owned by Billion Dollar Real Estate Fundon August 15, 2019 at 11:10 am
RENO, NV, Aug. 15, 2019 (GLOBE NEWSWIRE) -- via NEWMEDIAWIRE – Artificial Intelligence Technology Solutions, Inc. (AITX:OTCPK), is pleased to announce that Robotic Assistance Devices (RAD), its ...
- Cab Aggregator Unicorn Ola Acquires Artificial Intelligence Platform Pickup.aion August 15, 2019 at 8:16 am
Bengaluru-based cab aggregator unicorn Ola has acquired Bengaluru-based artificial intelligence platform Pickup.ai. As part of the deal, the co-founders and employees of Pikup.ai will join the Ola ...
- The Skeptic's Guide To Assessing Artificial Intelligenceon August 15, 2019 at 5:32 am
Humans have a tendency to race toward the next big breakthrough. In the 1960s, we were part of a race to the moon. The early 2000s was a race for the best consumer electronics. Now we are on a race ...
via Bing News