A new computer software programme has the potential to lip-read more accurately than people and to help those with hearing loss, Oxford University researchers have found.
Watch, Attend and Spell (WAS), is a new artificial intelligence (AI) software system that has been developed by Oxford, in collaboration with the company DeepMind.
The AI system uses computer vision and machine learning methods to learn how to lip-read from a dataset made up of more than 5,000 hours of TV footage, gathered from six different programmes including Newsnight, BBC Breakfast and Question Time. The videos contained more than 118,000 sentences in total, and a vocabulary of 17,500 words.
The research team compared the ability of the machine and a human expert to work out what was being said in the silent video by focusing solely on each speaker’s lip movements. They found that the software system was more accurate compared to the professional. The human lip-reader correctly read 12 per cent of words, while the WAS software recognised 50 per cent of the words in the dataset, without error. The machine’s mistakes were small, including things like missing an “s” at the end of a word, or single letter misspellings.
The software could support a number of developments, including helping the hard of hearing to navigate the world around them. Speaking on the tech’s core value, Jesal Vishnuram, Action on Hearing Loss Technology Research Manager, said: ‘Action on Hearing Loss welcomes the development of new technology that helps people who are deaf or have a hearing loss to have better access to television through superior real-time subtitling.
‘It is great to see research being conducted in this area, with new breakthroughs welcomed by Action on Hearing Loss by improving accessibility for people with a hearing loss. AI lip-reading technology would be able to enhance the accuracy and speed of speech-to-text especially in noisy environments and we encourage further research in this area and look forward to seeing new advances being made.’
Commenting on the potential uses for WAS Joon Son Chung, lead-author of the study and a graduate student at Oxford’s Department of Engineering, said: ‘Lip-reading is an impressive and challenging skill, so WAS can hopefully offer support to this task – for example, suggesting hypotheses for professional lip readers to verify using their expertise. There are also a host of other applications, such as dictating instructions to a phone in a noisy environment, dubbing archival silent films, resolving multi-talker simultaneous speech and improving the performance of automated speech recognition in general.’
Receive an email update when we add a new ARTIFICIAL INTELLIGENCE article.
The Latest on: Artificial intelligence
via Google News
The Latest on: Artificial intelligence
- Artificial Intelligence (AI), Hardware And Software: History Does Rhymeon February 27, 2020 at 6:05 am
“History does not repeat itself, but it rhymes,” is a quote attributed to Samuel Clemens (Mark Twain). The current state of artificial intelligence (AI) advancements remind me much of the 1970s and ...
- Five Core Virtues For Data Science And Artificial Intelligenceon February 27, 2020 at 5:19 am
Roles have included co-founder at a data analytics startup, VP Data Science and AI at Booz Allen, and Global Analytics Lead at Accenture. Virtues should be digitized. As we speed toward reliance on ...
- Artificial Intelligence Market Outlook and Growth Stance Forecasted Through 2025on February 27, 2020 at 2:39 am
In this report, the Global Artificial Intelligence (AI) market was valued at USD 11.71 Billion in 2016, and is projected to reach USD 191.60 billion by 2025, growing at a CAGR of 36.68% over the ...
- Global Artificial Intelligence Market - Revolutionary Trends 2029|| Atomwise Inc, Google Inc and IBM Corp.on February 27, 2020 at 2:06 am
Global Artificial Intelligence Market (Revenue and Volume), Type, Application, End-User, and Regional Analysis, Import-Export Analysis, Industry Analysis, Premium Insights, Intellectual Property ...
- Clinical Artificial Intelligence Leader Jvion Expands Executive Team to Scale Growth and Deliver the Next in Accountable Careon February 26, 2020 at 7:15 pm
for preventing avoidable patient harm, today announced the expansion of their executive team after a year of rapid growth. The addition of industry veterans Eric Schrock as Chief Technology Officer an ...
- Why this ASX artificial intelligence share is on the move todayon February 26, 2020 at 5:33 pm
share price is moving higher today after the artificial intelligence company delivered its FY19 results. The post Why this ASX artificial intelligence share is on the move today appeared first on ...
- Artificial intelligence uncovers outrageous employee expense reportson February 26, 2020 at 8:53 am
SEE: Cheat sheet: Artificial intelligence (free PDF) (TechRepublic) "Nothing shocks me. It's just how much is going through—that's what surprises me—how far people can take it," said Anant Kale, CEO ...
- Augmented Video, Artificial Intelligence, and Machine Learning: How This Startup Lets Fans (and Teams) See Soccer in a Whole New Wayon February 26, 2020 at 7:00 am
A new partnership between Major League Soccer and Second Spectrum's uses video, machine learning, and AI to turn data into insight -- and a better fan experience. A man sitting in front of me at a DC ...
- GovExec Daily: The Ethics of Artificial Intelligence at the Pentagonon February 26, 2020 at 3:05 am
As artificial intelligence becomes more of a priority, the Pentagon announced last week that it will adopt ethics principles for AI use. As Defense officials said that AI is top priority, having an ...
via Bing News