Recent research shows Brain-to-text device capable of decoding speech from brain signals
Ever wonder what it would be like if a device could decode your thoughts into actual speech or written words? While this might enhance the capabilities of already existing speech interfaces with devices, it could be a potential game-changer for those with speech pathologies, and even more so for “locked-in” patients who lack any speech or motor function.
“So instead of saying ‘Siri, what is the weather like today’ or ‘Ok Google, where can I go for lunch?’ I just imagine saying these things,” explains Christian Herff, author of a review recently published in the journal Frontiers in Human Neuroscience.
While reading one’s thoughts might still belong to the realms of science fiction, scientists are already decoding speech from signals generated in our brains when we speak or listen to speech.
In their review, Herff and co-author, Dr. Tanja Schultz, compare the pros and cons of using various brain imaging techniques to capture neural signals from the brain and then decode them to text.
The technologies include functional MRI and near infrared imaging that can detect neural signals based on metabolic activity of neurons, to methods such as EEG and magnetoencephalography (MEG) that can detect electromagnetic activity of neurons responding to speech. One method in particular, called electrocorticography or ECoG, showed promise in Herff’s study.
This study presents the Brain-to-text system in which epilepsy patients who already had electrode grids implanted for treatment of their condition participated. They read out texts presented on a screen in front of them while their brain activity was recorded. This formed the basis of a database of patterns of neural signals that could now be matched to speech elements or “phones”.
When the researchers also included language and dictionary models in their algorithms, they were able to decode neural signals to text with a high degree of accuracy. “For the first time, we could show that brain activity can be decoded specifically enough to use ASR technology on brain signals,” says Herff. “However, the current need for implanted electrodes renders it far from usable in day-to-day life.”
So, where does the field go from here to a functioning thought detection device? “A first milestone would be to actually decode imagined phrases from brain activity, but a lot of technical issues need to be solved for that,” concedes Herff.
The Latest on: Brain-to-text system
via Google News
The Latest on: Brain-to-text system
- Scientists think Facebook and Elon Musk are way too optimistic about mind-reading tech on April 28, 2017 at 2:11 pm
"That's extremely aggressive," for a such a brain-to-text system, says Wyble. In a keynote speech at a Facebook conference in San Jose, CA, on April 19, Dugan spoke of the brain in terms usually reser... […]
- Brain-to-text technology under development at Facebook on April 20, 2017 at 4:02 am
This would be achieved using an optical imaging system which scans the brain 100 times a second. That could allow users to send texts and emails without touching their phone, and could be useful for p... […]
- Facebook gives a sneak peek inside its unit studying brain-to-text technology on April 19, 2017 at 9:05 pm
Using brain implants, people can already type eight words a minute, she said. Facebook's goal, working with researchers at several U.S. universities, is to make the system non-invasive, as well as fas... […]
- Facebook has 60 engineers working on controlling computers from your brain on April 19, 2017 at 12:09 pm
At the same time, these efforts raise hard questions related to patient privacy, as any brain-to-text system will essentially read a person's unspoken thoughts. On the Internet, many reacted with alar... […]
- Facebook gives peek inside unit studying brain-to-text technology on April 18, 2017 at 5:00 pm
Using brain implants, people can already type eight words a minute, she said. Facebook’s goal, working with researchers at several U.S. universities, is to make the system non-invasive, as well as fas... […]
- Can a Brain-Computer Interface Convert Your Thoughts to Text? on October 26, 2016 at 3:46 am
One method in particular, called electrocorticography or ECoG, showed promise in Herff’s study. This study presents the Brain-to-text system in which epilepsy patients who already had electrode grids ... […]
- Countdown to Christmas 2015: Six of the most amazing and useful inventions of the year on December 11, 2015 at 10:03 pm
Called brain-to-text, the system is not just able to decode single words, but whole sentences and phrases as part of continuous speech. So don't start thinking too loudly... […]
- Speech recognition from brain activity on June 16, 2015 at 5:17 am
Researchers at KIT and Wadsworth Center, USA present their "Brain-to-Text" system in the scientific journal ... In Karlsruhe, the methods for signal processing and automatic speech recognition have be... […]
- Precursor to Mind-Reading Technology, Researchers Reconstruct Sentences From Decoded Brain Activity on June 15, 2015 at 5:00 pm
Researchers at Karlsruhe Institute of Technology in Germany and at Wadsworth Center in America are the first to devise a system that can decode brain activity from speaking and actually translate it b... […]
via Bing News