Recent research shows Brain-to-text device capable of decoding speech from brain signals
Ever wonder what it would be like if a device could decode your thoughts into actual speech or written words? While this might enhance the capabilities of already existing speech interfaces with devices, it could be a potential game-changer for those with speech pathologies, and even more so for “locked-in” patients who lack any speech or motor function.
“So instead of saying ‘Siri, what is the weather like today’ or ‘Ok Google, where can I go for lunch?’ I just imagine saying these things,” explains Christian Herff, author of a review recently published in the journal Frontiers in Human Neuroscience.
While reading one’s thoughts might still belong to the realms of science fiction, scientists are already decoding speech from signals generated in our brains when we speak or listen to speech.
In their review, Herff and co-author, Dr. Tanja Schultz, compare the pros and cons of using various brain imaging techniques to capture neural signals from the brain and then decode them to text.
The technologies include functional MRI and near infrared imaging that can detect neural signals based on metabolic activity of neurons, to methods such as EEG and magnetoencephalography (MEG) that can detect electromagnetic activity of neurons responding to speech. One method in particular, called electrocorticography or ECoG, showed promise in Herff’s study.
This study presents the Brain-to-text system in which epilepsy patients who already had electrode grids implanted for treatment of their condition participated. They read out texts presented on a screen in front of them while their brain activity was recorded. This formed the basis of a database of patterns of neural signals that could now be matched to speech elements or “phones”.
When the researchers also included language and dictionary models in their algorithms, they were able to decode neural signals to text with a high degree of accuracy. “For the first time, we could show that brain activity can be decoded specifically enough to use ASR technology on brain signals,” says Herff. “However, the current need for implanted electrodes renders it far from usable in day-to-day life.”
So, where does the field go from here to a functioning thought detection device? “A first milestone would be to actually decode imagined phrases from brain activity, but a lot of technical issues need to be solved for that,” concedes Herff.
The Latest on: Brain-to-text system
via Google News
The Latest on: Brain-to-text system
- Facebook faces new frontiers with real time brain-to-text researchon July 31, 2019 at 2:31 pm
Facebook and UCSF see the potential for infrared as a way of making non-invasive technology work. “We don’t expect this system to solve the problem of input for AR anytime soon,” Facebook admits.
- Neuroscientists fine-tune brain-to-speech translator – but there’s a long road aheadon July 30, 2019 at 6:58 pm
(UCSF Photo / Noah Berger) Neuroscientists have demonstrated a computerized system that can determine in real time ... which is aiming to create a non-invasive, wearable brain-to-text translator. But ...
- Neuroscientists decode brain speech signals into written texton July 30, 2019 at 4:11 pm
In its current form, the brain-reading software works only for stock sentences it has been trained on, but scientists believe it is a stepping stone towards a more powerful system that can decode in ...
- Mind-Reading Program Translates Thoughts Into Texton June 21, 2019 at 5:00 pm
Technology can reconstruct video based on a person's thoughts and even anticipate your moves while you drive. Now, a brain-to-text system can translate brain activity into written words. In a recent ...
- Brain-to-text: decoding spoken phrases from phone representations in the brainon March 3, 2019 at 4:00 pm
Here, we show for the first time that continuously spoken speech can be decoded into the expressed words from intracranial electrocorticographic (ECoG) recordings.Specifically, we implemented a system ...
- Research Shows Brain-to-Text System Can Decode Speech from Brain Signalson October 25, 2016 at 5:00 pm
Ever wonder what it would be like if a device could decode your thoughts into actual speech or written words? While this might enhance the capabilities of already existing speech interfaces with ...
- Scientists Just Made Mind Reading A Highly-Probable Part Of The Futureon June 23, 2015 at 7:50 am
And researchers just took a big step towards realizing it in a system called Brain-to-Text. Developed by a team from the Cognitive Systems Lab at KIT and the Wadsworth Center in New York, the system ...
- ‘Brain-to-Text’ system can turn a person’s thoughts into wordson June 21, 2015 at 5:00 pm
Researchers have developed a new signal processing and automatic speech recognition methods for the first time, that it’s possible to turn a person’s thoughts into a legible phrase, using what they’re ...
- Scientists Create First ‘Brain-To-Text’ Systemon June 18, 2015 at 5:35 am
Scientists create first ‘brain-to-text’ system: System combines cortical information with linguistic knowledge and machine-learning algorithms to extract most obvious word sequence. Speech is produced ...
via Bing News