A new technique developed by neuroscientists at U of T Scarborough can, for the first time, reconstruct images of what people perceive based on their brain activity gathered by EEG.
The technique developed by Dan Nemrodov, a postdoctoral fellow in Assistant Professor Adrian Nestor’s lab at U of T Scarborough, is able to digitally reconstruct images seen by test subjects based on electroencephalography (EEG) data.
“When we see something, our brain creates a mental percept, which is essentially a mental impression of that thing. We were able to capture this percept using EEG to get a direct illustration of what’s happening in the brain during this process,” says Nemrodov.
For the study, test subjects hooked up to EEG equipment were shown images of faces. Their brain activity was recorded and then used to digitally recreate the image in the subject’s mind using a technique based on machine learning algorithms.
It’s not the first time researchers have been able to reconstruct images based on visual stimuli using neuroimaging techniques. The current method was pioneered by Nestor who successfully reconstructed facial images from functional magnetic resonance imaging (fMRI) data in the past, but this is the first time EEG has been used.
And while techniques like fMRI – which measures brain activity by detecting changes in blood flow – can grab finer details of what’s going on in specific areas of the brain, EEG has greater practical potential given that it’s more common, portable, and inexpensive by comparison. EEG also has greater temporal resolution, meaning it can measure with detail how a percept develops in time right down to milliseconds, explains Nemrodov.
“fMRI captures activity at the time scale of seconds, but EEG captures activity at the millisecond scale. So we can see with very fine detail how the percept of a face develops in our brain using EEG,” he says. In fact, the researchers were able to estimate that it takes our brain about 170 milliseconds (0.17 seconds) to form a good representation of a face we see.
This study provides validation that EEG has potential for this type of image reconstruction notes Nemrodov, something many researchers doubted was possible given its apparent limitations. Using EEG data for image reconstruction has great theoretical and practical potential from a neurotechnological standpoint, especially since it’s relatively inexpensive and portable.
In terms of next steps, work is currently underway in Nestor’s lab to test how image reconstruction based on EEG data could be done using memory and applied to a wider range of objects beyond faces. But it could eventually have wide-ranging clinical applications as well.
“It could provide a means of communication for people who are unable to verbally communicate. Not only could it produce a neural-based reconstruction of what a person is perceiving, but also of what they remember and imagine, of what they want to express,” says Nestor.
“It could also have forensic uses for law enforcement in gathering eyewitness information on potential suspects rather than relying on verbal descriptions provided to a sketch artist.”
The research, which is published in the journal eNeuro, was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC) and by a Connaught New Researcher Award.
“What’s really exciting is that we’re not reconstructing squares and triangles but actual images of a person’s face, and that involves a lot of fine-grained visual detail,” adds Nestor.
“The fact we can reconstruct what someone experiences visually based on their brain activity opens up a lot of possibilities. It unveils the subjective content of our mind and it provides a way to access, explore and share the content of our perception, memory and imagination.”
The Latest on: Neuroimaging
- Wiring diagram of brain reconciles inconsistent neuroimaging findings of Alzheimer’s patients on December 18, 2018 at 1:46 pm
Using data from the Human Connectome Project—a publicly available “wiring diagram” of the human brain based on data from thousands of healthy volunteers—researchers were able to reassess inconsistent ... […]
- Researchers use brain connectome to reassess neuroimaging findings of Alzheimer's disease on December 16, 2018 at 9:09 pm
Already affecting more than five million Americans older than 65, Alzheimer's disease is on the rise and expected to impact more than 13 million people by 2050. Over the last three decades, researcher... […]
- Wiring diagram of the brain provides a clearer picture of brain scan data on December 15, 2018 at 12:03 pm
Neuroscientists have used data from the human brain connectome -- a publicly available 'wiring diagram' of the human brain based on data from thousands of healthy human volunteers -- to reassess the f... […]
- Neuroimaging detects severe abnormalities from Zika virus in 15% of infants on December 13, 2018 at 12:23 pm
The Zika virus epidemic in Rio de Janeiro, Brazil from September 2015 to June 2016 began as a relatively unknown mosquito-borne virus which was later linked to microcephaly and other neurological abno... […]
- UCR holds first annual Computational Neuroimaging and Neuroengineering Symposium on December 4, 2018 at 5:03 pm
On Friday, Nov. 30, the first annual Computational Neuroimaging and Neuroengineering Symposium (CNNS) was hosted at the UCR Alumni and Visitors Center by Megan Peters, assistant professor of bioengine... […]
- Physicians Order Costly, Redundant Neuroimaging for Stroke Patients: UM Study on December 4, 2018 at 4:00 pm
ANN ARBOR — Neuroimaging for stroke patients may be unnecessarily costly and redundant, contributing to rising costs nationwide for stroke care, according to University of Michigan research. The resea... […]
- Brain Imaging And Neuroimaging Market Volume Forecast and Value Chain Analysis 2016-2026 on November 21, 2018 at 1:35 am
Future Market Insights has announced the addition of the “Brain Imaging And Neuroimaging Market: Global Industry Analysis and Opportunity Assessment 2016-2026" report to their offering Over the last f... […]
- Functional neuroimaging reveals preclinical alterations in brain function on November 20, 2018 at 4:00 pm
Alzheimer’s disease (AD) causes progressive neurodegeneration. The EU project NPAD has developed a virtual reality real-time 3D imaging procedure to establish standard metrics for brain activity in AD ... […]
- Asceneuron Initiates Neuroimaging Trial for Tau Modifier ASN120290 on November 19, 2018 at 4:00 pm
Asceneuron SA, an emerging leader in the development of innovative small molecules for the treatment of neurodegenerative diseases, announced today it has commenced a new clinical trial of its lead as... […]
via Google News and Bing News