A new technique developed by neuroscientists at U of T Scarborough can, for the first time, reconstruct images of what people perceive based on their brain activity gathered by EEG.
The technique developed by Dan Nemrodov, a postdoctoral fellow in Assistant Professor Adrian Nestor’s lab at U of T Scarborough, is able to digitally reconstruct images seen by test subjects based on electroencephalography (EEG) data.
“When we see something, our brain creates a mental percept, which is essentially a mental impression of that thing. We were able to capture this percept using EEG to get a direct illustration of what’s happening in the brain during this process,” says Nemrodov.
For the study, test subjects hooked up to EEG equipment were shown images of faces. Their brain activity was recorded and then used to digitally recreate the image in the subject’s mind using a technique based on machine learning algorithms.
It’s not the first time researchers have been able to reconstruct images based on visual stimuli using neuroimaging techniques. The current method was pioneered by Nestor who successfully reconstructed facial images from functional magnetic resonance imaging (fMRI) data in the past, but this is the first time EEG has been used.
And while techniques like fMRI – which measures brain activity by detecting changes in blood flow – can grab finer details of what’s going on in specific areas of the brain, EEG has greater practical potential given that it’s more common, portable, and inexpensive by comparison. EEG also has greater temporal resolution, meaning it can measure with detail how a percept develops in time right down to milliseconds, explains Nemrodov.
“fMRI captures activity at the time scale of seconds, but EEG captures activity at the millisecond scale. So we can see with very fine detail how the percept of a face develops in our brain using EEG,” he says. In fact, the researchers were able to estimate that it takes our brain about 170 milliseconds (0.17 seconds) to form a good representation of a face we see.
This study provides validation that EEG has potential for this type of image reconstruction notes Nemrodov, something many researchers doubted was possible given its apparent limitations. Using EEG data for image reconstruction has great theoretical and practical potential from a neurotechnological standpoint, especially since it’s relatively inexpensive and portable.
In terms of next steps, work is currently underway in Nestor’s lab to test how image reconstruction based on EEG data could be done using memory and applied to a wider range of objects beyond faces. But it could eventually have wide-ranging clinical applications as well.
“It could provide a means of communication for people who are unable to verbally communicate. Not only could it produce a neural-based reconstruction of what a person is perceiving, but also of what they remember and imagine, of what they want to express,” says Nestor.
“It could also have forensic uses for law enforcement in gathering eyewitness information on potential suspects rather than relying on verbal descriptions provided to a sketch artist.”
The research, which is published in the journal eNeuro, was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC) and by a Connaught New Researcher Award.
“What’s really exciting is that we’re not reconstructing squares and triangles but actual images of a person’s face, and that involves a lot of fine-grained visual detail,” adds Nestor.
“The fact we can reconstruct what someone experiences visually based on their brain activity opens up a lot of possibilities. It unveils the subjective content of our mind and it provides a way to access, explore and share the content of our perception, memory and imagination.”
The Latest on: Neuroimaging
- Distinguished Professor Elizabeth Margulis and Chancellor Joe Steinmetz to Lecture on 'Brain and Music' on September 19, 2018 at 10:38 pm
Led Zeppelin will be on the syllabus; Bach and Beyoncé too. ERPs, EEGs and other neuroimaging tools that offer insight into musical enjoyment, the interplay between culture and hearing, and the nature ... […]
- Market Outlook for Diagnostic Neuroimaging Market Outlook, Research, Trends and Forecast to 2023 on September 19, 2018 at 10:44 am
New York, NY -- (SBWIRE) -- 09/19/2018 -- This market research report gives an in-depth idea about the global Diagnostic Neuroimaging market. It highlights the recent market scenario, growth in the pa... […]
- The Evolution of Neuroimaging on September 15, 2018 at 6:28 am
A fun new paper looks at the changing landscape of neuroimaging research through an analysis of the journals Neuroimage and PNAS. The article comes from UPenn researchers Jordan D. Dworkin, Russell T. […]
- Attorney Stephen G. Cobb Provides Expertise on Neuroimaging in Criminal Cases on September 12, 2018 at 10:11 am
Neuroimaging is not new to the courtroom, as attorneys have utilized brain images in a myriad of cases. CT scans and MRIs are often presented when an attorney needs to prove to the court that a client ... […]
- Global Diagnostic Neuroimaging Markets & Emerging Applications - Forecast to 2022 - ResearchAndMarkets.com on August 20, 2018 at 1:23 am
DUBLIN--(Business Wire)--The "Global Diagnostic Neuroimaging Markets and Emerging Applications, Forecast to 2022" report has been added to ResearchAndMarkets.com's offering. The scope of this research ... […]
- China Focus: AI beats human doctors in neuroimaging recognition contest on June 30, 2018 at 7:58 am
BEIJING, June 30 (Xinhua) -- An artificial intelligence (AI) system scored 2:0 against elite human physicians Saturday in two rounds of competitions in diagnosing brain tumors and predicting hematoma ... […]
- Limited submission opportunity: 2018 David Mahoney Neuroimaging Program on October 5, 2017 at 10:50 am
Vanderbilt anticipates the opportunity to nominate one candidate for the 2018 David Mahoney Neuroimaging Program of the Dana Foundation. Funds support pilot-testing by investigators who are early in t... […]
- Neuroimaging may aid in predicting PTSD following trauma on February 12, 2017 at 4:00 pm
A recent study conducted by Emory University researchers finds that amygdala reactivity may help predict who will have PTSD in the year following a trauma. The amygdala is the area in the brain that p... […]
- Neuroimaging categorizes four depression subtypes on December 5, 2016 at 4:00 pm
Patients with depression can be categorized into four unique subtypes defined by distinct patterns of abnormal connectivity in the brain, according to new research from Weill Cornell Medicine. These b... […]
- USC Stevens Hall for Neuroimaging officially opens its doors on November 18, 2016 at 12:48 pm
Rohit Varma, Sean Stevens, Mark and Mary Stevens, C. L. Max Nikias, Niki C. Nikias, Ghada Irani and Arthur Toga, from left, attend the opening of the USC Stevens Hall for Neuroimaging. (USC Photo/Gus ... […]
via Google News and Bing News