A new technique developed by neuroscientists at U of T Scarborough can, for the first time, reconstruct images of what people perceive based on their brain activity gathered by EEG.
The technique developed by Dan Nemrodov, a postdoctoral fellow in Assistant Professor Adrian Nestor’s lab at U of T Scarborough, is able to digitally reconstruct images seen by test subjects based on electroencephalography (EEG) data.
“When we see something, our brain creates a mental percept, which is essentially a mental impression of that thing. We were able to capture this percept using EEG to get a direct illustration of what’s happening in the brain during this process,” says Nemrodov.
For the study, test subjects hooked up to EEG equipment were shown images of faces. Their brain activity was recorded and then used to digitally recreate the image in the subject’s mind using a technique based on machine learning algorithms.
It’s not the first time researchers have been able to reconstruct images based on visual stimuli using neuroimaging techniques. The current method was pioneered by Nestor who successfully reconstructed facial images from functional magnetic resonance imaging (fMRI) data in the past, but this is the first time EEG has been used.
And while techniques like fMRI – which measures brain activity by detecting changes in blood flow – can grab finer details of what’s going on in specific areas of the brain, EEG has greater practical potential given that it’s more common, portable, and inexpensive by comparison. EEG also has greater temporal resolution, meaning it can measure with detail how a percept develops in time right down to milliseconds, explains Nemrodov.
“fMRI captures activity at the time scale of seconds, but EEG captures activity at the millisecond scale. So we can see with very fine detail how the percept of a face develops in our brain using EEG,” he says. In fact, the researchers were able to estimate that it takes our brain about 170 milliseconds (0.17 seconds) to form a good representation of a face we see.
This study provides validation that EEG has potential for this type of image reconstruction notes Nemrodov, something many researchers doubted was possible given its apparent limitations. Using EEG data for image reconstruction has great theoretical and practical potential from a neurotechnological standpoint, especially since it’s relatively inexpensive and portable.
In terms of next steps, work is currently underway in Nestor’s lab to test how image reconstruction based on EEG data could be done using memory and applied to a wider range of objects beyond faces. But it could eventually have wide-ranging clinical applications as well.
“It could provide a means of communication for people who are unable to verbally communicate. Not only could it produce a neural-based reconstruction of what a person is perceiving, but also of what they remember and imagine, of what they want to express,” says Nestor.
“It could also have forensic uses for law enforcement in gathering eyewitness information on potential suspects rather than relying on verbal descriptions provided to a sketch artist.”
The research, which is published in the journal eNeuro, was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC) and by a Connaught New Researcher Award.
“What’s really exciting is that we’re not reconstructing squares and triangles but actual images of a person’s face, and that involves a lot of fine-grained visual detail,” adds Nestor.
“The fact we can reconstruct what someone experiences visually based on their brain activity opens up a lot of possibilities. It unveils the subjective content of our mind and it provides a way to access, explore and share the content of our perception, memory and imagination.”
The Latest on: Neuroimaging
via Google News
The Latest on: Neuroimaging
- Cheap, portable scanners could transform brain imaging. But how will scientists deliver the data? on April 16, 2019 at 10:31 am
How should researchers share results with the far-flung populations they may soon be able to study? Could direct-to-consumer neuroimaging become an industry alongside personal genetic testing? With a ... […]
- 'Self-Management' Program Cuts Pain, Increases Brain Volume on April 15, 2019 at 12:25 pm
MILWAUKEE — Intensive behavioral and mindfulness approaches to managing chronic pain are associated with significant pain improvement, as shown via brain changes on neuroimaging — and not just on ... […]
- Ariana Grande's PTSD Brain Scan Photo Shows How Much She's Been Through & Fans Admire Her Openness on April 12, 2019 at 11:04 am
A study published by the Neuroimaging Clinics of North America in November 2007 explained that the hippocampus, the amygdala, and the prefrontal cortex are all brain areas that can be affected by PTSD ... […]
- Connectome analysis of functional and structural hemispheric brain networks in major depressive disorder on April 12, 2019 at 8:43 am
Neuroimaging studies have shown topological disruptions of both functional and structural whole-brain networks in major depressive disorder (MDD). This study examined common and specific alterations ... […]
- Neuroimaging Draws a Bead on Alzheimer’s on April 12, 2019 at 6:25 am
At a time when Alzheimer’s disease trials are falling like dominoes, Pfizer decided early last year to act decisively: It packed its bags and got out of town. The drug giant announced it was ... […]
- Predictive Big Data Analytics using the UK Biobank Data on April 12, 2019 at 2:19 am
Our approach generated decision rules to predict the presence and progression of depression or other mental illnesses by jointly representing and modeling the significant clinical and demographic ... […]
- I feel you: Emotional mirror neurons found in rats on April 11, 2019 at 8:20 am
Human neuroimaging studies have shown that when people experience pain, they activate a region of the brain called the cingulate cortex. When they observe someone else in pain, the same region is ... […]
- Multi-directional spectroscopy enables human neuroimaging on April 10, 2019 at 2:30 am
a) Schematic showing two optical paths from source to detector. b) The multi-directional fNIRS system with four source and four detector probes. c) The probe tip. (Courtesy: T Shimokawa et al Biomed. ... […]
- Forgetting Uses More Brain Power Than Remembering on March 11, 2019 at 10:20 am
AUSTIN, Texas — Choosing to forget something might take more mental effort than trying to remember it, researchers at The University of Texas at Austin discovered through neuroimaging. These findings, ... […]
- Researcher shares largest neuroimaging dataset on math development on March 5, 2019 at 6:29 pm
Vanderbilt University neuroscientist James R. Booth is making available the largest known neuroimaging dataset on math development. His goal in doing so is to support the work of other researchers ... […]
via Bing News