Carnegie Mellon University scientists can now use brain activation patterns to identify complex thoughts, such as, “The witness shouted during the trial.”
This latest research led by CMU’s Marcel Just builds on the pioneering use of machine learning algorithms with brain imaging technology to “mind read.” The findings indicate that the mind’s building blocks for constructing complex thoughts are formed by the brain’s various sub-systems and are not word-based. Published in Human Brain Mapping and funded by the Intelligence Advanced Research Projects Activity (IARPA), the study offers new evidence that the neural dimensions of concept representation are universal across people and languages.
“One of the big advances of the human brain was the ability to combine individual concepts into complex thoughts, to think not just of ‘bananas,’ but ‘I like to eat bananas in evening with my friends,'” said Just, the D.O. Hebb University Professor of Psychology in the Dietrich College of Humanities and Social Sciences. “We have finally developed a way to see thoughts of that complexity in the fMRI signal. The discovery of this correspondence between thoughts and brain activation patterns tells us what the thoughts are built of.”
Previous work by Just and his team showed that thoughts of familiar objects, like bananas or hammers, evoke activation patterns that involve the neural systems that we use to deal with those objects. For example, how you interact with a banana involves how you hold it, how you bite it and what it looks like.
The new study demonstrates that the brain’s coding of 240 complex events, sentences like the shouting during the trial scenario uses an alphabet of 42 meaning components, or neurally plausible semantic features, consisting of features, like person, setting, size, social interaction and physical action. Each type of information is processed in a different brain system—which is how the brain also processes the information for objects. By measuring the activation in each brain system, the program can tell what types of thoughts are being contemplated.
For seven adult participants, the researchers used a computational model to assess how the brain activation patterns for 239 sentences corresponded to the neurally plausible semantic features that characterized each sentence. Then the program was able to decode the features of the 240th left-out sentence. They went through leaving out each of the 240 sentences in turn, in what is called cross-validation.
The model was able to predict the features of the left-out sentence, with 87 percent accuracy, despite never being exposed to its activation before. It was also able to work in the other direction, to predict the activation pattern of a previously unseen sentence, knowing only its semantic features.
“Our method overcomes the unfortunate property of fMRI to smear together the signals emanating from brain events that occur close together in time, like the reading of two successive words in a sentence,” Just said. “This advance makes it possible for the first time to decode thoughts containing several concepts. That’s what most human thoughts are composed of.”
He added, “A next step might be to decode the general type of topic a person is thinking about, such as geology or skateboarding. We are on the way to making a map of all the types of knowledge in the brain.”
The Latest on: Mind reading technology
- Unlock Phase and Weddings: How Indian weddings will look like amid and post COVID 19?on June 26, 2020 at 5:14 am
We are already witnessing weddings with restrictions with the help of technology like Zoom calls or ... and sanitization will top of mind. Hyatt Place Gurgaon confirms, “Temperature reading will be ...
- Why Fear is Your Friend in This Market Downturnon June 26, 2020 at 4:17 am
It seems that every time the market dips, your heart skips a beat. This happens because of the fears of seeing your profits decline or losing a portion of your invested money. But not all fear is bad.
- In search of future Overseerson June 25, 2020 at 6:00 pm
A former Overseer and the executive director of the Harvard Alumni Association discuss the work of the HAA nominating committees.
- Burchfield: Maps and technology — best of both worldson June 25, 2020 at 5:00 am
Let’s face it, anyone with a GPS integrated into their vehicle or using the GPS app on their cell phone has tried it. You know where you want to go ...
- The e-bike you can control with your mindon June 23, 2020 at 7:17 pm
You sometimes hear cyclists say that their bike has become an extension of themselves. That when they’re in the zone, and everything is feeling just right, the bike disappears beneath them; that ...
- IBM, Monash and Southampton Uni develop mind-reading ebike to save liveson June 21, 2020 at 10:34 pm
Researchers from Monash University, IBM Research Australia, and the UK's University of Southampton have developed an ebike prototype that can "read" a cyclist's mind via their brain activity to ...
- Crypto Long & Short: What Changed My Mind About Bitcoin Narrativeson June 21, 2020 at 2:56 pm
Is bitcoin having a good year or not? As an industry, we need to work on honing our understanding of the many narratives, and how they can influence value.
- Meet 10 Companies Working On Reading Your Thoughts (And Even Those Of Your Pets)on June 21, 2020 at 8:46 am
Are brain-computer interfaces the next way we will communicate with machines and even with one another? Here are 10 companies working on decoding our thoughts.
- The 'mind-reading' bicycle that could save liveson June 20, 2020 at 10:30 pm
A Bicycle Network count of 8800 riders on April 25 showed the number had increased by 270 per cent compared with November last year. But Uber this week confirmed that its shared e-bike outfit Jump ...
- Recommended Reading: Why is Apple breaking up with Intel?on June 20, 2020 at 6:30 am
Apple prepares to break up with Intel Don Clark and Jack Nicas, The New York Times One of the big announcements at Monday’s WWDC virtual keynote is expected to be Apple’s long-rumored breakup with ...
via Google News and Bing News