This latest research led by CMU’s Marcel Just builds on the pioneering use of machine learning algorithms with brain imaging technology to “mind read.” The findings indicate that the mind’s building blocks for constructing complex thoughts are formed by the brain’s various sub-systems and are not word-based. Published in Human Brain Mapping and funded by the Intelligence Advanced Research Projects Activity (IARPA), the study offers new evidence that the neural dimensions of concept representation are universal across people and languages.
“One of the big advances of the human brain was the ability to combine individual concepts into complex thoughts, to think not just of ‘bananas,’ but ‘I like to eat bananas in evening with my friends,'” said Just, the D.O. Hebb University Professor of Psychology in the Dietrich College of Humanities and Social Sciences. “We have finally developed a way to see thoughts of that complexity in the fMRI signal. The discovery of this correspondence between thoughts and brain activation patterns tells us what the thoughts are built of.”
Previous work by Just and his team showed that thoughts of familiar objects, like bananas or hammers, evoke activation patterns that involve the neural systems that we use to deal with those objects. For example, how you interact with a banana involves how you hold it, how you bite it and what it looks like.
The new study demonstrates that the brain’s coding of 240 complex events, sentences like the shouting during the trial scenario uses an alphabet of 42 meaning components, or neurally plausible semantic features, consisting of features, like person, setting, size, social interaction and physical action. Each type of information is processed in a different brain system—which is how the brain also processes the information for objects. By measuring the activation in each brain system, the program can tell what types of thoughts are being contemplated.
For seven adult participants, the researchers used a computational model to assess how the brain activation patterns for 239 sentences corresponded to the neurally plausible semantic features that characterized each sentence. Then the program was able to decode the features of the 240th left-out sentence. They went through leaving out each of the 240 sentences in turn, in what is called cross-validation.
The model was able to predict the features of the left-out sentence, with 87 percent accuracy, despite never being exposed to its activation before. It was also able to work in the other direction, to predict the activation pattern of a previously unseen sentence, knowing only its semantic features.
“Our method overcomes the unfortunate property of fMRI to smear together the signals emanating from brain events that occur close together in time, like the reading of two successive words in a sentence,” Just said. “This advance makes it possible for the first time to decode thoughts containing several concepts. That’s what most human thoughts are composed of.”
He added, “A next step might be to decode the general type of topic a person is thinking about, such as geology or skateboarding. We are on the way to making a map of all the types of knowledge in the brain.”
The Latest on: Mind reading
- Mind-Reading Consumers on December 7, 2018 at 1:14 am
This article is an extract from the Winter Edition of MER Magazine published in August 2018. You can read the full article as well as other articles from MER for free by visiting digital.mailandexpres... […]
- MIND READING BREAKTHROUGH: Scientists experimenting on RATS make HUGE step forward on December 5, 2018 at 9:17 am
Scientists have said they can read rats minds and predict their next move, as well as their mistakes. By observing the hippocampus, scientists were able to predict where a rat would navigate in a maze ... […]
- Scientists can 'read rats MINDS' and predict what they will do next after mapping their brains on December 4, 2018 at 10:04 pm
Mind-reading could be one step closer thanks to the results of a new study involving rats. Scientists were able to predict where a rodent would go next just by observing which neurons were firing in t... […]
- I got my mind read by illusionist Alexander Magu on November 22, 2018 at 11:02 am
Magic is in our everyday life like the French pilaf. What I do are illusions," says Alexander Magu casually folding an iPhone as my eyes pop out. "Here, try it, it's a special Russian phone made of ru... […]
- Mind-Reading, Mood Manipulation Or Medicine From Poison on November 8, 2018 at 11:11 pm
Eight areas of scientific research with the potential to have the greatest impact on life on earth are highlighted with the publication of the World Economic Forum’s inaugural Future Frontiers 2018 su... […]
- Britain's Got Talent's mind-reading duo DNA fluff card trick live on Good Morning Britain on October 9, 2018 at 4:25 am
Britain's Got Talent's mind-reading duo DNA appeared on Good Morning Britain to wow Eamonn Holmes and Charlotte Hawkins with their skills ahead of their semi-finals appearance later tonight – but sadl... […]
- Kamala Harris' mind-reading act at the Kavanaugh hearing failed miserably on September 6, 2018 at 12:30 pm
Among several surreal moments at the confirmation hearings for Supreme Court nominee Brett Kavanaugh, one of the strangest was an encounter Wednesday evening between Sen. Kamala Harris and the nominee ... […]
- Mind-reading A.I. algorithm can work out what music is playing in your head on April 17, 2018 at 2:08 pm
Most of us have used apps like Shazam, which can identify songs when we hold up our phone up to a speaker. But what if it was possible for an app to identify a piece of music based on nothing more tha... […]
- Mind-reading AI isn’t sci-fi anymore… and it’s just getting started on March 6, 2018 at 2:19 pm
Despite its overwhelming success, the human brain peaked about two million years ago. Lucky for us, computers are helping us understand our brains better, but there may be some consequences to giving ... […]
- A “mind reading” AI on March 6, 2018 at 5:36 am
Think that Google’s search algorithms are good at reading your mind? That’s nothing compared to a new artificial intelligence research project coming out of Japan, which can analyze a person’s brain s... […]
via Google News and Bing News