This latest research led by CMU’s Marcel Just builds on the pioneering use of machine learning algorithms with brain imaging technology to “mind read.” The findings indicate that the mind’s building blocks for constructing complex thoughts are formed by the brain’s various sub-systems and are not word-based. Published in Human Brain Mapping and funded by the Intelligence Advanced Research Projects Activity (IARPA), the study offers new evidence that the neural dimensions of concept representation are universal across people and languages.
“One of the big advances of the human brain was the ability to combine individual concepts into complex thoughts, to think not just of ‘bananas,’ but ‘I like to eat bananas in evening with my friends,'” said Just, the D.O. Hebb University Professor of Psychology in the Dietrich College of Humanities and Social Sciences. “We have finally developed a way to see thoughts of that complexity in the fMRI signal. The discovery of this correspondence between thoughts and brain activation patterns tells us what the thoughts are built of.”
Previous work by Just and his team showed that thoughts of familiar objects, like bananas or hammers, evoke activation patterns that involve the neural systems that we use to deal with those objects. For example, how you interact with a banana involves how you hold it, how you bite it and what it looks like.
The new study demonstrates that the brain’s coding of 240 complex events, sentences like the shouting during the trial scenario uses an alphabet of 42 meaning components, or neurally plausible semantic features, consisting of features, like person, setting, size, social interaction and physical action. Each type of information is processed in a different brain system—which is how the brain also processes the information for objects. By measuring the activation in each brain system, the program can tell what types of thoughts are being contemplated.
For seven adult participants, the researchers used a computational model to assess how the brain activation patterns for 239 sentences corresponded to the neurally plausible semantic features that characterized each sentence. Then the program was able to decode the features of the 240th left-out sentence. They went through leaving out each of the 240 sentences in turn, in what is called cross-validation.
The model was able to predict the features of the left-out sentence, with 87 percent accuracy, despite never being exposed to its activation before. It was also able to work in the other direction, to predict the activation pattern of a previously unseen sentence, knowing only its semantic features.
“Our method overcomes the unfortunate property of fMRI to smear together the signals emanating from brain events that occur close together in time, like the reading of two successive words in a sentence,” Just said. “This advance makes it possible for the first time to decode thoughts containing several concepts. That’s what most human thoughts are composed of.”
He added, “A next step might be to decode the general type of topic a person is thinking about, such as geology or skateboarding. We are on the way to making a map of all the types of knowledge in the brain.”
The Latest on: Mind reading
The amazing Marianne, another mind-reading judge
on July 14, 2018 at 1:57 am
Another federal employee, Special Judge Marianne Battani, has brought her amazing powers of mind-reading to bear upon her ruling in an important federal case. Judge Battani recently sentenced Dr. Rene ... […]
Mind-reading robots are no longer science fiction
on July 9, 2018 at 11:53 am
New research developed at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) lets a person control a robotic arm with brainwaves and subtle hand gestures. It’s the stuff of X-Men, m... […]
Oh, no! Mind-reading device translates thoughts to text
on July 7, 2018 at 3:01 pm
OK, here’s something truly terrifying to contemplate. Scientists say they’ve developed a real mind-reading machine that instantly translates your thoughts into text. According to its inventors, the ma... […]
Why Withdrawing or Expecting Your Partner to Read Your Mind During a Fight is Ruining Your Relationship
on June 10, 2018 at 10:00 am
When you get in a fight with your significant other, what’s your natural reaction? Is it to withdraw and avoid the conflict entirely? Or be silently angry in the hope that he or she will figure out wh... […]
'Mind-reading' headset allows viewers to change plot of new film
on May 27, 2018 at 12:27 pm
A new brain-controlled film has been produced which picks up the reactions of the viewer and changes the story based on their response. During the movie, called The Moment, viewers wear an electroence... […]
Facebook is keeping quiet about its wildest ambitions as it tries to show it can be trustworthy and mature
on May 4, 2018 at 7:10 am
Facebook is staying quiet about its crazy vision for the future. At its F8 conference in previous years, it has discussed how it is building science-fiction-esque mind-reading tech. But in 2018, bruis... […]
China's Mind Reading Technology
on May 2, 2018 at 3:37 am
China continues to roll out the dystopian society high-tech gear, with media now reporting that some companies are monitoring their employees’ brain waves in an emotional intelligence sweep, just days ... […]
Mind-reading A.I. algorithm can work out what music is playing in your head
on April 18, 2018 at 1:25 am
Most of us have used apps like Shazam, which can identify songs when we hold up our phone up to a speaker. But what if it was possible for an app to identify a piece of music based on nothing more tha... […]
Mind-reading AI isn’t sci-fi anymore… and it’s just getting started
on March 6, 2018 at 2:19 pm
Despite its overwhelming success, the human brain peaked about two million years ago. Lucky for us, computers are helping us understand our brains better, but there may be some consequences to giving ... […]
Black Mirror’s mind-reading tech could be here sooner than you think
on January 18, 2018 at 8:10 pm
Our minds may no longer be a safe haven for secrets. Scientists are working toward building mind-reading algorithms that could potentially decode our innermost thoughts through memories that act as a ... […]
via Google News and Bing News