From Apple’s Siri to Honda’s robot Asimo, machines seem to be getting better and better at communicating with humans.
But some neuroscientists caution that today’s computers will never truly understand what we’re saying because they do not take into account the context of a conversation the way people do.
Specifically, say University of California, Berkeley, postdoctoral fellow Arjen Stolk and his Dutch colleagues, machines don’t develop a shared understanding of the people, place and situation – often including a long social history – that is key to human communication. Without such common ground, a computer cannot help but be confused.
“People tend to think of communication as an exchange of linguistic signs or gestures, forgetting that much of communication is about the social context, about who you are communicating with,” Stolk said.
The word “bank,” for example, would be interpreted one way if you’re holding a credit card but a different way if you’re holding a fishing pole. Without context, making a “V” with two fingers could mean victory, the number two, or “these are the two fingers I broke.”
“All these subtleties are quite crucial to understanding one another,” Stolk said, perhaps more so than the words and signals that computers and many neuroscientists focus on as the key to communication. “In fact, we can understand one another without language, without words and signs that already have a shared meaning.”
Babies and parents, not to mention strangers lacking a common language, communicate effectively all the time, based solely on gestures and a shared context they build up over even a short time.
Stolk argues that scientists and engineers should focus more on the contextual aspects of mutual understanding, basing his argument on experimental evidence from brain scans that humans achieve nonverbal mutual understanding using unique computational and neural mechanisms. Some of the studies Stolk has conducted suggest that a breakdown in mutual understanding is behind social disorders such as autism.
“This shift in understanding how people communicate without any need for language provides a new theoretical and empirical foundation for understanding normal social communication, and provides a new window into understanding and treating disorders of social communication in neurological and neurodevelopmental disorders,” said Dr. Robert Knight, a UC Berkeley professor of psychology in the campus’s Helen Wills Neuroscience Institute and a professor of neurology and neurosurgery at UCSF.
Stolk and his colleagues discuss the importance of conceptual alignment for mutual understanding in an opinion piece appearing Jan. 11 in the journal Trends in Cognitive Sciences.
Brain scans pinpoint site for ‘meeting of minds’
To explore how brains achieve mutual understanding, Stolk created a game that requires two players to communicate the rules to each other solely by game movements, without talking or even seeing one another, eliminating the influence of language or gesture. He then placed both players in an fMRI (functional magnetic resonance imager) and scanned their brains as they nonverbally communicated with one another via computer.
He found that the same regions of the brain – located in the poorly understood right temporal lobe, just above the ear – became active in both players during attempts to communicate the rules of the game. Critically, the superior temporal gyrus of the right temporal lobe maintained a steady, baseline activity throughout the game but became more active when one player suddenly understood what the other player was trying to communicate. The brain’s right hemisphere is more involved in abstract thought and social interactions than the left hemisphere.
“These regions in the right temporal lobe increase in activity the moment you establish a shared meaning for something, but not when you communicate a signal,” Stolk said. “The better the players got at understanding each other, the more active this region became.”
This means that both players are building a similar conceptual framework in the same area of the brain, constantly testing one another to make sure their concepts align, and updating only when new information changes that mutual understanding. The results were reported in 2014 in the Proceedings of the National Academy of Sciences.
“It is surprising,” said Stolk, “that for both the communicator, who has static input while she is planning her move, and the addressee, who is observing dynamic visual input during the game, the same region of the brain becomes more active over the course of the experiment as they improve their mutual understanding.”
Robots’ statistical reasoning
Robots and computers, on the other hand, converse based on a statistical analysis of a word’s meaning, Stolk said. If you usually use the word “bank” to mean a place to cash a check, then that will be the assumed meaning in a conversation, even when the conversation is about fishing.
The Latest on: Human computer understanding
via Google News
The Latest on: Human computer understanding
- Nazis, Human Calculators, and the Future that Failed: The Hidden History of Early Computing on February 19, 2019 at 7:02 pm
Beyond astronomy, human computers were essential to advances ... (such as the functions studied in high school calculus). This understanding is embodied by definitions like this one: analog ... […]
- The BBVA Foundation recognizes Ivan Sutherland for revolutionizing human-machine interaction through computer graphics and virtual reality on February 19, 2019 at 11:34 am
In a career spanning more than six decades, Sutherland has paired "a deep knowledge of technology with an understanding of human behavior to transform computer interaction," the citation continues. […]
- Ivan Sutherland, the 'father of computer graphics,' wins the Frontiers of Knowledge Award on February 19, 2019 at 9:41 am
In a career spanning more than six decades, Sutherland has paired "a deep knowledge of technology with an understanding of human behavior to transform computer interaction," the citation continues. No... […]
- How Harvard's human computers helped invent modern astronomy on February 6, 2019 at 12:00 pm
"And the first group of people to do that, to put together a full survey of the entire visible universe at the time was the Harvard Computers ... of relativity and the curvature of space. "Our underst... […]
- UA research team studies human-computer interaction on January 28, 2019 at 12:16 am
Students working in the UA Human Technology Interaction Lab are reimagining ... Crawford said in addition to understanding how to design physiological computer technologies for a younger age group, th... […]
- Understanding Human/Computer Symbiosis for AI on December 3, 2018 at 4:17 am
Did you know that 50- 80% of your enterprise business processes can be automated with AssistEdge? Identify processes, deploy bots and scale effortlessly with AssistEdge. Professor Francesca Rossi, a p... […]
- Human Centered Design and Engineering on October 20, 2018 at 3:43 pm
In the Department of Human Centered Design and Engineering (HCDE), students are designing the ... HCDE students and faculty focus on understanding human needs and interests as they design and build en... […]
- Smoking pot and promising us a human-computer interface: Just another day for Elon Musk on September 8, 2018 at 9:03 am
“How much smarter are you with a phone or computer or without ... “Neuroscience researchers say we have very limited understanding about how the neurons in the human brain communicate, and our methods ... […]
- The Long History of Computer Science and Psychology Comes Into View on March 18, 2018 at 1:33 pm
The work has taken place almost entirely in the domain of computer science, with little input from clinical psychologists, ethicists, or other academic fields interested in the messy details of human ... […]
- Understanding UX and UI in human-computer interaction on July 22, 2017 at 5:00 pm
The misunderstanding about differences between user experience (UX) and user interface (UI) repeats frequently in tech-based organisations. Both attributes operate in symbiosis, however, each one has ... […]
via Bing News