The neural structure we use to store and process information in verbal working memory is more complex than previously understood, finds a new study by NYU researchers–a discovery that has implications for the creation of artificial intelligence systems.
The neural structure we use to store and process information in verbal working memory is more complex than previously understood, finds a new study by researchers at New York University. It shows that processing information in working memory involves two different networks in the brain rather than one—a discovery that has implications for the creation of artificial intelligence (AI) systems, such as speech translation tools.
“Our results show there are at least two brain networks that are active when we are manipulating speech and language information in our minds,” explains Bijan Pesaran, an associate professor at New York University’s Center for Neural Science and the senior author of the research.
The work appears in the journal Nature Neuroscience.
Past studies had emphasized how a single “Central Executive” oversaw manipulations of information stored in working memory. The distinction is an important one, Pesaran observes, because current AI systems that replicate human speech typically assume computations involved in verbal working memory are performed by a single neural network.
“Artificial intelligence is gradually becoming more human like,” says Pesaran. “By better understanding intelligence in the human brain, we can suggest ways to improve AI systems. Our work indicates that AI systems with multiple working memory networks are needed.”
The paper’s first author was Greg Cogan, an NYU postdoctoral fellow at the time of the study and now a postdoctoral fellow at Duke University; other co-authors were Professor Orrin Devinsky, director of the Comprehensive Epilepsy Center at NYU Langone Medical Center, Werner Doyle, an associate professor at NYU Langone’s Department of Neurosurgery, Dan Friedman, an associate professor at NYU Langone’s Department of Neurology, and Lucia Melloni, an assistant professor at NYU Langone’s Department of Neurology.
The study focused on a form of working memory critical for thinking, planning, and creative reasoning and involves holding in mind and transforming the information necessary for speech and language.
The researchers examined human patients undergoing brain monitoring to treat drug-resistant epilepsy. Specifically, they decoded neural activity recorded from the surface of the brain of these patients as they were listening to speech sounds and speaking after a short delay. This method required the study’s subjects to use a rule provided by the researchers to transform speech sounds they heard into different spoken utterances—for example, the patients were told to repeat the same sound they had heard while at other times the researchers instructed the patients to listen to the sound and make a different utterance.
The researchers decoded the neural activity in each patient’s brain as the patients applied the rule to convert what they heard into what they needed to say. The results revealed that manipulating information held in working memory involved the operation of two brain networks. One network encoded the rule that the patients were using to guide the utterances they made (the rule network). Surprisingly, however, the rule network did not encode the details of how the subjects converted what they heard into what they said. The process of using the rule to transform the sounds into speech was handled by a second, transformation network. Activity in this network could be used to track how the input (what was heard) was being converted into the output (what was spoken) moment-by-moment.
Translating what you hear in one language to speak in another language involves applying a similar set of abstract rules. People with impairments of verbal working memory find it difficult to learn new languages. Modern intelligent machines also have trouble learning languages, the researchers add.
“One way we can enhance the development of more intelligent systems is with a fuller understanding of how the human brain and mind works,” notes Pesaran. “Diagnosing and treating working memory impairments in people involves psychological assessments. By analogy, machine psychology may one day be useful for diagnosing and treating impairments in the intelligence of our machines. This research examines a uniquely human form of intelligence, verbal working memory, and suggests new ways to make machines more intelligent.”
Receive an email update when we add a new ARTIFICIAL INTELLIGENCE article.
The Latest on: Artificial intelligence systems
via Google News
The Latest on: Artificial intelligence systems
- How Coronavirus and Protests Broke Artificial Intelligence And Why It’s A Good Thingon June 26, 2020 at 9:01 am
AI researchers are grappling with what our role should be in dismantling systemic racism, economic oppression, and other forms of injustice and discrimination.” ...
- NASA trains artificial intelligence systems that will direct the search for alien life in rock samples on Mars during the European Space Agency ExoMars mission in 2022on June 26, 2020 at 8:12 am
Rosalind Franklin 'ExoMars' rover will be the first to have the new AI system when it leaves for the Red Planet in 2022/2023.
- North American Artificial Intelligence (AI) in Drug Discovery Market 2020-2026 - ResearchAndMarkets.comon June 26, 2020 at 4:28 am
The "North America Artificial Intelligence (AI) in Drug Discovery Market 2020-2026 by Offering, Technology, Drug Type, Therapeutic Area, Application, End User, and Country: Trend Forecast and Growth ...
- Digital Transformation in Asia-Pacific: 5G, Artificial Intelligence, Internet of Things and Smart Cities 2020-2025 - ResearchAndMarkets.comon June 26, 2020 at 4:18 am
The "Digital Transformation Asia Pacific: 5G, Artificial Intelligence, Internet of Things, and Smart Cities in APAC 2020 - 2025" report has been added to ResearchAndMarkets.com's offering. From ...
- Artificial Intelligence (AI) Market Size, Share 2020 Global Growth Insight, Trends, Industry Key Players, Regional Forecast To 2023on June 26, 2020 at 3:16 am
Global "Artificial Intelligence (AI) Market" report 2020 has brief analysis and full-scale proposition of market ...
- Artificial Intelligence in Drug Discovery Market Global Trends, Market Share, Industry Size, Growth, Opportunities and Market Forecast 2020 to 2027on June 25, 2020 at 11:34 am
The Global Artificial Intelligence in Drug Discovery Market is anticipated to value over USD 2.08 billion by 2027 end with a CAGR of over 40.5% during the forecast period 2020 to 2027. The rising ...
- Intel takes new twist on artificial intelligence innovation with Valley degree programon June 25, 2020 at 5:00 am
Intel Corp. has long been known for its artificial intelligence innovations, but now the company — which has a huge presence in Chandler — is taking a new step into AI development. #phoenix ...
- Glitzy Air Force Video Lays Out "Skyborg" Artificial Intelligence Combat Drone Programon June 24, 2020 at 8:04 pm
The presentation outlines potential future mission sets, including air-to-air combat, and how the drones will fit into the service's larger plans.
- Amazon uses artificial intelligence to enforce social distancingon June 24, 2020 at 10:52 am
Amazon has unveiled a new artificial intelligence system to monitor social distancing among employees, in the hopes of reducing coronavirus infections. Wired staff writer Louise Matsakis joined CBSN ...
via Bing News