System could help prevent robots from overwhelming human teammates with information
Autonomous robots performing a joint task send each other continual updates: “I’ve passed through a door and am turning 90 degrees right.” “After advancing 2 feet I’ve encountered a wall. I’m turning 90 degrees right.” “After advancing 4 feet I’ve encountered a wall.” And so on.
Computers, of course, have no trouble filing this information away until they need it. But such a barrage of data would drive a human being crazy.
At the annual meeting of the Association for the Advancement of Artificial Intelligence last weekend, researchers at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) presented a new way of modeling robot collaboration that reduces the need for communication by 60 percent. They believe that their model could make it easier to design systems that enable humans and robots to work together — in, for example, emergency-response teams.
“We haven’t implemented it yet in human-robot teams,” says Julie Shah, an associate professor of aeronautics and astronautics and one of the paper’s two authors. “But it’s very exciting, because you can imagine: You’ve just reduced the number of communications by 60 percent, and presumably those other communications weren’t really necessary toward the person achieving their part of the task in that team.”
The work could have also have implications for multirobot collaborations that don’t involve humans. Communication consumes some power, which is always a consideration in battery-powered devices, but in some circumstances, the cost of processing new information could be a much more severe resource drain.
In a multiagent system — the computer science term for any collaboration among autonomous agents, electronic or otherwise — each agent must maintain a model of the current state of the world, as well as a model of what each of the other agents takes to be the state of the world. These days, agents are also expected to factor in the probabilities that their models are accurate. On the basis of those probabilities, they have to decide whether or not to modify their behaviors.
In some scenarios, a robot’s decision to broadcast a new item of information could force its fellows to update their models and churn through all those probabilities again. If the information is inessential, broadcasting it could introduce serious delays, to no purpose. And the MIT researchers’ work suggests that 60 percent of communications in multiagent systems may be inessential.
The state-of-the-art method for modeling multiagent systems is called a decentralized partially observable Markov decision process, or Dec-POMDP. A Dec-POMDP factors in several types of uncertainty; not only does it consider whether an agent’s view of the world is correct and whether its estimate of its fellows’ worldviews is correct, it also considers whether any action it takes will be successful. The robot may plan, for instance, to move forward 20 feet but find that crosswinds blow it off course.
Dec-POMDPs generally assume some prior knowledge about the environment in which the agents will be operating. Because Shah and Vaibhav Unhelkar, a graduate student in aeronautics and astronautics and first author on the new paper, were designing a system with emergency-response applications in mind, they couldn’t make that assumption. Emergency-response teams will usually be entering unfamiliar environments, and the very nature of the emergency could render the best prior information obsolete.
Adding the requirement of mapping the environment on the fly, however, makes the problem of computing a multiagent plan prohibitively time consuming. So Shah and Unhelkar’s system ignores uncertainty about actions’ effectiveness and assumes that whatever an agent attempts to do, it will do.
When an agent acquires a new item of information — that, for instance, a given passage through a building is blocked — it has three choices: it can ignore the information; it can use it but not broadcast it; or it can use it and broadcast it.
Each of these choices has benefits but imposes costs. In Shah and Unhelkar’s model, communication is a cost. But if an agent incorporates new information into its own model of the world and doesn’t broadcast it, it also incurs a cost, as its worldview becomes more difficult for its fellows to estimate correctly. For every new item of information an agent acquires, Shah and Unhelkar’s system performs that cost-benefit analysis, based on the agent’s model of the world, its expectations of its fellows’ actions, and the likelihood of accomplishing the joint goal more efficiently.
The researchers tested their system on more than 300 computer simulations of rescue tasks in unfamiliar environments. A version of their system that permitted extensive communication completed the tasks at a rate between 2 and 10 percent higher than the version that reduced communication by 60 percent.
In the experiments, however, all the agents were electronic. “What I’d be willing to bet, although we have to wait until we do the human-subject experiments, is that the human-robot team will fail miserably if the system is just telling the person all sorts of spurious information all the time,” Shah says. “For human-robot teams, I think that this algorithm is going to make the difference between a team that can function effectively versus a team that just plain can’t.”
In a separate research project, members of Shah’s group have asked teams of human subjects to execute similar virtual rescue missions that computer systems did in the experiments reported in the new paper. Using machine-learning algorithms, the researchers have mined the results for statistics on human communication patterns, which can be incorporated into the new model to more explicitly accommodate human-robot teams.
“It is well-understood that in human teams, when one team member gains new information, broadcasting this new information to all team members is generally not a good solution, especially when the cost of communication is high,” says Tim Miller, an assistant professor of computing and information systems at the University of Melbourne in Australia. “This work has applications outside of multiagent systems, reaching into the critical area of human-agent collaboration, where communication can be costly, but more importantly, human team members are quickly overloaded if presented with too much information.”
Learn more: Enabling human-robot rescue teams
The Latest on: Human-agent collaboration
via Google News
The Latest on: Human-agent collaboration
- Krishna C. Mukherjee Continues to Advance Organizations with AI and Automationon November 25, 2019 at 4:07 pm
This collaboration is essential in a rapidly changing environment because it shortens ... Customers, who prefer to call, can be connected by the IVR system to the best human agent. Others, who ...
- How AI And Human Agents Are Allying For An Improved Customer Experience: Insights from CCW And Moreon July 9, 2019 at 1:52 pm
At the third is the human agent. A conversation can start at any vertex ... to assist the agent either behind the scenes or directly with the customer in collaboration with the agent (for example, by ...
- Human-machine collaboration presents workplace challengeson April 5, 2019 at 7:49 am
The human-machine collaboration, expected to shape the future workplace ... the AI agent in most cases will be expected to work alongside the human agent. This will present significant challenges ...
- Hello, Collaboration! How the Future of A.I. Lies With Brand Cross-Pollinationon March 19, 2019 at 2:42 pm
Human out: The customer should always have the ability to engage with a human agent at any time. Customer-facing AI is all about adding value and eliminating friction. And, yes, bot collaboration ...
- Geoff Hinton Dismissed The Need For Explainable AI: 8 Experts Explain Why He's Wrongon December 20, 2018 at 7:50 pm
Timothy Miller, Associate Professor in computer science at the University of Melbourne, Australia, whose specializes in explainable AI and human-agent collaboration, disputes Hinton's claim on the ...
- IBM's AI toolkit will help developers fight bias in AIon November 16, 2018 at 4:58 am
As AI becomes more advanced, more and more aspects of our daily life are touched by invisible algorithms. However, the more we entrust vital decisions to software, the greater the need becomes to ...
- The artificial becomes realon January 30, 2018 at 12:13 pm
Human-agent collaboration is an active research area that addresses calibrated trust and transparency, common understanding of shared perceptions, and human-agent dialogue and collaboration. Army S&T ...
- Army scientists improve human-agent teaming by making AI agents more transparenton January 10, 2018 at 4:00 pm
U.S. Army Research Laboratory scientists developed ways to improve collaboration between humans and artificially ... model and measured its effectiveness on human-agent team performance in a series of ...
- Tech expected to reach a record $351 billion in revenue this yearon January 7, 2018 at 2:16 pm
In the more immediate future, IBM's Research Manager for human-agent collaboration Rachel Bellamy says that an AI system may be able to "explain why it tells you to do what it's recommending." Robots ...
- LiveWorld Introduces SaaS Application to Manage Messenger Chatbots with Automated Connections to Live Human Agentson October 18, 2016 at 7:47 am
Our software fills in this critical missing piece by seamlessly integrating the chatbot and live human agent experience." "This software fundamentally integrates bots as agents to allow for interative ...
via Bing News