Researchers at the U.S. Army Research Laboratory and the University of Texas at Austin have developed new techniques for robots or computer programs to learn how to perform tasks by interacting with a human instructor.
The findings of the study will be presented and published at the Association for the Advancement of Artificial Intelligence Conference in New Orleans, Louisiana, Feb. 2-7.
ARL and UT researchers considered a specific case where a human provides real-time feedback in the form of critique. First introduced by collaborator Dr. Peter Stone, a professor at the University of Texas at Austin, along with his former doctoral student, Brad Knox, as TAMER, or Training an Agent Manually via Evaluative Reinforcement, the ARL/UT team developed a new algorithm called Deep TAMER.
It is an extension of TAMER that uses deep learning – a class of machine learning algorithms that are loosely inspired by the brain to provide a robot the ability to learn how to perform tasks by viewing video streams in a short amount of time with a human trainer.
According to Army researcher Dr. Garrett Warnell, the team considered situations where a human teaches an agent how to behave by observing it and providing critique, for example, “good job” or “bad job” -similar to the way a person might train a dog to do a trick. Warnell said the researchers extended earlier work in this field to enable this type of training for robots or computer programs that currently see the world through images, which is an important first step in designing learning agents that can operate in the real world.
Many current techniques in artificial intelligence require robots to interact with their environment for extended periods of time to learn how to optimally perform a task. During this process, the agent might perform actions that may not only be wrong, like a robot running into a wall for example, but catastrophic like a robot running off the side of a cliff. Warnell said help from humans will speed things up for the agents, and help them avoid potential pitfalls.
As a first step, the researchers demonstrated Deep TAMER’s success by using it with 15 minutes of human-provided feedback to train an agent to perform better than humans on the Atari game of bowling – a task that has proven difficult for even state-of-the-art methods in artificial intelligence. Deep-TAMER-trained agents exhibited superhuman performance, besting both their amateur trainers and, on average, an expert human Atari player.
Within the next one to two years, researchers are interested in exploring the applicability of their newest technique in a wider variety of environments: for example, video games other than Atari Bowling and additional simulation environments to better represent the types of agents and environments found when fielding robots in the real world.
Their work will be published in the AAAI 2018 conference proceedings.
“The Army of the future will consist of Soldiers and autonomous teammates working side-by-side,” Warnell said. “While both humans and autonomous agents can be trained in advance, the team will inevitably be asked to perform tasks, for example, search and rescue or surveillance, in new environments they have not seen before. In these situations, humans are remarkably good at generalizing their training, but current artificially-intelligent agents are not.”
Deep TAMER is the first step in a line of research its researchers envision will enable more successful human-autonomy teams in the Army. Ultimately, they want autonomous agents that can quickly and safely learn from their human teammates in a wide variety of styles such as demonstration, natural language instruction and critique.
The Latest on: Deep Learning
via Google News
The Latest on: Deep Learning
- Core Scientific Provides NetApp ONTAP AI Infrastructure as a Service - Powered by NVIDIA DGX Systems for Deep Learning solutionson November 15, 2019 at 5:14 am
BELLEVUE, Wash., Nov. 15, 2019 /PRNewswire/ -- Core Scientific www.corescientific.com provides accelerated AI computing optimized to the demands of AI and deep learning. Core Scientific's Cloud for ...
- Deep learning segmentation of major vessels in X-ray coronary angiographyon November 15, 2019 at 2:22 am
In the present study, we proposed a robust method for major vessel segmentation using deep learning models with fully convolutional networks. When angiographic images of 3302 diseased major vessels ...
- Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctionson November 15, 2019 at 2:22 am
Here we present a deep learning framework for the prediction of the quantum mechanical wavefunction in a local basis of atomic orbitals from which all other ground-state properties can be derived.
- Deep Learning Market 2019 Drivers, Opportunities, Trends, and Forecast by 2025 – MRE Research Reporton November 14, 2019 at 11:01 pm
Nov 15, 2019 (Heraldkeepers) -- New York, November 15, 2019: The Deep Learning Market is segmented on the Basis of End-User Type, Application Type, Solution Type and Regional Analysis. By End-User ...
- Going deeper: Moveworks snags $75M in new money to bolster deep learning in enterpriseon November 14, 2019 at 4:30 pm
Unlike some applications of BERT or Transformer, which "fine tune" the system, a relatively simpler task, Moveworks is "pre-training" the BERT model, which means developing the initial corpus of text ...
- Amazon Saw 15-Fold Jump In Forecast Accuracy With Deep Learning And Other AI Statson November 14, 2019 at 6:04 am
When Amazon switched from traditional machine learning techniques to deep learning in 2015, it saw a 15-fold increase in the accuracy of its forecasts, a leap that has enabled it to roll-out its ...
- Deep learning expands study of nuclear waste remediationon November 13, 2019 at 3:38 am
A research collaboration between Lawrence Berkeley National Laboratory (Berkeley Lab), Pacific Northwest National Laboratory (PNNL), Brown University, and NVIDIA has achieved exaflop performance on ...
- Deep Learning Market to Hold a High Potential for Growth by 2026: Allied Market Researchon November 13, 2019 at 12:09 am
Nov 13, 2019 (Hitech News Daily via COMTEX) -- Deep learning is a subfield of machine learning that consist of a series of computer instructions or algorithms that is inspired by the function and ...
- Deep learning assists in detecting malignant lung cancerson November 12, 2019 at 11:08 am
Radiologists assisted by deep-learning based software were better able to detect malignant lung cancers on chest X-rays, according to research published in the journal Radiology. "The average ...
via Bing News