UC Berkeley researchers have developed algorithms that enable robots to learn motor tasks through trial and error using a process that more closely approximates the way humans learn, marking a major milestone in the field of artificial intelligence.
They demonstrated their technique, a type of reinforcement learning, by having a robot complete various tasks — putting a clothes hanger on a rack, assembling a toy plane, screwing a cap on a water bottle, and more — without pre-programmed details about its surroundings.
“What we’re reporting on here is a new approach to empowering a robot to learn,” said Professor Pieter Abbeel of UC Berkeley’s Department of Electrical Engineering and Computer Sciences. “The key is that when a robot is faced with something new, we won’t have to reprogram it. The exact same software, which encodes how the robot can learn, was used to allow the robot to learn all the different tasks we gave it.”
The latest developments will be presented on Thursday, May 28, in Seattle at the International Conference on Robotics and Automation (ICRA). Abbeel is leading the project with fellow UC Berkeley faculty member Trevor Darrell, director of the Berkeley Vision and Learning Center. Other members of the research team are postdoctoral researcher Sergey Levine and Ph.D. student Chelsea Finn.
The work is part of a new People and Robots Initiative at UC’s Center for Information Technology Research in the Interest of Society (CITRIS). The new multi-campus, multidisciplinary research initiative seeks to keep the dizzying advances in artificial intelligence, robotics and automation aligned to human needs.
“Most robotic applications are in controlled environments where objects are in predictable positions,” said Darrell. “The challenge of putting robots into real-life settings, like homes or offices, is that those environments are constantly changing. The robot must be able to perceive and adapt to its surroundings.”
Conventional, but impractical, approaches to helping a robot make its way through a 3D world include pre-programming it to handle the vast range of possible scenarios or creating simulated environments within which the robot operates.
Instead, the UC Berkeley researchers turned to a new branch of artificial intelligence known as deep learning, which is loosely inspired by the neural circuitry of the human brain when it perceives and interacts with the world.
“For all our versatility, humans are not born with a repertoire of behaviors that can be deployed like a Swiss army knife, and we do not need to be programmed,” said Levine. “Instead, we learn new skills over the course of our life from experience and from other humans. This learning process is so deeply rooted in our nervous system, that we cannot even communicate to another person precisely how the resulting skill should be executed. We can at best hope to offer pointers and guidance as they learn it on their own.”
In the world of artificial intelligence, deep learning programs create “neural nets” in which layers of artificial neurons process overlapping raw sensory data, whether it be sound waves or image pixels. This helps the robot recognize patterns and categories among the data it is receiving. People who use Siri on their iPhones, Google’s speech-to-text program or Google Street View might already have benefited from the significant advances deep learning has provided in speech and vision recognition.
Applying deep reinforcement learning to motor tasks has been far more challenging, however, since the task goes beyond the passive recognition of images and sounds.
“Moving about in an unstructured 3D environment is a whole different ballgame,” said Finn. “There are no labeled directions, no examples of how to solve the problem in advance. There are no examples of the correct solution like one would have in speech and vision recognition programs.”
The Latest on: Deep Learning
via Google News
The Latest on: Deep Learning
- Scientists develop a deep learning method to solve a fundamental problem in statistical physicson September 6, 2019 at 5:08 am
A team of scientists at Freie Universität Berlin has developed an Artificial Intelligence (AI) method that provides a fundamentally new solution of the "sampling problem" in statistical physics.
- What is the current scenario of Deep Learning Market in US? Amazon Web Services (AWS), Google, IBM, Intel, Micron Technologyon September 6, 2019 at 3:48 am
Sep 06, 2019 (Industry News Wire via COMTEX) -- Market Research Vision has published a latest and most trending report on Deep Learning Market which estimates that the global market size of Deep ...
- Deep Learning Market Size, Share, Analysis, Applications, Sale, Growth Insight, Trends, Leaders, Services and Future Forecast to 2023on September 4, 2019 at 11:48 pm
In enterprise computing, deep learning is evolving into one of the most advanced technologies. Deep learning is a subset of machine learning in Artificial Intelligence (AI) that has networks capable ...
- Deep-learning AI technique helps scientists see more clearly inside the cellon September 4, 2019 at 5:51 am
And the view on the right? That’s the same data after scientists processed it with software powered by deep learning, an artificial intelligence technique that’s swiftly gaining traction in biomedical ...
- Solving the puzzle of deep learning with GPUs and containerson September 4, 2019 at 4:13 am
Puzzled about how to run your artificial intelligence (AI), machine learning (ML), and deep learning (DL) applications at scale, with maximum performance, and minimum cost? There are lots of cloud ...
- Deep learning extends de novo protein modelling coverage of genomes using iteratively predicted structural constraintson September 4, 2019 at 2:20 am
The inapplicability of amino acid covariation methods to small protein families has limited their use for structural annotation of whole genomes. Recently, deep learning has shown promise in allowing ...
- Deep Learning for Semantic Segmentation of Defects in Advanced STEM Images of Steelson September 4, 2019 at 2:14 am
Crystalline materials exhibit long-range ordered lattice unit, within which resides nonperiodic structural features called defects. These crystallographic defects play a vital role in determining the ...
- Best of arXiv.org for AI, Machine Learning, and Deep Learning – July 2019on August 28, 2019 at 4:01 pm
In this recurring monthly feature, we filter recent research papers appearing on the arXiv.org preprint server for compelling subjects relating to AI, machine learning and deep learning – from ...
- Most Examples of Deep Learning Are Not Deep Enoughon August 28, 2019 at 3:54 am
In Part One of this pair of blogs—The Unity of the Human Race: Our Precarious Future—I made the case that we are getting perilously close to planet-destroying forces that could unwittingly and ...
- Deep Learning on GPUs: Successes and Promiseson August 27, 2019 at 9:05 am
The rise of deep-learning (DL) has been fueled by the improvements in accelerators. Accelerators allow DL models to crunch a large amount of data, which is vital for them to achieve high accuracy. In ...
via Bing News