UC Berkeley researchers have developed algorithms that enable robots to learn motor tasks through trial and error using a process that more closely approximates the way humans learn, marking a major milestone in the field of artificial intelligence.
They demonstrated their technique, a type of reinforcement learning, by having a robot complete various tasks — putting a clothes hanger on a rack, assembling a toy plane, screwing a cap on a water bottle, and more — without pre-programmed details about its surroundings.
“What we’re reporting on here is a new approach to empowering a robot to learn,” said Professor Pieter Abbeel of UC Berkeley’s Department of Electrical Engineering and Computer Sciences. “The key is that when a robot is faced with something new, we won’t have to reprogram it. The exact same software, which encodes how the robot can learn, was used to allow the robot to learn all the different tasks we gave it.”
The latest developments will be presented on Thursday, May 28, in Seattle at the International Conference on Robotics and Automation (ICRA). Abbeel is leading the project with fellow UC Berkeley faculty member Trevor Darrell, director of the Berkeley Vision and Learning Center. Other members of the research team are postdoctoral researcher Sergey Levine and Ph.D. student Chelsea Finn.
The work is part of a new People and Robots Initiative at UC’s Center for Information Technology Research in the Interest of Society (CITRIS). The new multi-campus, multidisciplinary research initiative seeks to keep the dizzying advances in artificial intelligence, robotics and automation aligned to human needs.
“Most robotic applications are in controlled environments where objects are in predictable positions,” said Darrell. “The challenge of putting robots into real-life settings, like homes or offices, is that those environments are constantly changing. The robot must be able to perceive and adapt to its surroundings.”
Conventional, but impractical, approaches to helping a robot make its way through a 3D world include pre-programming it to handle the vast range of possible scenarios or creating simulated environments within which the robot operates.
Instead, the UC Berkeley researchers turned to a new branch of artificial intelligence known as deep learning, which is loosely inspired by the neural circuitry of the human brain when it perceives and interacts with the world.
“For all our versatility, humans are not born with a repertoire of behaviors that can be deployed like a Swiss army knife, and we do not need to be programmed,” said Levine. “Instead, we learn new skills over the course of our life from experience and from other humans. This learning process is so deeply rooted in our nervous system, that we cannot even communicate to another person precisely how the resulting skill should be executed. We can at best hope to offer pointers and guidance as they learn it on their own.”
In the world of artificial intelligence, deep learning programs create “neural nets” in which layers of artificial neurons process overlapping raw sensory data, whether it be sound waves or image pixels. This helps the robot recognize patterns and categories among the data it is receiving. People who use Siri on their iPhones, Google’s speech-to-text program or Google Street View might already have benefited from the significant advances deep learning has provided in speech and vision recognition.
Applying deep reinforcement learning to motor tasks has been far more challenging, however, since the task goes beyond the passive recognition of images and sounds.
“Moving about in an unstructured 3D environment is a whole different ballgame,” said Finn. “There are no labeled directions, no examples of how to solve the problem in advance. There are no examples of the correct solution like one would have in speech and vision recognition programs.”
The Latest on: Deep Learning
via Google News
The Latest on: Deep Learning
- New deep learning model identifies sleep stageson February 3, 2020 at 4:04 pm
Helsinki [Finland], Feb 3 (ANI): Researchers at the University of Eastern Finland have developed a new deep learning model that can identify sleep stages as accurately as an experienced physician.
- Deep Learning Model Found to Accurately, Automatically Detect Sleep Staging for Patients With Suspected OSAon February 3, 2020 at 1:22 pm
Using a deep learning–based model to characterize sleep staging, researchers were able to accurately and automatically detect patients with and without obstructive sleep apnea (OSA), but accuracy ...
- Video: Data Parallel Deep Learningon February 3, 2020 at 7:35 am
In this video, Huihuo Zheng from Argonne National Laboratory presents: Data Parallel Deep Learning. The Argonne Training Program on Extreme-Scale Computing (ATPESC) provides intensive, two weeks of ...
- New deep learning model can accurately identify sleep stageson February 3, 2020 at 7:03 am
A new deep learning model developed by researchers at the University of Eastern Finland can identify sleep stages as accurately as an experienced physician. This opens up new avenues for the ...
- Deep Learning Market Challenges, Key Players, Market Segments, Development, Opportunities, Forecast Report 2026on February 3, 2020 at 3:26 am
New Jersey, United States - The report titled, Deep Learning Market has been recently published by Verified Market Research. The Deep Learning market has been garnering remarkable momentum in recent ...
- What are Machine Learning and Deep Learning in Artificial Intelligenceon February 2, 2020 at 2:16 pm
AI can be called a superset of Machine Learning (ML) processes, and Deep Learning (DL) processes. AI usually is an umbrella term that is used for ML and DL. Deep Learning is again, a subset of Machine ...
- Deep transfer learning has now been used to classify galaxies with expert-level accuracyon January 31, 2020 at 11:56 pm
Last year in September, researchers used deep learning to probe into dark matter in an industry first. Now, the same technique has been used to study galaxies. In the paper titled "Deep Learning at ...
- 5 Soon-to-Be Trends in Artificial Intelligence And Deep Learningon January 31, 2020 at 5:10 pm
AI’s major headwind is the cost of the investment, which will skew returns in the short-term. When the turnaround occurs, however, companies who are making the investment can expect to be rewarded ...
- Deep Learning Models for Histopathological Classification of Gastric and Colonic Epithelial Tumourson January 30, 2020 at 2:40 am
In 2018, there were 1,033,701 new cases and 782,685 deaths due to stomach cancer, and 1,096,601 new cases and 551,269 deaths due to colon cancer. Here, we propose deep learning models to classify ...
- Deep Learning Chipset Market Size, Share 2020 Supply, Consumption, Cost and Profit analysis and forecast to 2024| Says Market Reports Worldon January 29, 2020 at 9:37 pm
Deep Learning Chipset Market 2020 :- The Deep Learning Chipset Market has been created based on an in-depth market analysis with inputs from industry experts. The report covers the growth prospects ...
via Bing News