With a smartphone and a browser, people worldwide will be able to interact with a robot to speed the process of teaching robots how to do basic tasks.
In the basement of the Gates Computer Science Building at Stanford University, a screen attached to a red robotic arm lights up. A pair of cartoon eyes blinks. “Meet Bender,” says Ajay Mandlekar, PhD student in electrical engineering.
Bender is one of the robot arms that a team of Stanford researchers is using to test two frameworks that, together, could make it faster and easier to teach robots basic skills. The RoboTurk framework allows people to direct the robot arms in real time with a smartphone and a browser by showing the robot how to carry out tasks like picking up objects. SURREAL speeds the learning process by running multiple experiences at once, essentially allowing the robots to learn from many experiences simultaneously.
“With RoboTurk and SURREAL, we can push the boundary of what robots can do by combining lots of data collected by humans and coupling that with large-scale reinforcement learning,” said Mandlekar, a member of the team that developed the frameworks.
The group will be presenting RoboTurk and SURREAL Oct. 29 at the conference on robot learning in Zurich, Switzerland.
Humans teaching robots
Yuke Zhu, a PhD student in computer science and a member of the team, showed how the system works by opening the app on his iPhone and waving it through the air. He guided the robot arm – like a mechanical crane in an arcade game – to hover over his prize: a wooden block painted to look like a steak. This is a simple pick-and-place task that involves identifying objects, picking them up and putting them into the bin with the correct label.
To humans, the task seems ridiculously easy. But for the robots of today, it’s quite difficult. Robots typically learn by interacting with and exploring their environment – which usually results in lots of random arm waving – or from large datasets. Neither of these is as efficient as getting some human help. In the same way that parents teach their children to brush their teeth by guiding their hands, people can demonstrate to robots how to do specific tasks.
However, those lessons aren’t always perfect. When Zhu pressed hard on his phone screen and the robot released its grip, the wooden steak hit the edge of the bin and clattered onto the table. “Humans are by no means optimal at this,” Mandlekar said, “but this experience is still integral for the robots.”
Faster learning in parallel
These trials – even the failures – provide invaluable information. The demonstrations collected through RoboTurk will give the robots background knowledge to kickstart their learning. SURREAL can run thousands of simulated experiences by people worldwide at once to speed the learning process.
“With SURREAL, we want to accelerate this process of interacting with the environment,” said Linxi Fan, a PhD student in computer science and a member of the team. These frameworks drastically increase the amount of data for the robots to learn from.
“The twin frameworks combined can provide a mechanism for AI-assisted human performance of tasks where we can bring humans away from dangerous environments while still retaining a similar level of task execution proficiency,” said postdoctoral fellow Animesh Garg, a member of the team that developed the frameworks.
The team envisions that robots will be an integral part of everyday life in the future: helping with household chores, performing repetitive assembly tasks in manufacturing or completing dangerous tasks that may pose a threat to humans.
“You shouldn’t have to tell the robot to twist its arm 20 degrees and inch forward 10 centimeters,” said Zhu. “You want to be able to tell the robot to go to the kitchen and get an apple.”
Receive an email update when we add a new ROBOT LEARNING article.
The Latest on: Robot learning
via Google News
The Latest on: Robot learning
How AI Can Make Smart Robots Smarter
on November 12, 2018 at 6:51 pm
The Chief Scientist of the company, Pieter Abbeel, is also the Director of the UC Berkeley Robot Learning Lab and three of his star students have joined him to build a solution that can easily teach r... […]
Before replacing a carer with a robot, we need to assess the pros and cons
on November 12, 2018 at 4:11 pm
Our study participants identified that robots were “leveraged” as something new and attractive to keep young people interested in learning, or as “a conversation starter” with prospective families exp... […]
Two-step training helps robots interpret human language
on November 12, 2018 at 8:52 am
“Mapping Navigation Instructions to Continuous Control Actions With Position-Visitation Prediction,” presented at the Conference on Robot Learning Oct. 29-31 in Zurich, Switzerland. “Once it can predi... […]
'Tis The Season Of STEM With Learning Resources Toys Earning More Than 35 Industry Accolades
on November 12, 2018 at 8:51 am
This Year's Hot STEM Must-Haves, Botley™ the Coding Robot and Beaker Creatures™ Liquid Reactor Super Lab, Lead the Award Winners CHICAGO, Nov. 12, 2018 /PRNewswire/ -- Educational toys from Learning R... […]
This $180 toy robot has virtually limitless activities that teach my kids STEM skills, and it's a lot of fun
on November 12, 2018 at 8:32 am
And both have experience with a variety of STEM learning tools. After seeing our review of the LittleBits Star Wars Droid Inventor Kit, Wonder Workshop wanted us to test out its Cue Coding Robot for f... […]
Meet the Robot Who Knows How to Trade Bonds Better Than You Do
on November 11, 2018 at 11:51 pm
(Bloomberg) -- The robots have just got a step closer to managing ... according to a Greenwich Associates report. Machine Learning “Big data and machine learning are already being applied ... […]
Robotics team is making hundreds of ornaments for Festival of Trees
on November 10, 2018 at 6:00 am
It's after 6 p.m. on a Tuesday night, and several rooms in the Arconic Learning Center ... white and green robots (doll-like creations); small picture frames into which they will place cut ... […]
For Autistic Kids, Robots Can Be Social, Learning Study Buddy
on November 10, 2018 at 12:20 am
Robots have been put to work assembling cars in factories, answering questions at conventions and hotel lobbies, moving packages in warehouses, and more. Now, a team at the University of Southern Cali... […]
Robots are learning hand gestures by watching hours of TED talks
on November 10, 2018 at 12:02 am
We say a lot with our hands. We spread them wide to indicate size, stab the air for emphasis and reach out to draw people in. Waving our hands about when we speak makes us appear less robotic – and th... […]
via Bing News