With a smartphone and a browser, people worldwide will be able to interact with a robot to speed the process of teaching robots how to do basic tasks.
In the basement of the Gates Computer Science Building at Stanford University, a screen attached to a red robotic arm lights up. A pair of cartoon eyes blinks. “Meet Bender,” says Ajay Mandlekar, PhD student in electrical engineering.
Bender is one of the robot arms that a team of Stanford researchers is using to test two frameworks that, together, could make it faster and easier to teach robots basic skills. The RoboTurk framework allows people to direct the robot arms in real time with a smartphone and a browser by showing the robot how to carry out tasks like picking up objects. SURREAL speeds the learning process by running multiple experiences at once, essentially allowing the robots to learn from many experiences simultaneously.
“With RoboTurk and SURREAL, we can push the boundary of what robots can do by combining lots of data collected by humans and coupling that with large-scale reinforcement learning,” said Mandlekar, a member of the team that developed the frameworks.
The group will be presenting RoboTurk and SURREAL Oct. 29 at the conference on robot learning in Zurich, Switzerland.
Humans teaching robots
Yuke Zhu, a PhD student in computer science and a member of the team, showed how the system works by opening the app on his iPhone and waving it through the air. He guided the robot arm – like a mechanical crane in an arcade game – to hover over his prize: a wooden block painted to look like a steak. This is a simple pick-and-place task that involves identifying objects, picking them up and putting them into the bin with the correct label.
To humans, the task seems ridiculously easy. But for the robots of today, it’s quite difficult. Robots typically learn by interacting with and exploring their environment – which usually results in lots of random arm waving – or from large datasets. Neither of these is as efficient as getting some human help. In the same way that parents teach their children to brush their teeth by guiding their hands, people can demonstrate to robots how to do specific tasks.
However, those lessons aren’t always perfect. When Zhu pressed hard on his phone screen and the robot released its grip, the wooden steak hit the edge of the bin and clattered onto the table. “Humans are by no means optimal at this,” Mandlekar said, “but this experience is still integral for the robots.”
Faster learning in parallel
These trials – even the failures – provide invaluable information. The demonstrations collected through RoboTurk will give the robots background knowledge to kickstart their learning. SURREAL can run thousands of simulated experiences by people worldwide at once to speed the learning process.
“With SURREAL, we want to accelerate this process of interacting with the environment,” said Linxi Fan, a PhD student in computer science and a member of the team. These frameworks drastically increase the amount of data for the robots to learn from.
“The twin frameworks combined can provide a mechanism for AI-assisted human performance of tasks where we can bring humans away from dangerous environments while still retaining a similar level of task execution proficiency,” said postdoctoral fellow Animesh Garg, a member of the team that developed the frameworks.
The team envisions that robots will be an integral part of everyday life in the future: helping with household chores, performing repetitive assembly tasks in manufacturing or completing dangerous tasks that may pose a threat to humans.
“You shouldn’t have to tell the robot to twist its arm 20 degrees and inch forward 10 centimeters,” said Zhu. “You want to be able to tell the robot to go to the kitchen and get an apple.”
The Latest on: Robot learning
via Google News
The Latest on: Robot learning
- Singer-songwriter robot is heading out on touron February 27, 2020 at 10:56 am
So, we use deep learning to generate lyrics, but it’s also combined with semantic knowledge.” Musical robot Shimon plays with human musicians on one of his new songs. Shimon has learned to write ...
- Making French fries sucks. This robot does it for $3 an hour with no breakson February 27, 2020 at 9:12 am
The product of decades of research in robotics and machine learning, Flippy represents a synthesis of motors, sensors, chips and processing power that wasn’t possible until recently. Now, Flippy’s ...
- Robot uses AI to personalize teaching of autistic childrenon February 27, 2020 at 8:59 am
Researchers have developed a new personalized learning robot for autistic children that uses machine learning to adapt its lessons to each kid’s changing needs. The University of Southern Ca ...
- Socially assistive robot helps children with autism learnon February 27, 2020 at 6:14 am
This makes learning new skills a major challenge, especially in traditional school environments. Previous research suggests socially assistive robots can help children with autism learn. But these ...
- Children With Autism Saw Their Learning and Social Skills Boosted After Playing With This AI Roboton February 27, 2020 at 5:08 am
Over half a dozen children with autism played with a green, feathered artificially intelligent robot called Kiwi for the study.
- People prefer robots to explain themselves – and a brief summary doesn't cut iton February 26, 2020 at 4:13 pm
Artificial intelligence is entering our lives in many ways – on our smartphones, in our homes, in our cars. These systems can help people make appointments, drive and even diagnose illnesses. But as ...
- Robots that teach autistic kids social skills could help them developon February 26, 2020 at 2:02 pm
Now a new study, published in Science Robotics today, has taken an important step in advancing the AI that powers these in-home companions. Maja J. Matarić and her team at the University of Southern ...
- Inside the mind of an autonomous delivery roboton February 26, 2020 at 1:15 pm
If one of Starship’s robots encounters an obstacle on the sidewalk, its response is to stop in its tracks. That’s because stopping is the safest thing to do. But stopping on a driveway, or while ...
- Shimon is a singing and songwriting roboton February 26, 2020 at 6:21 am
Researchers working on the project trained the robot using datasets of 50,000 lyrics from jazz, prong rock, and hip-hop genres. The robot uses deep learning to generate words to go with the themes ...
via Bing News