A Step Closer to Self-Aware Machines
Robots that are self-aware have been science fiction fodder for decades, and now we may finally be getting closer. Humans are unique in being able to imagine themselves—to picture themselves in future scenarios, such as walking along the beach on a warm sunny day. Humans can also learn by revisiting past experiences and reflecting on what went right or wrong. While humans and animals acquire and adapt their self-image over their lifetime, most robots still learn using human-provided simulators and models, or by laborious, time-consuming trial and error. Robots have not learned to simulate themselves the way humans do.
Columbia Engineering researchers have made a major advance in robotics by creating a robot that learns what it is, from scratch, with zero prior knowledge of physics, geometry, or motor dynamics. Initially the robot does not know if it is a spider, a snake, an arm—it has no clue what its shape is. After a brief period of “babbling,” and within about a day of intensive computing, their robot creates a self-simulation. The robot can then use that self-simulator internally to contemplate and adapt to different situations, handling new tasks as well as detecting and repairing damage in its own body. The work is published today in Science Robotics.
Video of Columbia Engineering robot that learns what it is, with zero prior knowledge of physics, geometry, or motor dynamics. Initially the robot has no clue what its shape is. After a brief period of “babbling,” and within about a day of intensive computing, the robot creates a self-simulation, which it can then use to contemplate and adapt to different situations, handling new tasks as well as detecting and repairing damage in its body.
To date, robots have operated by having a human explicitly model the robot. “But if we want robots to become independent, to adapt quickly to scenarios unforeseen by their creators, then it’s essential that they learn to simulate themselves,” says Hod Lipson, professor of mechanical engineering, and director of the Creative Machines lab, where the research was done.
For the study, Lipson and his PhD student Robert Kwiatkowski used a four-degree-of-freedom articulated robotic arm. Initially, the robot moved randomly and collected approximately one thousand trajectories, each comprising one hundred points. The robot then used deep learning, a modern machine learning technique, to create a self-model. The first self-models were quite inaccurate, and the robot did not know what it was, or how its joints were connected. But after less than 35 hours of training, the self-model became consistent with the physical robot to within about four centimeters. The self-model performed a pick-and-place task in a closed loop system that enabled the robot to recalibrate its original position between each step along the trajectory based entirely on the internal self-model. With the closed loop control, the robot was able to grasp objects at specific locations on the ground and deposit them into a receptacle with 100 percent success.
Even in an open-loop system, which involves performing a task based entirely on the internal self-model, without any external feedback, the robot was able to complete the pick-and-place task with a 44 percent success rate. “That’s like trying to pick up a glass of water with your eyes closed, a process difficult even for humans,” observed the study’s lead author Kwiatkowski, a PhD student in the computer science department who works in Lipson’s lab.
The self-modeling robot was also used for other tasks, such as writing text using a marker. To test whether the self-model could detect damage to itself, the researchers 3D-printed a deformed part to simulate damage and the robot was able to detect the change and re-train its self-model. The new self-model enabled the robot to resume its pick-and-place tasks with little loss of performance.
Lipson, who is also a member of the Data Science Institute, notes that self-imaging is key to enabling robots to move away from the confinements of so-called “narrow-AI” towards more general abilities. “This is perhaps what a newborn child does in its crib, as it learns what it is,” he says. “We conjecture that this advantage may have also been the evolutionary origin of self-awareness in humans. While our robot’s ability to imagine itself is still crude compared to humans, we believe that this ability is on the path to machine self-awareness.”
Lipson believes that robotics and AI may offer a fresh window into the age-old puzzle of consciousness. “Philosophers, psychologists, and cognitive scientists have been pondering the nature self-awareness for millennia, but have made relatively little progress,” he observes. “We still cloak our lack of understanding with subjective terms like ‘canvas of reality,’ but robots now force us to translate these vague notions into concrete algorithms and mechanisms.”
Lipson and Kwiatkowski are aware of the ethical implications. “Self-awareness will lead to more resilient and adaptive systems, but also implies some loss of control,” they warn. “It’s a powerful technology, but it should be handled with care.”
The researchers are now exploring whether robots can model not just their own bodies, but also their own minds, i.e. whether robots can think about thinking.
Learn more: A Step Closer to Self-Aware Machines
The Latest on: Self-aware machines
via Google News
The Latest on: Self-aware machines
- Billie Eilish: the candid, self-aware voice of a generation takes on 007on January 18, 2020 at 9:30 am
The 18-year-old is the youngest person to sing a Bond theme – but she has handled a year of supernova fame with a maturity beyond her years ...
- Scientists turn frog cells into living machineson January 14, 2020 at 1:40 pm
(Photo: Sam Kriegman/University of Vermont) Despite their promise, it's hard to dismiss the ethical implications of grafting living cells to machines. Is there a point where "living, programmable ...
- The Roaring 20’s and the #Futureof2020on January 7, 2020 at 12:55 pm
The future is autonomous. Machines will deliver services that are continuous, auto-compliant, self-healing, self-learning, and self-aware. The need for greater precision decisions will require ...
- Meet the nonprofit that’s already fighting for the rights of sentient robotson April 10, 2019 at 7:10 am
Movies like Blade Runner and other science fiction tend to depict robots as self-aware machines, capable of making their own decisions and able to express personality and emotion. Robots aren’t ...
- AI BREAKTHROUGH: Scientists build ‘self-aware’ robot able to REPAIR ITSELFon February 18, 2019 at 12:01 am
And this ability is framed as a significant step toward building truly self-aware machines. Robert Kwiatkowski, a phd student at Columbia University’s prestigious Creative Machines Lab ...
- Robot, know thyself; machines get more self-awareon February 4, 2019 at 9:59 pm
“In the future we plan that this machine will also help us conquer deep space,” he added. Fedor is not the first robot to go into space. In 2011, NASA sent up Robonaut 2, a humanoid robot ...
- Robot, know thyself; machines get more self-awareon February 4, 2019 at 3:46 pm
NEW YORK (AP) — Forget dreaming of electric sheep. Robots first need to figure out how to imagine themselves. One New York robot has done just that. It's learned that it's a robotic arm using a ...
- Robot, Know Thyself; Machines Get More Self-Awareon February 4, 2019 at 3:09 pm
In this image made from a Feb. 1, 2019, video, Robert Kwiatkowski, a graduate student at Columbia University, demonstrates a robotic arm picking up a red ball and dropping it in a cup at the ...
- Rise of the Machines and Descent of Man? Scientists Create Quasi-“Self-aware” Roboton February 4, 2019 at 6:47 am
Whatever the state of research into creating self-aware machines, however, are we aware of the implications such developments have for man? “The group of scientists claimed this is the first ...
- Robot that can 'imagine itself' and became self-aware is built by scientistson January 30, 2019 at 11:07 am
A robot able to 'imagine' itself has been created in a step towards the self-aware robots envisioned in the Terminator movies. Skynet and other sci-fi machines are able to learn and decipher ...
via Bing News