ASU researcher creates system to control robots with the brain
A researcher at Arizona State University has discovered how to control multiple robotic drones using the human brain.
A controller wears a skull cap outfitted with 128 electrodes wired to a computer. The device records electrical brain activity. If the controller moves a hand or thinks of something, certain areas light up.
“I can see that activity from outside,” said Panagiotis Artemiadis (pictured above), director of the Human-Oriented Robotics and Control Lab and an assistant professor of mechanical and aerospace engineering in the School for Engineering of Matter, Transport and Energy in the Ira A. Fulton Schools of Engineering. “Our goal is to decode that activity to control variables for the robots.”
If the user is thinking about decreasing cohesion between the drones — spreading them out, in other words — “we know what part of the brain controls that thought,” Artemiadis said.
A wireless system sends the thought to the robots. “We have a motion-capture system that knows where the quads are, and we change their distance, and that’s it,” he said.
Up to four small robots, some of which fly, can be controlled with brain interfaces. Joysticks don’t work, because they can only control one craft at a time.
“You can’t do something collectively” with a joystick, Artemiadis said. “If you want to swarm around an area and guard that area, you cannot do that.”
To make them move, the controller watches on a monitor and thinks and pictures the drones performing various tasks.
Artemiadis has been working on the brain-to-machine interface since he earned his doctorate in 2009, specifically neural interfaces with robot hands and arms.
“During the last two to three decades there has been a lot of research on single brain/machine interface, where you control a single machine,” he said.
A few years ago, he had the idea to go to a lot of machines. It’s part of a trend in robotics and space exploration: Instead of building one giant expensive machine or plane or spacecraft, researchers build a lot of little cheap ones.
“If you lose half of them, it doesn’t really matter,” Artemiadis said.
He already knew what area of the brain controlled what motions. One discovery jumped out at him.
“I was surprised the brain cares about swarms and collective behaviors,” he said.
“What I didn’t know — or hypothesized — is that the brain cares about things we are not doing ourselves,” he added. “We don’t have a swarm we control. We have hands and limbs and all that stuff, but we don’t control swarms.”
In other words, our brains are not used to all of our fingers and toes running off on their own and then returning.
“I was surprised the brain cares about that, and that the brain can adapt,” he said.
He worked with Air Force pilots on this; the two-year project was funded by the Defense Advanced Research Projects Agency of the U.S. Department of Defense and the Air Force. The pilots were skeptical. Their main objection was what would happen if they thought of something else while controlling the drones.
Artemiadis said controllers have to stay focused. If it’s close to lunch and all you can think about it is pizza, it doesn’t work. Fatigue and stress also play a part. Artemiadis said he can tell when subjects are tired or need a break.
“We tell the subject to think of two things,” he said. “Focus on breathing, or we tell them to imagine closing their left hand into a fist.”
Each subject is different. The system has to be calibrated to individual controllers, and it has to be done every day, because brain signals change from day to day.
The next step in Artemiadis’ research is multiple people controlling multiple robots. He plans to move to a much larger experimental space to refine the proof of concept. In the future, he sees drone swarms performing complex operations, such as search-and-rescue missions.
The Latest on: Controlling multiple robot drones with the brain
via Google News
The Latest on: Controlling multiple robot drones with the brain
- The ‘Westworld’ Confusion Index: A Song Of Robot Nazis And Dragonson March 23, 2020 at 8:47 am
When we last checked in with Maeve, the all-powerful robot who started out as the madam of a ... or possibly even previous iterations of this television show, that all takes multiple episodes and ...
- Yes, the Army's New Robot Tanks Might Just Be Around the Corneron March 23, 2020 at 6:52 am
In September 2019, a Titan fired multiple ... controlled M-113. The operators of the M-113 and its machine gun followed behind the drone in an M-577 command vehicle, issuing commands via radio. In one ...
- Westworld season 3 episode 2 recap: Let's talk about that Game of Thrones Easter eggon March 22, 2020 at 7:19 pm
This is the "where your favorite characters are now" episode. If you didn't stick around through the end credits of the first episode of Westworld's third season, then you may have missed the reveal ...
- ‘Westworld’ Season 3, Episode 2 Recap And Review: ‘The Winter Line’on March 22, 2020 at 7:02 pm
Westworld is strikingly different in its third season, in more ways than one. One of these is how quickly we’re dispensing with the illusions this time around, which isn’t a bad thing—though plenty of ...
- A drone ducks, dips and dives to dodge obstacles in a flashon March 20, 2020 at 7:01 am
Drones fitted with a type of motion-detecting camera can dodge obstacles ten times faster than current drones equipped with conventional cameras. Self-flying drones have commercial potential for ...
- Microsoft researchers train AI in simulation to control a real-world droneon March 18, 2020 at 8:47 am
Inspired by the human brain, it maps visual information directly onto correct control actions ... giving the robot a better chance of identifying and retrieving people in need of help. “By separating ...
- Training deep control policies for the real worldon March 17, 2020 at 4:56 pm
Instead, we aimed to create a computational fabric, inspired by the function of a human brain, to map visual information directly to correct control ... the drone was still able to complete the ...
- How AI, drones are helping fight against the novel coronaviruson March 12, 2020 at 8:34 am
They used AI algorithm to analyse multiple sources such ... Thus, these robots are play huge role in containing the coronavirus infections. Such disinfection robots are deployed across major hospitals ...
- Yes Russia Does Have a Fighting Robot (But It Isn't Very Good)on March 11, 2020 at 4:10 pm
Key point: Russia's fancy new drone looks cool. However, it doesn't perform very well. In May 2018, the Russian military revealed it had combat-tested its Uran-9 robot tank in Syria. The diminutive ...
- Psycho-Pass: 5 Futuristic Elements That Are Highly Possible (& 5 That Are Impossible)on March 10, 2020 at 11:48 am
The process, however, can not be done on the brain. The reason that this technological advancement can ... That, and the gun's devastating capabilities have yet to be replicated in real life. Drones ...
via Bing News