ASU researcher creates system to control robots with the brain
A researcher at Arizona State University has discovered how to control multiple robotic drones using the human brain.
A controller wears a skull cap outfitted with 128 electrodes wired to a computer. The device records electrical brain activity. If the controller moves a hand or thinks of something, certain areas light up.
“I can see that activity from outside,” said Panagiotis Artemiadis (pictured above), director of the Human-Oriented Robotics and Control Lab and an assistant professor of mechanical and aerospace engineering in the School for Engineering of Matter, Transport and Energy in the Ira A. Fulton Schools of Engineering. “Our goal is to decode that activity to control variables for the robots.”
If the user is thinking about decreasing cohesion between the drones — spreading them out, in other words — “we know what part of the brain controls that thought,” Artemiadis said.
A wireless system sends the thought to the robots. “We have a motion-capture system that knows where the quads are, and we change their distance, and that’s it,” he said.
Up to four small robots, some of which fly, can be controlled with brain interfaces. Joysticks don’t work, because they can only control one craft at a time.
“You can’t do something collectively” with a joystick, Artemiadis said. “If you want to swarm around an area and guard that area, you cannot do that.”
To make them move, the controller watches on a monitor and thinks and pictures the drones performing various tasks.
Artemiadis has been working on the brain-to-machine interface since he earned his doctorate in 2009, specifically neural interfaces with robot hands and arms.
“During the last two to three decades there has been a lot of research on single brain/machine interface, where you control a single machine,” he said.
A few years ago, he had the idea to go to a lot of machines. It’s part of a trend in robotics and space exploration: Instead of building one giant expensive machine or plane or spacecraft, researchers build a lot of little cheap ones.
“If you lose half of them, it doesn’t really matter,” Artemiadis said.
He already knew what area of the brain controlled what motions. One discovery jumped out at him.
“I was surprised the brain cares about swarms and collective behaviors,” he said.
“What I didn’t know — or hypothesized — is that the brain cares about things we are not doing ourselves,” he added. “We don’t have a swarm we control. We have hands and limbs and all that stuff, but we don’t control swarms.”
In other words, our brains are not used to all of our fingers and toes running off on their own and then returning.
“I was surprised the brain cares about that, and that the brain can adapt,” he said.
He worked with Air Force pilots on this; the two-year project was funded by the Defense Advanced Research Projects Agency of the U.S. Department of Defense and the Air Force. The pilots were skeptical. Their main objection was what would happen if they thought of something else while controlling the drones.
Artemiadis said controllers have to stay focused. If it’s close to lunch and all you can think about it is pizza, it doesn’t work. Fatigue and stress also play a part. Artemiadis said he can tell when subjects are tired or need a break.
“We tell the subject to think of two things,” he said. “Focus on breathing, or we tell them to imagine closing their left hand into a fist.”
Each subject is different. The system has to be calibrated to individual controllers, and it has to be done every day, because brain signals change from day to day.
The next step in Artemiadis’ research is multiple people controlling multiple robots. He plans to move to a much larger experimental space to refine the proof of concept. In the future, he sees drone swarms performing complex operations, such as search-and-rescue missions.
The Latest on: Controlling multiple robot drones with the brain
via Google News
The Latest on: Controlling multiple robot drones with the brain
- DJI's first educational robot, Robomaster S1 now available in UAEon November 19, 2019 at 7:09 am
DUBAI, UAE: – DJI, the global leader in civilian drones and aerial ... signal even while performing multiple tasks. Along with its custom brushless motor, the S1 has four Mecanum wheels, most commonly ...
- Awesome Tech You Can’t Buy Yet: Ultrafast chargers and backyard biodigesterson November 17, 2019 at 2:00 am
This is achieved by using embedded sensors capable of capturing this brain activity and proprietary software ... features and functionality as any other aquatic drone, including 1080P video capability ...
- The Army Is Bringing Artificial Intelligence To Its Armored Vehicleson November 10, 2019 at 6:03 am
(Washington, D.C.) Streamlining multiple targeting sensors to destroy long-range targets, arming forward- positioned robots to penetrate enemy defenses and receiving organized weather-specific terrain ...
- The U.S. military, algorithmic warfare, and big techon November 8, 2019 at 9:12 am
We learned this week that the Department of Defense is using facial recognition at scale, and Secretary of Defense Mark Esper said he believes China is selling lethal autonomous drones. Amid all that ...
- Brain Controlled Tracked Roboton November 5, 2019 at 4:00 pm
[Imetomi] found himself salvaging a camera from a broken drone when he decided to use it in a ... [Imetomi] also used a hacked Nacomimi Brainwave Toy to make a brain controlled version of his robot.
- Drones controlled with brain-computer interfaceon October 2, 2017 at 4:09 am
But using multiple ... individually controlled UAVs cannot. Here are a few of the drone applications that are now within reach: Search and Rescue Missions Humans will collaborate with swarms of robots ...
- How to Control a Swarm of Drones with Your Mindon August 6, 2016 at 12:38 am
Ever dream of commanding a legion of robots to help you take ... researchers are able to control multiple drones using human thought and vision to guide the quadcopters wirelessly. The device records ...
- Brain power multiplied for drone swarm controlon July 18, 2016 at 5:00 pm
Past research has found ways to steer a drone just through the power of the mind ... and even move onto a system where multiple people control multiple robots. The team demonstrates the project in the ...
- This scientist can control a swarm of drones with his thoughtson July 15, 2016 at 10:46 am
What’s the only thing that could make a regular drone ... specific brain areas can be activated when the human observes collective behaviors of swarms. The fact that the brain can adapt to output ...
- ASU researcher controls multiple drones with his mindon July 13, 2016 at 11:14 pm
That’s why he’s developing a system to control multiple robots with the human ... it triggers certain areas of their brain. That activity is measured by electrodes on a skull cap, decoded, and sent ...
via Bing News