Your torso is more intuitive – and more precise – than joysticks for piloting drones, both simulated and real, according to a recent study by EPFL scientists. Work is already underway to implement this new body-machine-interface technology for search and rescue with drones.
Imagine piloting a drone using the movements of your torso only and leaving your head free to look around, much like a bird. EPFL research has just shown that using your torso to pilot flying machines is indeed more immersive – and more effective – than using the long-established joystick. The results are published in today’s issue of PNAS.
“Our aim was to design a control method which would be easy to learn and therefore require less mental focus from the users so that they can focus on more important issues, like search and rescue,” says lead author Jenifer Miehlbradt of EPFL’s Translational Neuroengineering Laboratory led by Bertarelli Foundation Chair Silvestro Micera. “Using your torso really gives you the feeling that you are actually flying. Joysticks, on the other hand, are of simple design but mastering their use to precisely control distant objects can be challenging.”
The scientists wanted to observe how people use their bodies to pilot a flying object, in this case a drone, and determine which movements are most intuitive and natural – approaching the pilot problem from a completely new perspective.
They started by monitoring the body movements of 17 individuals thanks to 19 infrared markers placed all over the upper body as well as their muscular activity. Each participant followed the actions of a virtual drone through simulated landscapes that passed-by as viewed through virtual reality goggles.
Motion patterns emerged and the scientists quickly established torso-related strategies for piloting drones: they found that only 4 markers – located on the torso – were needed to pilot flight simulators and real drones through a circuit of obstacles effectively.
Overall, the scientists compared their torso strategies to joystick control in 39 individuals. They found that torso drone control outperformed joystick control in precision, reliability and with minimal training sessions.
“Data analysis allowed us to develop a very simple and intuitive approach which could also be used with other populations, machines, and operations,” says Micera, also at the Scuola Superiore Sant’Anna in Italy in Biomedical Engineering. He adds, “The approach significantly improves the teleoperation of robots with non-human mechanical attributes.”
While the PNAS results provide a truly new and completely immersive piloting strategy with a focus on characterizing the relevant torso parameters, leaving the head, limbs, hands and feet free to perform other actions, their proof-of-concept system still requires body markers and external motion detectors in order to work.
The next steps are to make the torso strategy completely wearable for piloting flying objects. The application range is huge, from flight simulators to piloting drones and even perhaps planes of the future. A garment that implements the torso strategy into drone control without external motion detectors was developed at EPFL’s Laboratory of Intelligent Systems led by co-author Dario Floreano based on the PNAS findings.
A jacket for flying like a bird
The Fly Jacket, a first implementation of the torso strategy for piloting flying objects.
Drone pilots can now achieve an unprecedented level of immersion thanks to Fly Jacket developed by Carine Rognon, a researcher at EPFL’s Laboratory of Intelligent Systems led by Dario Floreano. The Fly Jacket appeared in the July 2018 issue of IEEE Robotics and Automation Letters.
Rognon came up with a very lightweight garment that translates the torso strategy described in the PNAS article into drone control commands without external motion detectors. It allows pilots to control their drone intuitively with their body movements – such as leaning forward and backward and pivoting their upper body – rather than with a hand-held device.
Thanks to an embedded motion sensor developed by EPFL Laboratory of Embedded systems led by David Atienza, the fly jacket makes the drone control extremely responsive. Furthermore, the fly jacket has an arm support system that prevents fatigue. This, together with the use of first-person view (FPV) goggles connected to an on-board camera, allows pilots to navigate the skies naturally while keeping their arms spread out as wings.
“The Fly Jacket not only produces an immersive and intuitive flight control experience, but also frees the human hands for other tasks. For example, we have shown that humans could wear data gloves to give additional commands to the drone, like for take-off and landing, or to indicate points of interest seen from the drone perspective that would immediately appear on a map. This could be very useful for fire fighters or rescuers to quickly and precisely identify locations where help is needed,” says Floreano.
Learn more: Forget joysticks, use your torso to pilot drones
Receive an email update when we add a new DRONES article.
The Latest on: Torso drone control
via Google News
The Latest on: Torso drone control
- Doctors share gun stories, demand action after NRA tells them to ‘stay in their lane’ on November 12, 2018 at 2:12 am
The article, titled “Surprise: Physician Group Rehashes Same Tired Gun Control Policies,” was promoted ... Man who flew gun-firing drone faces unrelated assault trial “Oh, was I supposed ... […]
- Oman mulls drones for logistics and transport on November 10, 2018 at 9:14 pm
There is a need for regulations to ensure drones are used in a manner that ... We are not responsible for, and do not control, such external websites, entities, applications or media publishers. The b... […]
- Star Trek: 20 Wildest Things Seven Of Nine Did Before Voyager on November 10, 2018 at 6:34 pm
In addition, they even discovered a Borg drone and brought it on broad their ship-- a ... to see just how acute her senses where while The Doctor had temporarily control over her body. She also has th... […]
- Review: The DJI Mavic 2 Pro is the Best Drone Ever Made on November 8, 2018 at 7:45 am
Put yourself behind the control sticks ... advances that make this drone magnificent. I will try and keep this short and sweet: the Mavic 2 Pro, aside from continually getting better at obstacle avoid... […]
- Tiny RoboFly launches when powered by a laser on November 7, 2018 at 6:03 pm
Its rectangular body, protruding with functional ... With directional control the swarms could move like locusts, a mess of miniature wings and metal. If they could fit into pockets, little drones cou... […]
- Vizag-based Saif Automation’s water drone will help prevent people from drowning on November 7, 2018 at 5:43 pm
With the handheld remote, they can control and manoeuvre the drone until it reaches and picks ... The startup is looking at beach authorities, water body authorities, municipalities and dam ... […]
- Aussie teenager Rudi Browning becomes world’s first FAI Drone Racing champion on November 6, 2018 at 6:11 pm
In a statement released by the sport’s governing body earlier this week ... video goggles synched with the streaming camera on-board their drone craft. They then use a remote control to fly and manoeu... […]
- With This Patch, You Can Control a Drone with a Flick of Your Wrist on November 6, 2018 at 1:34 pm
NextFlex is letting you use your body. Just slap on a patch and you're ready to go ... From there it can detect electric currents so the operator can control a drone through movement, without the need ... […]
- Infineon at electronica 2018: Electromobility is being made fit for long distances, drones are coming of age, and robots are becoming agile on November 5, 2018 at 4:07 am
Infineon is presenting a new approach: AURIX™ microcontrollers as flight controllers and CoolGaN solutions for engine control ... drones. Infineon introduces visitors to its booth to ROBOY. The humano... […]
via Bing News