Method for designing efficient computer chips may get miniature smart drones off the ground.
In recent years, engineers have worked to shrink drone technology, building flying prototypes that are the size of a bumblebee and loaded with even tinier sensors and cameras. Thus far, they have managed to miniaturize almost every part of a drone, except for the brains of the entire operation — the computer chip.
Standard computer chips for quadcoptors and other similarly sized drones process an enormous amount of streaming data from cameras and sensors, and interpret that data on the fly to autonomously direct a drone’s pitch, speed, and trajectory. To do so, these computers use between 10 and 30 watts of power, supplied by batteries that would weigh down a much smaller, bee-sized drone.
Now, engineers at MIT have taken a first step in designing a computer chip that uses a fraction of the power of larger drone computers and is tailored for a drone as small as a bottlecap. They will present a new methodology and design, which they call “Navion,” at the Robotics: Science and Systems conference, held this week at MIT.
The team, led by Sertac Karaman, the Class of 1948 Career Development Associate Professor of Aeronautics and Astronautics at MIT, and Vivienne Sze, an associate professor in MIT’s Department of Electrical Engineering and Computer Science, developed a low-power algorithm, in tandem with pared-down hardware, to create a specialized computer chip.
The key contribution of their work is a new approach for designing the chip hardware and the algorithms that run on the chip. “Traditionally, an algorithm is designed, and you throw it over to a hardware person to figure out how to map the algorithm to hardware,” Sze says. “But we found by designing the hardware and algorithms together, we can achieve more substantial power savings.”
“We are finding that this new approach to programming robots, which involves thinking about hardware and algorithms jointly, is key to scaling them down,” Karaman says.
The new chip processes streaming images at 20 frames per second and automatically carries out commands to adjust a drone’s orientation in space. The streamlined chip performs all these computations while using just below 2 watts of power — making it an order of magnitude more efficient than current drone-embedded chips.
Karaman, says the team’s design is the first step toward engineering “the smallest intelligent drone that can fly on its own.” He ultimately envisions disaster-response and search-and-rescue missions in which insect-sized drones flit in and out of tight spaces to examine a collapsed structure or look for trapped individuals. Karaman also foresees novel uses in consumer electronics.
“Imagine buying a bottlecap-sized drone that can integrate with your phone, and you can take it out and fit it in your palm,” he says. “If you lift your hand up a little, it would sense that, and start to fly around and film you. Then you open your hand again and it would land on your palm, and you could upload that video to your phone and share it with others.”
Karaman and Sze’s co-authors are graduate students Zhengdong Zhang and Amr Suleiman, and research scientist Luca Carlone.
From the ground up
Current minidrone prototypes are small enough to fit on a person’s fingertip and are extremely light, requiring only 1 watt of power to lift off from the ground. Their accompanying cameras and sensors use up an additional half a watt to operate.
“The missing piece is the computers — we can’t fit them in terms of size and power,” Karaman says. “We need to miniaturize the computers and make them low power.”
The group quickly realized that conventional chip design techniques would likely not produce a chip that was small enough and provided the required processing power to intelligently fly a small autonomous drone.
“As transistors have gotten smaller, there have been improvements in efficiency and speed, but that’s slowing down, and now we have to come up with specialized hardware to get improvements in efficiency,” Sze says.
The researchers decided to build a specialized chip from the ground up, developing algorithms to process data, and hardware to carry out that data-processing, in tandem.
Tweaking a formula
Specifically, the researchers made slight changes to an existing algorithm commonly used to determine a drone’s “ego-motion,” or awareness of its position in space. They then implemented various versions of the algorithm on a field-programmable gate array (FPGA), a very simple programmable chip. To formalize this process, they developed a method called iterative splitting co-design that could strike the right balance of achieving accuracy while reducing the power consumption and the number of gates.
A typical FPGA consists of hundreds of thousands of disconnected gates, which researchers can connect in desired patterns to create specialized computing elements. Reducing the number gates with co-design allowed the team to chose an FPGA chip with fewer gates, leading to substantial power savings.
“If we don’t need a certain logic or memory process, we don’t use them, and that saves a lot of power,” Karaman explains.
Each time the researchers tweaked the ego-motion algorithm, they mapped the version onto the FPGA’s gates and connected the chip to a circuit board. They then fed the chip data from a standard drone dataset — an accumulation of streaming images and accelerometer measurements from previous drone-flying experiments that had been carried out by others and made available to the robotics community.
“These experiments are also done in a motion-capture room, so you know exactly where the drone is, and we use all this information after the fact,” Karaman says.
For each version of the algorithm that was implemented on the FPGA chip, the researchers observed the amount of power that the chip consumed as it processed the incoming data and estimated its resulting position in space.
The team’s most efficient design processed images at 20 frames per second and accurately estimated the drone’s orientation in space, while consuming less than 2 watts of power.
The power savings came partly from modifications to the amount of memory stored in the chip. Sze and her colleagues found that they were able to shrink the amount of data that the algorithm needed to process, while still achieving the same outcome. As a result, the chip itself was able to store less data and consume less power.
“Memory is really expensive in terms of power,” Sze says. “Since we do on-the-fly computing, as soon as we receive any data on the chip, we try to do as much processing as possible so we can throw it out right away, which enables us to keep a very small amount of memory on the chip without accessing off-chip memory, which is much more expensive.”
In this way, the team was able to reduce the chip’s memory storage to 2 megabytes without using off-chip memory, compared to a typical embedded computer chip for drones, which uses off-chip memory on the order of a few gigabytes.
“Any which way you can reduce the power so you can reduce battery size or extend battery life, the better,” Sze says.
This summer, the team will mount the FPGA chip onto a drone to test its performance in flight. Ultimately, the team plans to implement the optimized algorithm on an application-specific integrated circuit, or ASIC, a more specialized hardware platform that allows engineers to design specific types of gates, directly onto the chip.
“We think we can get this down to just a few hundred milliwatts,” Karaman says. “With this platform, we can do all kinds of optimizations, which allows tremendous power savings.”
Learn more: Miniaturizing the brain of a drone
The Latest on: smallest drone
- Small Eruption at Indonesia’s Agung After Weeks of Unrest on November 21, 2017 at 5:37 am
Drone footage (below) taken not long after this explosive eruption ... continues to maintain a 7.5-km exclusion radius around the volcano and this eruption was clearly small enough that no one is in immediate danger. The PVMBG hasn’t raised the alert ... […]
- Meet the World’s Smallest, Most Versatile Drone on November 21, 2017 at 4:26 am
It’s no longer just science fiction fantasy: Drones have become affordable and easily-accessible ways to capture stunning video, take a pass at your neighbor’s obnoxious grill party, or just have some good aeronautic fun. There’s just the unfortunate ... […]
- AT&T Flying COW drones will help bring cell service back to Puerto Rico on November 21, 2017 at 4:07 am
They're tethered to the ground, which provides fiber data and power. Since the drones exceed 55 lbs., the weight limit in the FAA's small drone rule, they required special authorization to be used in Puerto Rico. The decision comes two months after ... […]
- AT&T gets FAA’s approval of using drones to restore Puerto Rico’s cellular service on November 21, 2017 at 2:14 am
The FAA exemption was needed because the drone exceeds the 55-pound weight limit required to operate under the government’s small drone rule. AT&T will use the drone as a temporary cell service solution while it rebuilds permanent infrastructure on the ... […]
- FAA Approves Drone To Restore Puerto Rico Cell Service on November 20, 2017 at 10:43 pm
Because the aircraft exceeded the 55-lb. weight limit required to operate under the FAA’s small drone rule, the FAA had to issue a special exemption and an emergency certificate of authorization for AT&T to conduct its mission. The company is using the ... […]
- ‘Cell tower in the sky’: FAA-approved Flying Cow drones to restore network to Puerto Rico on November 20, 2017 at 6:08 pm
The drones will carry a small cell, along with antennas, that are connected to the ground by a tether. This specific setup will allow power and fiber data connections to be brought to customers on the island. Further, the power being transmitted from the ... […]
- Global Small Drone Sales Market Report 2017; New Report Launched on November 20, 2017 at 10:02 am
Bangalore, India -- (SBWIRE) -- 11/20/2017 -- Global Small Drone Sales Market 2017 report split global into several key Regions, with sales (K Units), revenue (Million USD), market share and growth rate of Small Drone for these regions, from 2012 to 2022 ... […]
- Holiday gift ideas: Timeless toys that play well for the big and small kids in your house on November 20, 2017 at 3:15 am
A 12-month subscription costs $59 a month. Where can I get it: www.thimble.io. What is it: A small, light, easily maneuverable drone with an on-board camera. You can fly the drone while wearing included VR goggles. You'll need to provide your own ... […]
- FAA approves Flying Cow drones to restore Puerto Rico cell network on November 20, 2017 at 1:33 am
The telecommunications giant says the drone carries a small cell and antennas and is connected to the ground by a tether which provides power and a fiber data connection. As the drone is powered via the ground it is able to remain in the sky indefinitely. […]
- Drones will reshape how we build our cities on November 19, 2017 at 2:40 pm
And the waste of millions of journeys delivering single small packages seems shockingly inefficient and unsustainable. Last year Amazon trialled its drone delivery service in Cambridge and Dubai is experimenting with passenger drones. Even though obstacles ... […]
via Google News and Bing News