Cornell University researchers are developing a system to enable teams of robots to share information as they move around, and if necessary, interpret what they see. This would allow the robots to conduct surveillance as a single entity with many eyes. Beyond surveillance, the new technology could enable teams of robots to relieve humans of dangerous jobs such as disposing of landmines, cleaning up after a nuclear meltdown or surveying the damage after a flood or hurricane.
“Once you have robots that cooperate, you can do all sorts of things,” said Kilian Weinberger, associate professor of computer science, who is collaborating on the project with Silvia Ferrari, professor of mechanical and aerospace engineering, and Mark Campbell, professor of mechanical engineering.
Their work, “Convolutional-Features Analysis and Control for Mobile Visual Scene Perception,” is supported by a four-year, $1.7 million grant from the U.S. Office of Naval Research.
The researchers will call on their extensive experience with computer vision to match and combine images of the same area from several cameras, identify objects and track objects and people from place to place. The work will require groundbreaking research because most prior work in the field has focused on analyzing images from just a single camera as it moves around. The new system will fuse information from fixed cameras, mobile observers and outside sources.
The mobile observers might include autonomous aircraft and ground vehicles and perhaps humanoid robots wandering through a crowd. They will send their images to a central control unit, which might also have access to other cameras looking at the region of interest, as well as access to the internet for help in labeling what it sees. What make of car is that? How do you open this container? Identify this person.
Knowing the context of a scene, robot observers may detect suspicious actors and activities that might otherwise go unnoticed. A person running may be a common occurrence on a college campus but may require further scrutiny in a secured area.
Researchers plan early tests on the Cornell campus, using research robots to “surveil” crowded areas while drawing on an overview from existing webcams. This work might lead to incorporating the new technology into campus security.
The Latest on: Robotic swarms
via Google News
The Latest on: Robotic swarms
- Astronomers think this black hole collision may have exploded with lighton June 25, 2020 at 7:00 am
Enlarge / Artist's concept of a supermassive black hole and its surrounding accretion disk of gas. Embedded within this disk are two smaller black holes, orbiting one another, that eventually collided ...
- Want to Win the Next War Against Russia, China or North Korea. Let AI Run the Show.on June 24, 2020 at 11:43 am
What if artillery rounds, mini-drone swarms of explosives, rockets and even air-fired missiles are all approaching forward-positioned Army troops at the same time? Imagine that these incoming weapons ...
- AI-Powered Agricultural Robots: A Revolution in Affordable Ultra-Precision, Says IDTechExon June 22, 2020 at 9:51 am
The developments in agricultural robotics, machine vision, and AI will drive a deep and far-reaching transformation of the way farming ...
- ‘Doom Patrol’ Season 2 Review: Tragedy Plus Time Travel in Another Weird, Wonderful Seasonon June 20, 2020 at 9:17 am
Doom Patrol season 2 is still as weird as ever—shoutout to the Terrible Doctor Tyme and his disco parties—but also leans harder into the tragedy of it all.
- Let the robot swarms begin!on June 19, 2020 at 5:47 am
The chemical compound, azobenzene derivative, is able to sense light, acting as the molecular robot's on/off switch. Scientists have made huge moving "swarms' of these molecular robots by ...
- Let the robot swarms begin!on June 19, 2020 at 5:34 am
Scientists are looking for ways to make millions of molecule-sized robots swarm together so they can perform multiple tasks simultaneously. Tsukuba, Japan, - ...
- Scientists working to make molecule-sized robots swarm together to perform taskson June 18, 2020 at 2:36 pm
Multi-disciplinary research has led to the innovative fabrication of molecule-sized robots. Scientists are now advancing their efforts to make these robots interact and work together in the millions, ...
- Qualcomm Introduces 5G and AI-Enabled Robotics Platformon June 18, 2020 at 12:12 pm
Qualcomm on Wednesday announced its Robotics RB5 platform, with 5G and 4G connectivity, on-device AI and machine learning, superior computing and intelligent sensing capabilities. The platform's ...
- Molecular robot swarmson June 18, 2020 at 3:55 am
Scientists are looking for ways to make millions of molecule-sized robots swarm together so they can perform multiple tasks simultaneously.
via Bing News