Firefighters have only their wits and five senses to rely on inside a burning building. But research developed in part by NASA’s Jet Propulsion Laboratory, Pasadena, California, may change that, introducing artificial intelligence (AI) that could collect data on temperatures, gases and other danger signals and guide a team of first responders safely through the flames.
AUDREY, the Assistant for Understanding Data through Reasoning, Extraction, and sYnthesis, has received the Undersecretary’s Award for Collaboration from the Department of Homeland Security (DHS) in recognition of its joint development by JPL and DHS. It’s part of the Next Generation First Responder (NGFR) program, a DHS initiative to innovate new ways to keep firefighters, police, paramedics and other first responders safe in the field through increased awareness of their surroundings and communication abilities.
But the big picture is even more exciting: AUDREY can track an entire team of firefighters, sending relevant signals to individuals while helping to make recommendations for how they could work together.
“As a firefighter moves through an environment, AUDREY could send alerts through a mobile device or head-mounted display,” said Mark James of JPL, lead scientist for the AUDREY project.
AUDREY is designed to be integrated with the “Internet of Things” — the idea of numerous devices and sensors all wirelessly “talking” to one another. In the case of firefighters, wearable sensors in their clothes could pick up their GPS location, heat in other rooms, the presence of dangerous chemicals and gases, satellite imagery of a location and much more.
“When first responders are connected to all these sensors, the AUDREY agent becomes their guardian angel,” said Edward Chow, manager of JPL’s Civil Program Office and program manager for AUDREY. “Because of all this data the sensor sees, firefighters won’t run into the next room where the floor will collapse.”
John Merrill, NGFR program manager for the DHS Science and Technology Directorate, said that technology is rapidly providing new strengths for first responders in the field.
“The proliferation of miniaturized sensors and Internet of Things devices can make a tremendous impact on first responder safety, connectivity, and situational awareness,” Merrill said. “The massive amount of data available to the first responder is incomprehensible in its raw state and must be synthesized into useable, actionable information.”
Guardian angel in the cloud
AUDREY is designed to keep watch from above. As a cloud-based piece of software, it can do more than send data to those in the field. As it watches an event, it can actually learn and start making predictions about what resources will be needed next.
James said the system is designed to recognize the specific roles of first responders in the field. This allows AUDREY to provide potentially lifesaving information customized to the various roles, which avoids overloading the users.
“Since AUDREY knows the roles of everyone who receives her data, she only supplies the relevant information that is appropriate for them,” James said.
In June, AUDREY was tested in a virtual demonstration at the Public Safety Broadband Stakeholder Meeting held by the Department of Commerce in San Diego. It was fed data from a variety of sensors and asked to make safety recommendations, which it then sent to a mobile device. Within a year, Chow said, the plan is to test AUDREY in field demonstrations.
From machine to human-like thinking
Chow emphasized that artificial intelligence is only as effective as the data it’s working with. The more data it has, the higher the probability that it will make useful recommendations.
“Most A.I. projects are rule-based — if this, then that,” he said. “But what if you’re only getting part of the information? We use complex reasoning to simulate how humans think. That allows us to provide more useful info to firefighters than a traditional A.I. system.”
Learn more: A.I. Could Be a Firefighter’s ‘Guardian Angel’
The Latest on: Next Generation First Responder (NGFR) program
via Google News
The Latest on: Next Generation First Responder (NGFR) program
- DHS S&T Conducts First Responder Exercise in Alabamaon October 28, 2019 at 1:45 pm
The DHS Science and Technology Directorate’s Next Generation First Responder Program took part in the NGFR – Birmingham Shaken Fury Operational Experimentation, an exercise that tested emergency ...
- AI-enabled voice assistance for responderson September 25, 2019 at 1:29 pm
Most recently, the Next Generation First Responder (NGFR) Apex program at the Department of Homeland Security’s Science and Technology Directorate tested the tool, called the Assistant for ...
- U.S.-Canada AI Partnership Aims to Help First Responderson July 6, 2018 at 11:13 am
The initiative is part of S&T’s Next Generation First Responder (NGFR) Apex Program, which includes more than 40 research and development projects aimed to help first responders in the field by ...
- DHS S&T Invests $750,000 in First Responder Technologyon August 15, 2017 at 1:08 pm
and the Next Generation First Responder (NGFR) Apex program, managed by S&T’s First Responder Group. With the goal of providing multilayer threat protection and immediate situational awareness to ...
- DHS S&T Awards Metronome Software $750K To Strengthen Security Of First Responder Sensor Systemson August 14, 2017 at 9:44 am
and the Next Generation First Responder (NGFR) Apex program, managed by S&T’s First Responder Group. “Strengthening the security of first responder sensor networks is needed to protect data flows from ...
- MobileIron to Partner with Metronome Software on DHS S&T Mobile Security Projecton August 14, 2017 at 5:29 am
Other Agencies Technology Solutions award is a joint project of DHS S&T's Mobile Security R&D program, administered by its Homeland Security Advanced Research Projects Agency Cyber Security Division, ...
- NASA Develops Artificial Intelligence to Enhance Firefighter Safetyon August 18, 2016 at 12:58 pm
It’s part of the Next Generation First Responder (NGFR) program, a DHS initiative to innovate new ways to keep firefighters, police, paramedics and other first responders safe in the field through ...
- Help from above: An AI that watches over first responderson August 14, 2016 at 5:00 pm
Created as part of the DHS's Next Generation First Responders (NGFR) program, JPL's artificial intelligence (AI) system was designed to coordinate those kinds of technologies. The Assistant for ...
- Next Generation First Responder Program Works to Better Protect, Connect Responderson August 2, 2016 at 5:00 pm
The Next Generation First Responder (NGFR) Apex program envisions first responders who are better protected, connected and fully aware, enabling faster, more efficient and safer response to threats ...
- First Responders Group: A Year in Reviewon December 21, 2015 at 4:00 pm
Guest post from Dan Cotter, director, Department of Homeland Security Science and Technology Directorate (S&T) First Responders Group (FRG) The First Responders Group’s entire mission is serving the ...
via Bing News