Computer scientists at The University of Texas at Austin have taught an artificial intelligence agent how to do something that usually only humans can do—take a few quick glimpses around and infer its whole environment, a skill necessary for the development of effective search-and-rescue robots that one day can improve the effectiveness of dangerous missions.
The team, led by professor Kristen Grauman, Ph.D. candidate Santhosh Ramakrishnan and former Ph.D. candidate Dinesh Jayaraman (now at the University of California, Berkeley) published their results today in the journal Science Robotics.
Most AI agents—computer systems that could endow robots or other machines with intelligence—are trained for very specific tasks—such as to recognize an object or estimate its volume—in an environment they have experienced before, like a factory. But the agent developed by Grauman and Ramakrishnan is general purpose, gathering visual information that can then be used for a wide range of tasks.
“We want an agent that’s generally equipped to enter environments and be ready for new perception tasks as they arise,” Grauman said. “It behaves in a way that’s versatile and able to succeed at different tasks because it has learned useful patterns about the visual world.”
The scientists used deep learning, a type of machine learning inspired by the brain’s neural networks, to train their agent on thousands of 360-degree images of different environments.
Now, when presented with a scene it has never seen before, the agent uses its experience to choose a few glimpses—like a tourist standing in the middle of a cathedral taking a few snapshots in different directions—that together add up to less than 20 percent of the full scene. What makes this system so effective is that it’s not just taking pictures in random directions but, after each glimpse, choosing the next shot that it predicts will add the most new information about the whole scene. This is much like if you were in a grocery store you had never visited before, and you saw apples, you would expect to find oranges nearby, but to locate the milk, you might glance the other way. Based on glimpses, the agent infers what it would have seen if it had looked in all the other directions, reconstructing a full 360-degree image of its surroundings.
“Just as you bring in prior information about the regularities that exist in previously experienced environments—like all the grocery stores you have ever been to—this agent searches in a nonexhaustive way,” Grauman said. “It learns to make intelligent guesses about where to gather visual information to succeed in perception tasks.”
One of the main challenges the scientists set for themselves was to design an agent that can work under tight time constraints. This would be critical in a search-and-rescue application. For example, in a burning building a robot would be called upon to quickly locate people, flames and hazardous materials and relay that information to firefighters.
For now, the new agent operates like a person standing in one spot, with the ability to point a camera in any direction but not able to move to a new position. Or, equivalently, the agent could gaze upon an object it is holding and decide how to turn the object to inspect another side of it. Next, the researchers are developing the system further to work in a fully mobile robot.
Using the supercomputers at UT Austin’s Texas Advanced Computing Center and Department of Computer Science, it took about a day to train their agent using an artificial intelligence approach called reinforcement learning. The team, with Ramakrishnan’s leadership, developed a method for speeding up the training: building a second agent, called a sidekick, to assist the primary agent.
“Using extra information that’s present purely during training helps the [primary] agent learn faster,” Ramakrishnan said.
Learn more: New AI Sees Like a Human, Filling in the Blanks
The Latest on: Artificial intelligence agent
via Google News
The Latest on: Artificial intelligence agent
- AnsweriQ Unveils New Single-Click Automation for Customer Service Teamson June 25, 2019 at 3:56 pm
AnsweriQ’s Robo Assist Enables Freshly to Reduce Customer Service Response Times by 90% Utilizing Artificial Intelligence (AI ... single-click automation for agents – a new offering that ... […]
- Talkdesk Launches Talkdesk Boost to Accelerate Digital Transformationon June 25, 2019 at 6:39 am
mobile agent support, digital channels, Customer Relationship Management (CRM) software integration and artificial intelligence (AI). Despite the limitations and frustrations of these older, ... […]
- Social and juristic challenges of artificial intelligenceon June 25, 2019 at 6:36 am
as artificial intelligence itself may learn how best to respond. Indeed, a recent review by Peysakhovich and Lerer (2018) points out that, because of their ubiquity in economic and social interactions ... […]
- Global Artificial Intelligence and Machine Learning Market Analysis Outlook (2014-2025) - QY Researchon June 24, 2019 at 12:45 pm
Los Angeles, CA -- (SBWIRE) -- 06/24/2019 -- Artificial intelligence (AI) is the study of "intelligent agents": any device that perceives its environment and takes actions that maximize its chance of ... […]
- Artificial Intelligence Technology Solutions Launches New Security Device Solution ROSAon June 24, 2019 at 6:00 am
RENO, NV, June 24, 2019 (GLOBE NEWSWIRE) -- via NEWMEDIAWIRE – Artificial Intelligence Technology ... an acronym for Responsive Observation Security Agent, as an addition to its existing lineup ... […]
- UrbanZoom to provide agents access to real time data with $1m investmenton June 23, 2019 at 5:24 am
a homegrown start-up that applies big data and artificial intelligence (AI) to the real estate sector, allowing all agents and customers of ERA Realty Network to benefit from AI-driven predictive ... […]
- 7 Types Of Artificial Intelligenceon June 19, 2019 at 8:03 pm
Artificial General Intelligence is the ability of an AI agent to learn, perceive, understand, and function completely like a human being. These systems will be able to independently build multiple ... […]
- Allianz Italy Invests in Innovating Its Digital Ecosystem and Provides Agents With Virtual Advisor Developed by iGeniuson June 19, 2019 at 8:17 am
Part of the digital ecosystem developed for the Agents' network, the new virtual advisor is powered by iGenius' technology. Thanks to natural language interactions and artificial intelligence ... […]
- As artificial intelligence and fintech come knocking, half of Asia-Pacific finance professionals fear for their jobson June 19, 2019 at 3:28 am
Half of finance professionals in Asia-Pacific believe their jobs will either disappear or change substantially over the next decade, with some of their work taken over by artificial intelligence ... ... […]
- BluIP Announces Launch of First Customer Utilizing Artificial Intelligence Virtual Agent, RLH Corp.on June 18, 2019 at 12:02 pm
Las Vegas, NV, and Minneapolis, MN - June 18, 2019 – BluIP, Inc., a leading technology solutions provider to the hospitality industry, today announced that RLH Corporation has signed on with BluIP to ... […]
via Bing News