Software developed at the University of Bonn can accurately predict future actions
Computer scientists from the University of Bonn have developed software that can look a few minutes into the future: The program first learns the typical sequence of actions, such as cooking, from video sequences. Based on this knowledge, it can then accurately predict in new situations what the chef will do at which point in time. Researchers will present their findings at the world’s largest Conference on Computer Vision and Pattern Recognition, which will be held June 19-21 in Salt Lake City, USA.
The perfect butler, as every fan of British social drama knows, has a special ability: He senses his employer’s wishes before they have even been uttered. The working group of Prof. Dr. Jürgen Gall wants to teach computers something similar: “We want to predict the timing and duration of activities – minutes or even hours before they happen”, he explains.
A kitchen robot, for example, could then pass the ingredients as soon as they are needed, pre-heat the oven in time – and in the meantime warn the chef if he is about to forget a preparation step. The automatic vacuum cleaner meanwhile knows that it has no business in the kitchen at that time, and instead takes care of the living room.
We humans are very good at anticipating the actions of others. For computers however, this discipline is still in its infancy. The researchers at the Institute of Computer Science at the University of Bonn are now able to announce a first success: They have developed self-learning software that can estimate the timing and duration of future activities with astonishing accuracy for periods of several minutes.
Training data: four hours of salad videos
The training data used by the scientists included 40 videos in which performers prepare different salads. Each of the recordings was around 6 minutes long and contained an average of 20 different actions. The videos also contained precise details of what time the action started and how long it took.
The computer “watched” these salad videos totaling around four hours. This way, the algorithm learned which actions typically follow each other during this task and how long they last. This is by no means trivial: After all, every chef has his own approach. Additionally, the sequence may vary depending on the recipe.
“Then we tested how successful the learning process was”, explains Gall. “For this we confronted the software with videos that it had not seen before.” At least the new short films fit into the context: They also showed the preparation of a salad. For the test, the computer was told what is shown in the first 20 or 30 percent of one of the new videos. On this basis it then had to predict what would happen during the rest of the film.
That worked amazingly well. Gall: “Accuracy was over 40 percent for short forecast periods, but then dropped the more the algorithm had to look into the future.” For activities that were more than three minutes in the future, the computer was still right in 15 percent of cases. However, the prognosis was only considered correct if both the activity and its timing were correctly predicted.
Gall and his colleagues want the study to be understood only as a first step into the new field of activity prediction. Especially since the algorithm performs noticeably worse if it has to recognize on its own what happens in the first part of the video, instead of being told. Because this analysis is never 100 percent correct – Gall speaks of “noisy” data. “Our process does work with it”, he says. “But unfortunately nowhere near as well.”
Receive an email update when we add a new ACTIVITY PREDICTION article.
The Latest on: Activity prediction
via Google News
The Latest on: Activity prediction
- USD/CAD Daily Price Forecast – US Greenback Losses Ground To Canadian Loonie Over Subdued Demand and Profit Booking Activities on November 13, 2018 at 10:32 am
The USD/CAD pair traded with a mild negative bias on Tuesday and eroded a part of the previous session’s up-move to 3-1/2 month tops. The pair stalled its recent positive momentum near mid-1 ... […]
- Exclusive: Mars Season 2 Writers Got "Lucky" With Scientific Predictions on November 13, 2018 at 9:56 am
The writers behind National Geographic's Mars got lucky with some of their scientific predictions. Considering the rapid ... be tectonic plate movement on Mars or some kind of volcanic activity on Mar... […]
- GIS Market in North America 2019-2023 - Importance of GIS in Capacity and Urban Planning Activities to Boost Demand - Technavio on November 13, 2018 at 9:03 am
LONDON--(BUSINESS WIRE)--Nov 13, 2018--analysts forecast the GIS Market in North America to grow ... in North America is the importance of GIS in capacity and urban planning activities: GIS Market in ... […]
- Worldwide M&A Activity Set to Push Higher over the Next Six Months, but Imbalances Remain on November 13, 2018 at 6:00 am
The prediction appears in the latest Intralinks Deal Flow Predictor, an indicator of future M&A announcements with a proven track record for accuracy. However, while the short-term outlook for M&A act... […]
- Forcepoint Reveals Cybersecurity Predictions for 2019: Trusted Interactions Critical to Fueling Innovation and Growth for Enterprises and Governments on November 13, 2018 at 5:46 am
to understand the reasons behind their activity," Marty continued. "Understanding how a user acts on the network and within applications can identify behavioral anomalies that help inform risk-adaptiv... […]
- Indian Poultry Market Report 2018-2023: Industry Trends, Share, Size, Growth, Opportunity and Forecast - ResearchAndMarkets.com on November 13, 2018 at 2:30 am
The "Indian Poultry Market: Industry Trends, Share, Size, Growth, Opportunity and Forecast 2018-2023" report has been added ... during the last two decades transforming from a mere backyard activity i... […]
- Tuesday’s First Warning Forecast: Rain today then a big cool down on November 13, 2018 at 2:27 am
Highs in the upper 40s. Winds: N 10-20G25 Shower and thunderstorm activity associated with a tropical wave that is moving through the Leeward Islands has continued to become less organized. […]
- (VIDEOS) Kreskin right on election prediction: Democrats win House on November 12, 2018 at 7:09 pm
But Kreskin's prediction was close enough that he was able to tear up ... More people were involved in the Nov. 7 followup and the normal activities of a business kept interrupting, with phones ringin... […]
- Global Market Study on Shiplifts and Transfer Systems: Increasing Seaborne Trade Activities to Drive Growth on November 12, 2018 at 2:34 pm
Growing seaborne trade activities and maritime tourism are some of the factors ... industry factors, product life stage, forecast factors, value chain overview covering approximate margins, porter's a... […]
via Bing News