Researchers from the School of Interactive Computing and the Institute for Robotics and Intelligent Machines developed a new method that teaches computers to “see” and understand what humans do in a typical day.
The technique gathered more than 40,000 pictures taken every 30 to 60 seconds, over a 6 month period, by a wearable camera and predicted with 83 percent accuracy what activity that person was doing. Researchers taught the computer to categorize images across 19 activity classes. The test subject wearing the camera could review and annotate the photos at the end of each day (deleting any necessary for privacy) to ensure that they were correctly categorized.
“It was surprising how the method’s ability to correctly classify images could be generalized to another person after just two more days of annotation,” said Steven Hickson, a Ph.D. candidate in Computer Science and a lead researcher on the project.
“This work is about developing a better way to understand people’s activities, and build systems that can recognize people’s activities at a finely-grained level of detail,” said Edison Thomaz, co-author and graduate research assistant in the School of Interactive Computing. “Activity tracking devices like the Fitbit can tell how many steps you take per day, but imagine being able to track all of your activities – not just physical activities like walking and running. This work is moving toward full activity intelligence. At a technical level, we are showing that it’s becoming possible for computer vision techniques alone to be used for this.”
The group believes they have gathered the largest annotated dataset of first-person images to demonstrate that deep-learning can understand human behavior and the habits of a specific person.
Student Daniel Casto, a Ph.D. candidate in Computer Science and a lead researcher on the project, helped present the method earlier this month at UBICOMP 2015 in Osaka, Japan. He says reaction from conference-goers was positive.
“People liked that we had a method that combines time and images,” Castro says. “Time (of activity) can be especially important for some activity classes. This system learned how relevant images were because of people’s schedules. What does it think the image is showing? It sees both time and image probabilities and makes a better prediction.”
The ability to literally see and recognize human activities has implications in a number of areas – from developing improved personal assistant applications like Siri to helping researchers explain links between health and behavior, Thomaz says.
Castro and Hickson believe that someday within the next decade we will have ubiquitous devices that can improve our personal choices throughout the day.
“Imagine if a device could learn what I would be doing next – ideally predict it – and recommend an alternative?” Castro says. “Once it builds your own schedule by knowing what you are doing, it might tell you there is a traffic delay and you should leave sooner or take a different route.”
The Latest on: Deep learning
via Google News
The Latest on: Deep learning
- Deep Learning Artificial Intelligence Leader Vyasa Analytics Selected for 2020 MassChallenge HealthTech Acceleratoron January 23, 2020 at 8:52 am
Vyasa Analytics, an innovative provider of highly scalable deep-learning AI analytics software, has been selected to join the 2020 MassChallenge HealthTech program, a startup accelerator that matches ...
- Thinking fast & slow: New DFKI project aims at making Deep Learning methods more reliableon January 23, 2020 at 4:41 am
Modern computers are in a similar position: Thanks to their training with large amounts of data, Deep Learning methods can deliver fast, yet incomprehensible results. Scientists of the German Research ...
- Classification and Morphological Analysis of Vector Mosquitoes using Deep Convolutional Neural Networkson January 23, 2020 at 2:15 am
In this study, we investigated the capability of state-of-the-art deep learning models in classifying mosquito species having high inter-species similarity and intra-species variations. Since no ...
- Podcast: A Codebase for Deep Learning Supercomputers to Fight Canceron January 22, 2020 at 8:41 am
The Exascale Deep Learning–Enabled Precision Medicine for Cancer (CANDLE) project is directed at developing pre-clinical response models, predicting mechanisms of RAS/RAF–driven cancers, and ...
- DeLTA 2020: 1st International Conference on Deep Learning Theory and Applications (Paris, France - July 8-10, 2020) - ResearchAndMarkets.comon January 21, 2020 at 4:32 pm
The "DeLTA 2020: 1st International Conference on Deep Learning Theory and Applications" conference has been added to ResearchAndMarkets.com's offering. Deep Learning and Big Data Analytics are two ...
- Microsoft makes performance, speed optimizations to ONNX machine-learning runtime available to developerson January 21, 2020 at 10:36 am
Microsoft is open sourcing and integrating some updates it it has made in deep-learning models used for natural-language processing. On January 21, the company announced it is making available to ...
- Uber's Synthetic Training Data Speeds Up Deep Learning by 9xon January 21, 2020 at 6:18 am
Using this synthetic data, Uber sped up its neural architecture search (NAS) deep-learning optimization process by 9x. In a paper published on arXiv, the team described the system and a series of ...
- Deep Learning Market 2020: Global Industry Trends, Sales Revenue, Industry Growth by 2025 – MRE Analysison January 20, 2020 at 10:30 pm
New York, January 21, 2020: Deep Learning is a subfield of machine learning concerned with algorithms inspired by the structure and function of the brain called artificial neural networks. The Deep ...
- Applying Deep Learning to Localization Microscopyon January 17, 2020 at 2:39 am
Two such technologies that can be combined to produce a better understanding of biological systems are localization microscopy and deep learning. Localization microscopy is a recently developed ...
- Deep Learning Market Report 2020 Competitors and Their Respective Market Share, R&D Status and Future Projections 2026on January 17, 2020 at 2:12 am
Global Deep Learning Market Report offers industry news by region, technological developments, value chain status, and market scope 2026. “Deep Learning Market” report 2020 presents the analysis of ...
via Bing News