New research aims to open the ‘black box’ of computer vision
It can take years of birdwatching experience to tell one species from the next. But using an artificial intelligence technique called deep learning, Duke University researchers have trained a computer to identify up to 200 species of birds from just a photo.
The real innovation, however, is that the A.I. tool also shows its thinking, in a way that even someone who doesn’t know a penguin from a puffin can understand.
The team trained their deep neural network — algorithms based on the way the brain works — by feeding it 11,788 photos of 200 bird species to learn from, ranging from swimming ducks to hovering hummingbirds.
The researchers never told the network “this is a beak” or “these are wing feathers.” Given a photo of a mystery bird, the network is able to pick out important patterns in the image and hazard a guess by comparing those patterns to typical species traits it has seen before.
Along the way it spits out a series of heat maps that essentially say: “This isn’t just any warbler. It’s a hooded warbler, and here are the features — like its masked head and yellow belly — that give it away.”
Duke computer science Ph.D. student Chaofan Chen and undergraduate Oscar Li led the research, along with other team members of the Prediction Analysis Lab directed by Duke professor Cynthia Rudin.
They found their neural network is able to identify the correct species up to 84% of the time — on par with some of its best-performing counterparts, which don’t reveal how they are able to tell, say, one sparrow from the next.
Rudin says their project is about more than naming birds. It’s about visualizing what deep neural networks are really seeing when they look at an image.
Similar technology is used to tag people on social networking sites, spot suspected criminals in surveillance cameras, and train self-driving cars to detect things like traffic lights and pedestrians.
The problem, Rudin says, is that most deep learning approaches to computer vision are notoriously opaque. Unlike traditional software, deep learning software learns from the data without being explicitly programmed. As a result, exactly how these algorithms ‘think’ when they classify an image isn’t always clear.
Rudin and her colleagues are trying to show that A.I. doesn’t have to be that way. She and her lab are designing deep learning models that explain the reasoning behind their predictions, making it clear exactly why and how they came up with their answers. When such a model makes a mistake, its built-in transparency makes it possible to see why.
For their next project, Rudin and her team are using their algorithm to classify suspicious areas in medical images like mammograms. If it works, their system won’t just help doctors detect lumps, calcifications and other symptoms that could be signs of breast cancer. It will also show which parts of the mammogram it’s homing in on, revealing which specific features most resemble the cancerous lesions it has seen before in other patients.
In that way, Rudin says, their network is designed to mimic the way doctors make a diagnosis. “It’s case-based reasoning,” Rudin said. “We’re hoping we can better explain to physicians or patients why their image was classified by the network as either malignant or benign.”
The Latest on: Deep learning
via Google News
The Latest on: Deep learning
- Discriminating pseudoprogression and true progression in diffuse infiltrating glioma using multi-parametric MRI data through deep learningon November 23, 2020 at 11:49 am
Differentiating pseudoprogression from true tumor progression has become a significant challenge in follow-up of diffuse infiltrating gliomas, particularly high grade, which leads to a potential ...
- Deep Learning Market Size, Definition, Development, News and significant Growth With Regional Trends By Forecast 2023on November 23, 2020 at 4:59 am
The MarketWatch News Department was not involved in the creation of this content. Nov 23, 2020 (AmericaNewsHour) -- The Deep Learning Market is estimated to record a significant growth throughout the ...
- Deep Learning Market by Type and by Geography- Global Opportunity Analysis and Industry Forecast, 2020-2024on November 20, 2020 at 9:45 am
Technavio has announced its latest market research report titled Global Deep Learning Market 2020-2024 (Graphic: Business Wire) LONDON-- ( BUSINESS WIRE )--The deep learning market is expected to grow ...
- Rebooting AI: Deep learning, meet knowledge graphson November 20, 2020 at 8:26 am
Gary Marcus, a prominent figure in AI, is on a mission to instill a breath of fresh air to a discipline he sees as in danger of stagnating. Knowledge graphs, the 20-year old hype, may have something ...
- Pioneer in Deep Learning Cybersecurity Deep Instinct Adds Board Advisors Mark Anderson and John Spiliotis as Growth Accelerates and Company Expands Worldwideon November 19, 2020 at 10:00 am
Deep Instinct, the first and only cybersecurity company to apply end-to-end deep learning to predict, identify, and prevent cyberattacks, today announced that Mark Anderson and John Spiliotis have ...
- Deep Learning Market Report 2020 Industry Trends, Share and Size, Expected CAGR, Top playerson November 18, 2020 at 7:38 am
The global deep learning market is expected to expand at 30.87% CAGR during the forecast period. Global deep learning market is expected to witness substantial growth during the forecast period. North ...
- AI startup Abacus.ai nabs $22 million in Series B funding to automate creation of deep learning modelson November 18, 2020 at 3:07 am
Abacus.ai, the year-and-a-half-old San Francisco startup that seeks to automate deep learning models for customers, said Wednesday it has received $22 million in financing in a Series B round led by ...
- AI pioneer Geoff Hinton: “Deep learning is going to be able to do everything”on November 4, 2020 at 10:51 pm
That professor was Geoffrey Hinton, and the technique they used was called deep learning. Hinton had actually been working with deep learning since the 1980s, but its effectiveness had been ...
- What’s the carbon footprint of A.I.? This clever tool breaks it downon November 4, 2020 at 1:41 pm
Deep-learning A.I. is the machine learning technology that powers everything from cutting-edge natural language processing to machine vision tools. It may also be powering climate change — as a ...
- Deep-learning algorithms helping to clear space junk from our skieson October 30, 2020 at 11:29 am
What role will deep learning algorithms play? And, what is real time in space? These are some of the questions being tackled in a ground-breaking project, led by EPFL spin-off, ClearSpace ...
via Bing News