Rice U. expert: Key is creating ML systems that question their own predictions
Rice University statistician Genevera Allen says scientists must keep questioning the accuracy and reproducibility of scientific discoveries made by machine-learning techniques until researchers develop new computational systems that can critique themselves.
Allen, associate professor of statistics, computer science and electrical and computer engineering at Rice and of pediatrics-neurology at Baylor College of Medicine, will address the topic in both a press briefing and a general session today at the 2019 Annual Meeting of the American Association for the Advancement of Science (AAAS).
“The question is, ‘Can we really trust the discoveries that are currently being made using machine-learning techniques applied to large data sets?’” Allen said. “The answer in many situations is probably, ‘Not without checking,’ but work is underway on next-generation machine-learning systems that will assess the uncertainty and reproducibility of their predictions.”
Machine learning (ML) is a branch of statistics and computer science concerned with building computational systems that learn from data rather than following explicit instructions. Allen said much attention in the ML field has focused on developing predictive models that allow ML to make predictions about future data based on its understanding of data it has studied.
“A lot of these techniques are designed to always make a prediction,” she said. “They never come back with ‘I don’t know,’ or ‘I didn’t discover anything,’ because they aren’t made to.”
She said uncorroborated data-driven discoveries from recently published ML studies of cancer data are a good example.
“In precision medicine, it’s important to find groups of patients that have genomically similar profiles so you can develop drug therapies that are targeted to the specific genome for their disease,” Allen said. “People have applied machine learning to genomic data from clinical cohorts to find groups, or clusters, of patients with similar genomic profiles.
“But there are cases where discoveries aren’t reproducible; the clusters discovered in one study are completely different than the clusters found in another,” she said. “Why? Because most machine-learning techniques today always say, ‘I found a group.’ Sometimes, it would be far more useful if they said, ‘I think some of these are really grouped together, but I’m uncertain about these others.’”
The Latest on: Machine-learning discoveries
via Google News
The Latest on: Machine-learning discoveries
- HPC Innovation Excellence Award Showcases Physics-based Scientific Discoveryon August 17, 2019 at 9:44 am
Supervised machine learning and deep learning work well only if you have ... “This is why there has been keen interest in unsupervised physics-informed discovery approaches like DisCo.” This is a ...
- Dr. Trilce Estrada Recognized as the 2019 ACM SIGHPC Emerging Woman Leader in Technical Computingon August 16, 2019 at 12:35 pm
She is recognized “for her innovative and transformative deployment of machine learning for knowledge discovery in molecular dynamics simulations and in situ analytics.” The Emerging Woman Leader in ...
- Y Combinator-backed Holy Grail is using machine learning to build better batterieson August 16, 2019 at 9:08 am
“There are some companies that only do the machine-learning part and the computational ... as a new platform for materials science discoveries broadly. For now, though, the focus is on batteries.
- Machine learning brings cell imaging promises into focuson August 16, 2019 at 2:54 am
By pushing these data through a machine learning pipeline, they hope to find relationships that are invisible to the human eye, and to tease out clusters of effects that can guide their drug discovery ...
- Top data scientists are honored for their work in data mining and discoveryon August 16, 2019 at 12:49 am
The KDD conference is the setting for the annual gathering of ACM’s Subgroup on Knowledge Discovery and Data Mining ... for his contributions to society through the development of machine learning ...
- AI And Machine Learning Are Powering Next-Generation Media Operationson August 15, 2019 at 8:41 am
This reliance on data shapes content discovery, how content is delivered, and even business models. Malpani says her organization is one of many using machine learning to select and package content ...
- New Partnership Uses Machine Learning to Improve Data Securityon August 15, 2019 at 6:45 am
As machine learning and artificial intelligence continue to make their ... to see how we can really help our colleagues here with some discoveries.” ...
- Vionlabs to debut content discovery platform at IBC 2019on August 12, 2019 at 7:23 am
Stockholm-based media tech company Vionlabs announces that its artificial intelligence-powered content discovery platform will make its public debut at IBC 2019. The platform uses artificial ...
- Publisher Discovery Relaunch with Advanced AI and Machine Learningon August 12, 2019 at 3:10 am
Publisher Discovery is excited to announce the launch of a brand new platform driven by advanced AI and machine learning technology. The development of Publisher Discovery competitor analysis tools ...
- Charmboard: Enabling product discovery via videoson August 11, 2019 at 12:27 pm
At the core of its business is Artificial Intelligence (AI) and Machine Learning (ML). This enables all the users to make organic discoveries that are native to the content they are viewing. At the ...
via Bing News