Half of mouse studies fail to report the sex and age of the models involved
A project at The University of Manchester to analyse 15,000 mouse studies – the largest of its kind ever undertaken – has revealed that about half of these studies failed to report the sex and age of the mice involved, despite these being recognised as key variables that can affect the outcome of scientific studies.
The project utilised text mining software developed at the University, which can analyse large collections of documents to unearth information which would otherwise have been virtually impossible to discover. The software relies on a number of rules, which automatically scan the method section of papers to identify mentions of gender and age.
The results of the project, published this week in eLife, highlight the issue of reproducibility of scientific research – around £20 billion is spent every year on research which is not reproducible, and over 80% of potential therapeutics fail in humans after being tested in mice.
Previously published studies have suggested that research done on female animals may not be applicable for men, and in many of the studies analysed in this project, the animals used were overwhelmingly female. This may be due to female mice being less aggressive, which makes them easier to use in the studies. This is important, because the sexes can have markedly different responses to the same investigations – for example, in infection research.
This may significantly reduce the reliability of studies, and lead to drugs that won’t work for half of the population.
The reproducibility of studies often focuses on the interpretation of statistics, but this project has highlighted that the methods used may not be reported rigorously enough to assess whether they were done correctly. By looking at the methods used, it is possible to infer whether or not the statistics produced are sound, and reproducible in the future. Without knowing these methods, this cannot be inferred at all, which hampers cross-disciplinary research and longevity of data.
The project has produced a vital tool to measure the reproducibility of scientific studies, but there is a long way to go – failure to consider gender in research is still very much the norm, and according to one analysis of scientific studies published in 2009, only 45% of animal studies involving depression or anxiety and only 38 percent involving strokes used females, even though these conditions are more common in women.
“The opportunity to use text mining to cover such a broad portfolio of research was brilliant, and vital to see the bigger picture,” said Sheena Cruickshank, Senior Lecturer in Immunology at The University of Manchester. “We are an interdisciplinary team, and it was this which enabled us to spot this issue and then explore it. The paper builds on several pieces of work we have done together, and highlights the importance of the scientific community to come together and define what is important in the current reproducibility crisis.”
“This study has demonstrated how state-of-the-art computer science technology is instrumental for a large-scale and systematic analysis of literature,” said Dr Goran Nenadic from The University of Manchester’s School of Computer Science. “It avoids small sample bias, and allows us to explore the research landscape on a large scale to identify key issues in reporting details of scientific methodologies, which are necessary for reproducibility, transparency and fidelity of research.”
The Latest on: Reproducibility of scientific research
via Google News
The Latest on: Reproducibility of scientific research
- Invest 5% of research funds in ensuring data are reusableon February 25, 2020 at 10:09 am
My colleagues and I, along with European Open Science Cloud, an initiative aimed at promoting open-science ... intelligence (FAIR can also mean ‘fully AI ready’), which will open up unprecedented ...
- Reproducible Dry Stamping Transfer of PEDOT:PSS Transparent Top Electrode for Flexible Semitransparent Metal Halide Perovskite Solar Cellson February 24, 2020 at 9:25 pm
Department of Chemical and Biomolecular Engineering (BK21+ Graduate Program), Korea Advanced Institute of Science and Technology, 291 Daehak-ro ... The Altmetric Attention Score is a quantitative ...
- How a 'no raw data, no science' outlook can resolve the reproducibility crisis in scienceon February 20, 2020 at 5:06 pm
This discrepancy is called a "reproducibility crisis"—or the inability of scientific findings to be replicated by other researchers. This problem has become more prevalent over the past few decades, ...
- TACC – Supporting Portable, Reproducible, Computational Science with Containerson February 20, 2020 at 8:29 am
It’s a nice overview with insight for making use of containers in scientific research. Presented here is small portion ... supporting code that was developed on deprecated environments becomes a ...
- An optimized structure of memristive device for neuromorphic computing systems implementedon February 19, 2020 at 7:49 am
Variability (lack of reproducibility) of resistive switching parameters ... This work is funded by a Nizhny Novgorod region grant in the field of science, technology and engineering (Agreement No. 316 ...
- The Scientific Paper Is Outdatedon February 16, 2020 at 5:36 pm
Using technologies such as Binder, an open-source tool that allows anyone to recreate a researcher’s technical environment, we could make reproducibility a built-in property of all our scholarly ...
- Geography and Environment Research Transparency and Reproducibility Training - Grantham Research Institute on climate change and the environmenton February 10, 2020 at 4:00 pm
The Geography & Environment Department is pleased to host you for the first Research Transparency and Reproducibility Training at the London School of Economics and Political Science. Participants ...
- Pilot program aims to improve reproducibility, utility, and ethics of biomedical researchon February 10, 2020 at 4:00 pm
Addressing the widespread concern over transparency and reproducibility in biomedical research, one of the largest institutions in science has begun to provide a framework, interventions ...
- Transparent and Reproducible Social Science Research: How to Do Open Scienceon January 15, 2020 at 4:20 am
We hope this tour of major topics in research transparency and reproducibility has been useful to you. You’ll recall that we started by painting a picture of the ideal scientific ethos to which we ...
- Rigor and Reproducibility in Researchon May 16, 2018 at 3:01 pm
The problem of non-reproducible outcomes in the scientific literature is rapidly eroding the credibility of biomedical research. The goal of the Mastering the Art of Reproducible Science course is to ...
via Bing News