Half of mouse studies fail to report the sex and age of the models involved
A project at The University of Manchester to analyse 15,000 mouse studies – the largest of its kind ever undertaken – has revealed that about half of these studies failed to report the sex and age of the mice involved, despite these being recognised as key variables that can affect the outcome of scientific studies.
The project utilised text mining software developed at the University, which can analyse large collections of documents to unearth information which would otherwise have been virtually impossible to discover. The software relies on a number of rules, which automatically scan the method section of papers to identify mentions of gender and age.
The results of the project, published this week in eLife, highlight the issue of reproducibility of scientific research – around £20 billion is spent every year on research which is not reproducible, and over 80% of potential therapeutics fail in humans after being tested in mice.
Previously published studies have suggested that research done on female animals may not be applicable for men, and in many of the studies analysed in this project, the animals used were overwhelmingly female. This may be due to female mice being less aggressive, which makes them easier to use in the studies. This is important, because the sexes can have markedly different responses to the same investigations – for example, in infection research.
This may significantly reduce the reliability of studies, and lead to drugs that won’t work for half of the population.
The reproducibility of studies often focuses on the interpretation of statistics, but this project has highlighted that the methods used may not be reported rigorously enough to assess whether they were done correctly. By looking at the methods used, it is possible to infer whether or not the statistics produced are sound, and reproducible in the future. Without knowing these methods, this cannot be inferred at all, which hampers cross-disciplinary research and longevity of data.
The project has produced a vital tool to measure the reproducibility of scientific studies, but there is a long way to go – failure to consider gender in research is still very much the norm, and according to one analysis of scientific studies published in 2009, only 45% of animal studies involving depression or anxiety and only 38 percent involving strokes used females, even though these conditions are more common in women.
“The opportunity to use text mining to cover such a broad portfolio of research was brilliant, and vital to see the bigger picture,” said Sheena Cruickshank, Senior Lecturer in Immunology at The University of Manchester. “We are an interdisciplinary team, and it was this which enabled us to spot this issue and then explore it. The paper builds on several pieces of work we have done together, and highlights the importance of the scientific community to come together and define what is important in the current reproducibility crisis.”
“This study has demonstrated how state-of-the-art computer science technology is instrumental for a large-scale and systematic analysis of literature,” said Dr Goran Nenadic from The University of Manchester’s School of Computer Science. “It avoids small sample bias, and allows us to explore the research landscape on a large scale to identify key issues in reporting details of scientific methodologies, which are necessary for reproducibility, transparency and fidelity of research.”
The Latest on: Reproducibility of scientific research
via Google News
The Latest on: Reproducibility of scientific research
- The Database of Cross-Linguistic Colexifications, reproducible analysis of cross-linguistic polysemieson January 13, 2020 at 2:13 am
Advances in computer-assisted linguistic research have been greatly influential in reshaping linguistic research ... Once the data have been curated and the scripts for workflow reproducibility are ...
- Robust, reproducible and quantitative analysis of thousands of proteomes by micro-flow LC–MS/MSon January 9, 2020 at 2:34 am
Nano-flow liquid chromatography tandem mass spectrometry (nano-flow LC–MS/MS) is the mainstay in proteome research because of its excellent sensitivity but often comes at the expense of robustness.
- UK Group Tackles Reproducibility in Researchon January 7, 2020 at 10:58 am
These and other recent findings on the lack of reproducibility in scientific research have inspired the creation of groups such as the UK Reproducibility Network (UKRN). The Scientist spoke with ...
- Reproducibility Initiative to Increase the Value of Biomedical Researchon December 15, 2019 at 4:00 pm
have announced the launch of the Reproducibility Initiative – a new program to help scientists, institutions and funding agencies validate their critical research findings. Science Exchange CEO and co ...
- UK universities will work together to improve research quality and reproducibilityon December 10, 2019 at 10:25 am
Advances in science depend on research that is replicable ... aligning promotion and hiring criteria to support open and reproducible research practices, and sharing best practices. Academic leads ...
- ESIP Introduces New Data and Software Citation Guidelines Aimed at Making Earth Science Research FAIRon December 9, 2019 at 5:02 am
Many publishers now require research papers to include data and software citations, which not only provide credit to data producers, data stewards and software developers, but also ensure scientific ...
- Digital Science Unveils Report on Reproducibility and Falsifiability in Researchon September 11, 2019 at 9:32 pm
Reproducibility, Falsifiability and the Scientific Method,” which addresses the “appropriate documentation and sharing of research data, clear analysis and processes, and the sharing of code,” among ...
- EarthCube Data Capabilities: Collaborative Research: Integration of Reproducibility into Community Cyberinfrastructureon August 25, 2019 at 5:00 pm
For science to reliably support new discoveries ... Emphasis on the importance of research reproducibility is steadily rising, however many studies still continue to not be reproducible.
- Transparent and Reproducible Social Science Research: A new open science textbookon August 5, 2019 at 10:45 am
There’s a new textbook in town! “Transparent and Reproducible Social Science Research: How to do open science,” by Garret Christensen, Jeremy Freese, and CEGA Faculty Director Ted Miguel, is the first ...
- Launch of the World’s First Public Laboratory Dedicated to Certifying the Reproducibility of Scientific Researchon July 18, 2019 at 6:51 am
A non-profit certification agency, cascad will allow researchers to signal the reproducibility of their research. The public laboratory has been featured in an article published in Science on July 12.
via Bing News