Since 1955, The Journal of Irreproducible Results has offered “spoofs, parodies, whimsies, burlesques, lampoons and satires” about life in the laboratory.
Among its greatest hits: “Acoustic Oscillations in Jell-O, With and Without Fruit, Subjected to Varying Levels of Stress” and “Utilizing Infinite Loops to Compute an Approximate Value of Infinity.” The good-natured jibes are a backhanded celebration of science. What really goes on in the lab is, by implication, of a loftier, more serious nature.
It has been jarring to learn in recent years that a reproducible result may actually be the rarest of birds. Replication, the ability of another lab to reproduce a finding, is the gold standard of science, reassurance that you have discovered something true. But that is getting harder all the time. With the most accessible truths already discovered, what remains are often subtle effects, some so delicate that they can be conjured up only under ideal circumstances, using highly specialized techniques.
Fears that this is resulting in some questionable findings began to emerge in 2005, when Dr. John P. A. Ioannidis, a kind of meta-scientist who researches research, wrote a paper pointedly titled “Why Most Published Research Findings Are False.”
Given the desire for ambitious scientists to break from the pack with a striking new finding, Dr. Ioannidis reasoned, many hypotheses already start with a high chance of being wrong. Otherwise proving them right would not be so difficult and surprising — and supportive of a scientist’s career. Taking into account the human tendency to see what we want to see, unconscious bias is inevitable. Without any ill intent, a scientist may be nudged toward interpreting the data so it supports the hypothesis, even if just barely.
The effect is amplified by competition for a shrinking pool of grant money and also by the design of so many experiments — with small sample sizes (cells in a lab dish or people in an epidemiological pool) and weak standards for what passes as statistically significant. That makes it all the easier to fool oneself.
Paradoxically the hottest fields, with the most people pursuing the same questions, are most prone to error, Dr. Ioannidis argued. If one of five competing labs is alone in finding an effect, that result is the one likely to be published. But there is a four in five chance that it is wrong. Papers reporting negative conclusions are more easily ignored.
Putting all of this together, Dr. Ioannidis devised a mathematical model supporting the conclusion that most published findings are probably incorrect.
The Latest on: Research results
via Google News
The Latest on: Research results
- Scientists consider whether sharing research results before peer review helps or hurtson October 28, 2019 at 5:00 pm
A growing number of biologists are using the hashtag #ASAPbio to promote "preprinting." That's the somewhat controversial practice of posting research results before they're published in peer review ...
- Predicting research results can mean better science and better adviceon October 25, 2019 at 5:52 am
We ask experts for advice all the time. A company might ask an economist for advice on how to motivate its employees. A government might ask what the effect of a policy reform will be. To give the ...
- Predicting research results can mean better science and better adviceon October 24, 2019 at 12:12 pm
To give the advice, experts often would like to draw on the results of an experiment. But they don’t always have relevant experimental evidence. Collecting expert predictions about research results ...
- For better research results, let mice be miceon October 24, 2019 at 11:19 am
Animal models can serve as gateways for understanding many human communication disorders, but a new study suggests that the established practice of socially isolating mice for such purposes might ...
- For better research results, let mice be miceon October 24, 2019 at 10:01 am
Previous research demonstrated that when female mice have babies ... "But I also think that creating a more natural living situation for the mice will make the results of these laboratory experiments ...
- AgriLife expert to present crop research resultson October 19, 2019 at 8:19 pm
Of the research completed each year ... experts such as McGinty to test those plants by growing them on real farmers’ land and documenting the results, he said. “Varieties have a really short shelf ...
- 45 hours of research results on football Injuries and Suspensions websites and their comparisonon September 16, 2019 at 10:40 am
Looking through a lot of websites with injuries and suspensions trying to figure out where the most recent updates is time-consuming. Therefore I decided to make a deep analysis of the top websites ...
- Druva, Cohesity Crow About Independent Research Resultson September 12, 2019 at 9:53 pm
It would help research firms to guard against criticism from vendors who may feel unfairly treated, and help to maintain trust with customers who rely on them for their expertise. I encourage ...
- Rapid Dose Therapeutics Announces Research Results Published in Frontiers in Pharmacology Journalon September 12, 2019 at 4:01 am
BURLINGTON, Ontario, Sept. 12, 2019 (GLOBE NEWSWIRE) -- Rapid Dose Therapeutics Corp. (“RDT”) (CSE: DOSE) announced today that the results of a research study conducted by the University of Nevada, ...
via Bing News