Open access isn’t as open as you think, especially when there are corporate interests involved
Cambridge computer scientists have established a new gold standard for open research, in order to make scientific results more robust and reliable
A group of Cambridge computer scientists have set a new gold standard for openness and reproducibility in research by sharing the more than 200GB of data and 20,000 lines of code behind their latest results – an unprecedented degree of openness in a peer-reviewed publication. The researchers hope that this new gold standard will be adopted by other fields, increasing the reliability of research results, especially for work which is publicly funded.
The researchers are presenting their results at a talk today (4 May) at the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI) in Oakland, California.
In recent years there’s been a great deal of discussion about so-called ‘open access’ publications – the idea that research publications, particularly those funded by public money, should be made publicly available.
Computer science has embraced open access more than many disciplines, with some publishers sub-licensing publications and allowing authors to publish them in open archives. However, as more and more corporations publish their research in academic journals, and as academics find themselves in a ‘publish or perish’ culture, the reliability of research results has come into question.
“Open access isn’t as open as you think, especially when there are corporate interests involved,” said Matthew Grosvenor, a PhD student from the University’s Computer Laboratory, and the paper’s lead author. “Due to commercial sensitivities, corporations are reluctant to make their code and data sets available when they publish in peer-reviewed journals. But without the code or data sets, the results are irrelevant – we can’t know whether an experiment is the same if we try to recreate it.”
Beyond computer science, a number of high-profile incidents of errors, fraud or misconduct have called quality standards in research into question. This has thrown the issue of reproducibility – that a result can be reliably repeated given the same conditions – into the spotlight.
“If a result cannot be reliably repeated, then how can we trust it?” said Grosvenor. “If you try to reproduce other people’s work from the paper alone, you often end up with different numbers. Unless you have access to everything, it’s useless to call a piece of research open source. It’s either open source or it’s not – you can’t open source just a little bit.”
With their most recent publication, Grosvenor and his colleagues have gone several steps beyond typical open access standards – setting a new gold standard for open and reproducible research. All of the experimental figures and tables in the award-winning final version of their paper, which describes a new method of making data centres more efficient, are clickable.
The Latest on: Open research
via Google News
The Latest on: Open research
- F1000 Research joins Taylor & Francis Groupon January 10, 2020 at 7:22 am
Leading specialist academic publisher Taylor & Francis Group, part of Informa plc, has today announced the addition of cutting-edge open research publisher F1000 Research Ltd. United by their shared ...
- Research Experience for Undergraduates 2020: Applications are Open!on December 4, 2019 at 12:23 pm
The application process for the SETI Institute’s Research Experience for Undergraduates (REU) program 2020 is now open. Applications will close on February 1, 2020. The SETI Institute’s REU program is ...
- NSTC Committee Seeks Input on Safe, Ethical, and Open Research Environmentson November 27, 2019 at 6:33 am
The National Science and Technology Council’s (NSTC) Joint Committee on Research Environments (JCORE) released a request for information (RFI) on Nov. 26 outlining the committee’s research priorities.
- Open research beats erecting borders in Artificial Intelligence: Bill Gateson November 21, 2019 at 8:48 pm
Microsoft Corp co-founder Bill Gates spoke out against protectionism in technological research around topics like artificial intelligence, arguing that open systems will inevitably win out over closed ...
- Bill Gates Touts Benefits of Open Research in AIon November 21, 2019 at 5:43 am
Nov.21 -- Microsoft Corp. co-founder Bill Gates discussed protectionism in technological research around topics like artificial intelligence. Gates argued that open systems will inevitably win out ...
- Bill Gates Says Open Research Beats Erecting Borders in AIon November 21, 2019 at 3:44 am
Microsoft Corp. co-founder Bill Gates spoke out against protectionism in technological research around topics like artificial intelligence, arguing that open systems will inevitably win out over ...
- If we choose to align open access to research with geo-political borders we negate the moral value of open accesson November 11, 2019 at 8:15 am
It has recently been suggested that to support the development of open access (OA) in Europe, access to open research might be ‘geoblocked’, or limited, to those countries that were involved in ...
- Keep three elementary schools open — research is clearon November 5, 2019 at 10:40 pm
All education research demonstrates that students perform better in smaller ... Why doesn’t the school board want to keep schools such as Acequia Madre Elementary School open and learn from them why ...
- Embrace Open-Source Military Research to Win the AI Competitionon October 16, 2019 at 12:47 am
Ironically, the Defense Department may be able to win the AI competition only if it embraces a more open research and development strategy. Despite legitimate security concerns, the Defense Department ...
via Bing News