Advertisement

Topics

Randomly auditing research labs could be an affordable way to improve research quality: A simulation study.

08:00 EDT 12th April 2018 | BioPortfolio

Summary of "Randomly auditing research labs could be an affordable way to improve research quality: A simulation study."

The "publish or perish" incentive drives many researchers to increase the quantity of their papers at the cost of quality. Lowering quality increases the number of false positive errors which is a key cause of the reproducibility crisis. We adapted a previously published simulation of the research world where labs that produce many papers are more likely to have "child" labs that inherit their characteristics. This selection creates a competitive spiral that favours quantity over quality. To try to halt the competitive spiral we added random audits that could detect and remove labs with a high proportion of false positives, and also improved the behaviour of "child" and "parent" labs who increased their effort and so lowered their probability of making a false positive error. Without auditing, only 0.2% of simulations did not experience the competitive spiral, defined by a convergence to the highest possible false positive probability. Auditing 1.35% of papers avoided the competitive spiral in 71% of simulations, and auditing 1.94% of papers in 95% of simulations. Audits worked best when they were only applied to established labs with 50 or more papers compared with labs with 25 or more papers. Adding a ±20% random error to the number of false positives to simulate peer reviewer error did not reduce the audits' efficacy. The main benefit of the audits was via the increase in effort in "child" and "parent" labs. Audits improved the literature by reducing the number of false positives from 30.2 per 100 papers to 12.3 per 100 papers. Auditing 1.94% of papers would cost an estimated $15.9 million per year if applied to papers produced by National Institutes of Health funding. Our simulation greatly simplifies the research world and there are many unanswered questions about if and how audits would work that can only be addressed by a trial of an audit.

Affiliation

Journal Details

This article was published in the following journal.

Name: PloS one
ISSN: 1932-6203
Pages: e0195613

Links

DeepDyve research library

PubMed Articles [29913 Associated PubMed Articles listed on BioPortfolio]

Research matters: Meta-spin cycles, the blindness of bias, and rebuilding trust.

Meta-research is research about research. Meta-research may not be as click-worthy as a meta-pug-a pug dog dressed up in a pug costume-but it is crucial to understanding research. A particularly valua...

The Importance of HIV Research for Transgender and Gender Non-Binary Individuals.

Transgender and gender non-binary (trans/GNB) individuals are disproportionally affected by HIV, yet they are not adequately represented in HIV research and often underserved in clinical care. By buil...

Interventions to improve adherence to reporting guidelines in health research: a scoping review protocol.

There is evidence that the use of some reporting guidelines, such as the Consolidated Standards for Reporting Trials, is associated with improved completeness of reporting in health research. However,...

A consensus statement on how to conduct inclusive health research.

The active involvement of people with intellectual disabilities in research, or inclusive research, is relatively common. However, inclusive health research is less common, even though it is expected ...

CROWN initiative and preterm birth prevention: Researchers and editors commit to implement core outcome sets.

The emphasis on research quality has taken great strides in recent years. Publication of clinical trial protocols (i.e. SPIRIT guideline), prospective registration (e.g. ClinicalTrials. gov, WHO regis...

Clinical Trials [11915 Associated Clinical Trials listed on BioPortfolio]

Design of an Affordable Gym for Post Stroke Rehabilitation

Rehab in a Crate is a therapy gym designed to be affordable, compact and easily transportable. The purpose of this particular study is to gain feedback on the initial design of the Rehab i...

Post Affordable Care Act Evaluation

This innovative study will measure the impact of Affordable Care Act-sponsored Medicaid expansions on access to and utilization of community health center (CHC) services. Building on our p...

Long-Term Effects of Bariatric Surgery

The primary objective of LABS-2 is to use standardized techniques and measures to assess the longer-term safety and efficacy of bariatric surgery by: 1. comparing post-surgical outcomes...

Investigation of a Novel Approach to Improve Treatment Success Rates for Tuberculosis Patients in Senegal

Tuberculosis (TB) patients who receive inadequate treatment or do not complete therapy are more likely to remain infectious, thus contributing to the continuous spread of TB infection in c...

Smart Vision Labs Autorefractor

The study is used to verify the accuracy and repeatability of Smart Vision Labs Refractor.

Medical and Biotech [MESH] Definitions

Research carried out by nurses in the clinical setting and designed to provide information that will help improve patient care. Other professional staff may also participate in the research.

Component of the NATIONAL INSTITUTES OF HEALTH. It seeks to improve oral, dental and craniofacial health through research, research training, and the dissemination of health information by conducting and supporting basic and clinical research. It was established in 1948 as the National Institute of Dental Research and re-named in 1998 as the National Institute of Dental and Craniofacial Research.

A designation for publications of research resulting from extramural research funded by the National Institutes of Health.

A designation for publications of research resulting from intramural research at the National Institutes of Health.

The moral obligations governing the conduct of research. Used for discussions of research ethics as a general topic.

Advertisement
Quick Search
Advertisement
Advertisement

 


DeepDyve research library

Relevant Topic

Pediatrics
Pediatrics is the general medicine of childhood. Because of the developmental processes (psychological and physical) of childhood, the involvement of parents, and the social management of conditions at home and at school, pediatrics is a specialty. With ...


Searches Linking to this Article