Effect of open peer review on quality of reviews and on reviewers'recommendations: a randomised trial

Susan van Rooyen · Fiona Godlee · Stephen J. W. Evans · Nick A. Black · Richard W. Smith

415 citations0/0 files storedBMJ

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Publishing and Scholarly Communication Academic Writing and Publishing Academic Publishing and Open Access

Abstract

OBJECTIVES: To examine the effect on peer review of asking reviewers to have their identity revealed to the authors of the paper. DESIGN: Randomised trial. Consecutive eligible papers were sent to two reviewers who were randomised to have their identity revealed to the authors or to remain anonymous. Editors and authors were blind to the intervention. MAIN OUTCOME MEASURES: The quality of the reviews was independently rated by two editors and the corresponding author using a validated instrument. Additional outcomes were the time taken to complete the review and the recommendation regarding publication. A questionnaire survey was undertaken of the authors of a cohort of manuscripts submitted for publication to find out their views on open peer review. RESULTS: Two editors' assessments were obtained for 113 out of 125 manuscripts, and the corresponding author's assessment was obtained for 105. Reviewers randomised to be asked to be identified were 12% (95% confidence interval 0.2% to 24%) more likely to decline to review than reviewers randomised to remain anonymous (35% v 23%). There was no significant difference in quality (scored on a scale of 1 to 5) between anonymous reviewers (3.06 (SD 0.72)) and identified reviewers (3.09 (0.68)) (P=0.68, 95% confidence interval for difference - 0.19 to 0.12), and no significant difference in the recommendation regarding publication or time taken to review the paper. The editors' quality score for reviews (3.05 (SD 0.70)) was significantly higher than that of authors (2.90 (0.87)) (P<0.005, 95%confidence interval for difference - 0.26 to - 0.03). Most authors were in favour of open peer review. CONCLUSIONS: Asking reviewers to consent to being identified to the author had no important effect on the quality of the review, the recommendation regarding publication, or the time taken to review, but it significantly increased the likelihood of reviewers declining to review.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 415 citations exist upstream.

Cited by

2016How open science helps researchers succeed 2017Scholarly use of social media and altmetrics: A review of the literature 2016The academic, economic and societal impacts of Open Access: an evidence-based review 2016Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science 2017What is open peer review? A systematic review 2012Peer review in a changing world: An international study measuring the attitudes of researchers 2020The limitations to our understanding of peer review 2017Gender bias in scholarly peer review

Imported from OpenAlex (CC0) — nothing here is generated.