Citation map · Study

SZodixStudyAcademic Library

Shelves Open access

Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated

Grant Peer Review: Improving Inter-Rater Reliability with Training

10 references·16 citing·49 second hop

FromToDepth

this work references cited by second hop

References

1979Intraclass correlations: Uses in assessing rater reliability.23,882 cited
2011Extraneous factors in judicial decisions1,431 cited
2014Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Raters1,097 cited
1994A critical discussion of intraclass correlation coefficients714 cited
2008Improving the peer-review process for grant applications: Reliability, validity, bias, and generalizability.299 cited
1999Peer Review in Health Sciences268 cited
2004Effects of training on quality of peer review: randomised controlled trial268 cited
2010A Reliability-Generalization Study of Journal Peer Reviews: A Multilevel Meta-Analysis of Inter-Rater Reliability and Its Determinants232 cited
2014Incentives and Performance96 cited
2011The Validity of Peer Review in a General Medicine Journal72 cited

Cited by

2020The leaky pipeline in research grant peer review and funding decisions: challenges and future directions86 cited
2017What do we know about grant peer review in the health sciences?68 cited
2022What works for peer review and decision-making in research funding: a realist synthesis53 cited
2019The troubles with peer review for allocating research funding51 cited

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work

2018Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency42 cited

2019Measuring bias, burden and conservatism in research funding processes35 cited

2021Implementing a pressure training program to improve decision-making and execution of skill among premier league academy soccer players32 cited

2017The future of societal impact assessment using peer review: pre-evaluation training, consensus building and inter-reviewer reliability30 cited

2017Difficulty of recruiting reviewers predicts review scores and editorial decisions at six journals of ecology and evolution28 cited

2021When Zero May Not Be Zero: A Cautionary Note on the Use of Inter-Rater Reliability in Evaluating Grant Peer Review28 cited

2021A retrospective analysis of the peer review of more than 75,000 Marie Curie proposals between 2007 and 201826 cited

2024ReviewFlow: Intelligent Scaffolding to Support Academic Peer Reviewing25 cited

2017Scalable information inequalities for uncertainty quantification25 cited

2017Peer-review for selection of oral presentations for conferences: Are we reliable?19 cited

2023Reviewer training for improving grant and journal peer review17 cited

2018Disparities in ratings of internal and external applicants: A case for model-based inter-rater reliability17 cited