Benefits and Challenges of Using AI for Peer Review: A Study on Researchers’ Perceptions

Abstract

As AI becomes increasingly integrated into the peer review process, understanding its implications remains limited. This paper examines researchers’ perceptions of AI in peer review, highlighting both its benefits and challenges. Qualitative data were gathered from peer reviewers on a social media platform, revealing mixed feelings about AI’s role in the review process. AI may enhance feedback by allowing reviewers to rephrase their comments. This results in kinder and more professional reviews. It also has the potential to speed up the process by saving time on pre-submission checks and managing larger volumes of submissions. However, concerns persist that comments using AI may be overly generic and lack specific insights. Reviewers fear that outputs from AI could be passed to authors without proper verification. Moreover, ethical issues arise when AI is employed without consent, risking confidentiality and compromising the review’s quality. As the academic community navigates these complexities, it is essential to proceed with caution. It ensures that AI’s integration does not undermine the integrity of peer review. A balance between AI’s efficiency and the unique insights provided by human reviewers is imperative. To address these concerns, institutions should focus on transparency with AI tools, maintain quality assurance through validation, establish clear ethical guidelines, prioritize privacy and data protection, and support ongoing professional development for reviewers. Only time will tell if AI will genuinely revolutionize peer review or complicate existing challenges.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 15 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.