Reporting and Reproducibility of Meta-Analysis in Speech, Language, and Hearing Research

Abstract

Purpose The purposes of this meta-review are to (a) articulate the importance of transparency and reproducibility in meta-analysis, (b) assess the transparency and reproducibility of meta-analyses published in journals of the American Speech-Language-Hearing Association (ASHA), and (c) discuss the implications of our findings and recommendations for future research. Method We conducted a meta-review of all meta-analyses published in ASHA journals through December 31, 2020. Our systematic review yielded 47 meta-analyses for inclusion in this review. We coded all eligible reports on the core elements of transparency and reproducibility in meta-analysis. Results Our findings suggest that though reporting tendencies have improved over time, much work is needed to promote transparency and reproducibility in meta-analytic work. Key areas for future accountability include preregistering study protocol, using Preferred Reporting in Systematic Reviews and Meta-Analysis checklists, providing full data sets, and publishing analytic codes. Conclusions The state of reporting in meta-analysis is improving over time. We conclude with a discussion of specific areas that need further attention, and recommendations for researchers to consider when conducting future meta-analyses. Supplemental Material https://doi.org/10.23641/asha.14888481.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 11 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.