ALL-IN meta-analysis: breathing life into living systematic reviews

Abstract

-values and anytime-valid confidence intervals that can be updated at any time-reanalyzing after each new observation while retaining type-I error and coverage guarantees, live-no need to prespecify the looks, and leading-in the decisions on whether individual studies should be initiated, stopped or expanded, the meta-analysis can be the leading source of information without losing validity to accumulation bias. The analysis design requires no information about the trial sample sizes or the number of trials eventually included. So ALL-IN meta-analysis can be applied retrospectively as well as prospectively, to evaluate the evidence once or sequentially. Because the intention of the analysis does not change the validity of the results, the results of the analysis can change the intentions ('optional stopping' and 'optional continuation' based on the results so far). On the one hand: any analysis can be turned into a living one, or even become prospective and real-time by updating with new trial data and including interim data from trials that are still ongoing - without any changes in the cut-offs for testing or the method for interval estimation. On the other hand: no stopping rule needs to be enforced for the analysis to remain valid, so participating in a prospective meta-analysis does not require outside control over data collection. Hence ALL-IN meta-analysis breathes life into living systematic reviews, and offers better and simpler statistics, efficiency, collaboration and communication.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 11 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.