Article2018

The Regression Trap and Other Pitfalls of Replication Science—Illustrated by the Report of the Open Science Collaboration

37 citations0/0 files storedBasic and Applied Social Psychology

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Meta-analysis and systematic reviews Academic and Historical Perspectives in Psychology Psychology Research and Bibliometrics

Abstract

The Open Science Collaboration’s 2015 Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716. doi:10.1126/science.aac4716[Crossref], [PubMed], [Web of Science ®] , [Google Scholar] report suggests that replication effect sizes in psychology are modest. However, closer inspection reveals serious problems. When plotting replication effects are against original effects, the regression trap is lurking: Expecting replication effects to be equally strong as original effects is logically unwarranted; they are inevitably subject to regressive shrinkage. To control for regression, the reliability of original and replication studies must be taken into account. Further problems arise from missing manipulation checks and sampling biases. Our critical comment highlights the need for replication science to live up to the same methodological scrutiny as other research.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 37 citations exist upstream.

References

2010The weirdest people in the world?2015Estimating the reproducibility of psychological science 2010WEIRD languages have misled us, too [Comment on Henrich et al.]1971Belief in the law of small numbers.1970How we should measure "change": Or should we?1955Representative design and probabilistic theory in a functional psychology.1886Regression Towards Mediocrity in Hereditary Stature.1965Problems in Measuring Change

Cited by

2022A Review of Multisite Replication Projects in Social Psychology: Is It Viable to Sustain Any Confidence in Social Psychology’s Knowledge Base?2019What Can We Learn from Many Labs Replications?2022Proposal of a Selection Protocol for Replication of Studies in Sports and Exercise Science 2021Little evidence that Eurasian jays protect their caches by responding to cues about a conspecific’s desire and visual perspective 2022Replikationskrise, p-hacking und Open Science 2020

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.