Meta-analysis for integrating study outcomes: A Monte Carlo study of its susceptibility to Type I and Type II errors.

Paul E. Spector · Edward L. Levine

97 citations0/0 files storedJournal of Applied Psychology

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Meta-analysis and systematic reviews Psychology Research and Bibliometrics Reliability and Agreement in Measurement

Abstract

A Monte Carlo study was conducted to determine Types I and II error rates of the Schmidt and Hunter (S&H) meta-analysis method and the U statistic for assessing homogeneity within a set of correlations. One thousand samples of correlations were generated randomly to fill each of 450 cells of an 18 × 5 × 5 (Underlying Population Correlations × Numbers of Correlations Compared × Sample Size Per Correlation) design. To assess Type I error rates, correlations were drawn from the same population. To assess power, correlations were drawn from two different populations. As compared with U, which was uniformly robust, the Type I error rate for the S&H method was unacceptably high in many cells, particularly when the criterion for determining homogeneity was set at a highly conservative level. Power for the S&H method increased with increasing size of population differences, sample size per correlation, and in some cases, number of correlations compared. The U statistic did more poorly in most conditions in protecting from Type II errors.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 97 citations exist upstream.

References

1976Primary, Secondary, and Meta-Analysis of Research 1994Meta-Analytic Procedures for Social Research.1984Validity and utility of alternative predictors of job performance.1984Meta-Analysis: Cumulating Research Findings across Studies 1983A meta-analysis of the correlates of role conflict and ambiguity.1980Validity generalization results for tests used to predict job proficiency and training success in clerical occupations.

Cited by

1991Mediators and moderators in meta-analysis: There's a reason we don't let dodo birds tell us which psychotherapies should have prizes.1991Meta‐analysis comparing the persuasiveness of one‐sided and two‐sided messages 1998The Relation between Job Level and Job Satisfaction 2012A Meta-Analytic Investigation of the Relationship Between State Affect, Discrete Emotions, and Job Performance 2009Replicating and Extending Past Personality/Job Satisfaction Meta-Analyses 1992A meta-analytic review of the relationship between absence and turnover.1988A COMPARISON OF CRITERIA FOR TEST VALIDATION: A META‐ANALYTIC INVESTIGATION

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.