A rEAPPRAISAL OF THE KAPPA COEFFICIENT

William Thompson · Stephen D. Walter

500 citations0/0 files storedJournal of Clinical Epidemiology

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Reliability and Agreement in Measurement Meta-analysis and systematic reviews Statistical Methods in Epidemiology

Abstract

Kappa is frequently used in epidemiology as an index of the quality of measurement for binary characteristics. The authors discuss the strong dependence of kappa on true prevalence, and they examine the relationship of the value of kappa to the degree of attenuation of the odds ratio that results from non-differential misclassification. It is concluded that under certain circumstances kappa can be interpreted as an indicator of validity, i.e. unbiasedness of the odds ratio, rather than simply as one of reliability. Cautions are stressed regarding (1) possible variation in the quality of measurement and (2) possible lack of independence of errors for the paired measurements from which kappa is calculated. An important implication for the design of reliability studies is that they should be conducted in populations where the distribution of the factor of interest is similar to that for the settings in which the measurement technique will ultimately be applied.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 500 citations exist upstream.

References

1960A Coefficient of Agreement for Nominal Scales 1987MISINTERPRETATION AND MISUSE OF THE KAPPA STATISTIC

Cited by

2004Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure 2002Kappa coefficients in medical research 2016Measuring inter-rater reliability for nominal data – which coefficients and confidence intervals are appropriate?2006Comparison of classification accuracy using Cohen’s Weighted Kappa 2006The Irvine–Minnesota Inventory to Measure Built Environments 1996Behavior and interpretation of the κ statistic: Resolution of the two paradoxes 1996Dependence of Weighted Kappa Coefficients on the Number of Categories 2000Reproducibility of peer review in clinical neuroscience: Is agreement between reviewers any greater than would be expected by chance alone?

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.