The Measurement of Observer Agreement for Categorical Data

Abstract

This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.

Cite this

John Richard Landis, Gary G. Koch (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics. https://doi.org/10.2307/2529310

@article{richard1977the,
  title  = {The Measurement of Observer Agreement for Categorical Data},
  author = {Landis, John Richard and Koch, Gary G.},
  year   = {1977},
  journal = {Biometrics},
  doi    = {10.2307/2529310}
}

Citations in this library

Stored only when both papers are in the corpus — 81,000 citations exist upstream.

References

Cited by