Measuring agreement in method comparison studies

Abstract

Agreement between two methods of clinical measurement can be quantified using the differences between observations made using the two methods on the same subjects. The 95% limits of agreement, estimated by mean difference +/- 1.96 standard deviation of the differences, provide an interval within which 95% of differences between measurements by the two methods are expected to lie. We describe how graphical methods can be used to investigate the assumptions of the method and we also give confidence intervals. We extend the basic approach to data where there is a relationship between difference and magnitude, both with a simple logarithmic transformation approach and a new, more general, regression approach. We discuss the importance of the repeatability of each method separately and compare an estimate of this to the limits of agreement. We extend the limits of agreement approach to data with repeated measurements, proposing new estimates for equal numbers of replicates by each method on each subject, for unequal numbers of replicates, and for replicated data collected in pairs, where the underlying value of the quantity being measured is changing. Finally, we describe a nonparametric approach to comparing methods.

Cite this

Douglas G. Altman (1999). Measuring agreement in method comparison studies. Statistical Methods in Medical Research. https://doi.org/10.1177/096228029900800204

@article{g1999measuring,
  title  = {Measuring agreement in method comparison studies},
  author = {Altman, Douglas G.},
  year   = {1999},
  journal = {Statistical Methods in Medical Research},
  doi    = {10.1177/096228029900800204}
}

Citations in this library

Stored only when both papers are in the corpus — 9,616 citations exist upstream.

References

Cited by