Measurement of Interrater Agreement with Adjustment for Covariates

William Eric Barlow

40 citations0/0 files storedBiometrics

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Reliability and Agreement in Measurement Probability and Statistical Research Statistical Methods in Epidemiology

Abstract

The kappa coefficient measures chance-corrected agreement between two observers in the dichotomous classification of subjects. The marginal probability of classification by each rater may depend on one or more confounding variables, however. Failure to account for these confounders may lead to inflated estimates of agreement. A multinomial model is used that assumes both raters have the same marginal probability of classification, but this probability may depend on one or more covariates. The model may be fit using software for conditional logistic regression. Additionally, likelihood-based confidence intervals for the parameter representing agreement may be computed. A simple example is discussed to illustrate model-fitting and application of the technique.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 40 citations exist upstream.

References

1977The Measurement of Observer Agreement for Categorical Data 1960A Coefficient of Agreement for Nominal Scales 1968Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.1971Measuring nominal scale agreement among many raters.19892 x 2 Kappa Coefficients: Measures of Agreement or Association 1993Interval Estimation under Two Study Designs for Kappa with Binary Classifications 1991A comparison of methods for calculating a stratified kappa 1982JACKKNIFING FUNCTIONS OF MULTINOMIAL FREQUENCIES, WITH AN APPLICATION TO A MEASURE OF CONCORDANCE1

Cited by

2008On population‐based measures of agreement for binary classifications 2003A Two-Stage Logistic Regression Model for Analyzing Inter-Rater Agreement 2006An Alternative to Cohen's κ 2011Bayesian random effects for interrater and test–retest reliability with nested clinical observations 2012Hierarchical modeling of agreement 2009

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.