Testing the Homogeneity of Kappa Statistics

Allan P. Donner · Michael Eliasziw · Neil S. Klar

74 citations0/0 files storedBiometrics

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Reliability and Agreement in Measurement Probability and Statistical Research Statistical Methods in Epidemiology

Abstract

Procedures are compared for testing the homogeneity of k > or = 2 independent kappa statistics in the case of two raters and a dichotomous outcome. One of the procedures is based on the estimated large sample variance derived under a model frequently adopted for inferences concerning interobserver agreement. The other is based on a goodness-of-fit approach to this model. The results of a Monte Carlo simulation show that the two approaches have similar properties if the number of subjects in each sample is large (> 100), and the prevalence of the underlying trait of interest is not extreme, while the goodness-of-fit approach is recommended for comparisons involving smaller numbers of subjects or in which the prevalence of the underlying trait is small (< 0.3).

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 74 citations exist upstream.

References

1971Measuring nominal scale agreement among many raters.1955Reliability of Content Analysis: The Case of Nominal Scale Coding 1988A rEAPPRAISAL OF THE KAPPA COEFFICIENT 1977A One-Way Components of Variance Model for Categorical Data 1992Review papers : Design and analysis of reliability studies 19892 x 2 Kappa Coefficients: Measures of Agreement or Association 1992A goodness‐of‐fit approach to inference procedures for the kappa statistic: Confidence interval construction, significance‐testing and sample size estimation 1988Another look at interrater agreement.

Cited by

2004Exploring response shift in longitudinal data 2022Detecting Depression Signs on Social Media: A Systematic Literature Review 2002Interval Estimation for a Difference Between Intraclass Kappa Statistics 2014Kappa statistic for clustered matched-pair data 2008Examining intra-rater and inter-rater response agreement: A medical chart abstraction study of a community-based asthma care program

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.