Maximum Likelihood Estimation of Agreement in the Constant Predictive Probability Model, and Its Relation to Cohen's Kappa

Abstract

The alpha agreement parameter is defined as the proportion of a population of items that are classified identically "for cause" by two classifiers, the remaining items being classified at random. The parameters of the corresponding constant predictive probability model are shown to be estimable by the method of maximum likelihood, and a simulation study indicates applicability of the asymptotic results to finite samples. The new estimator tends to be larger than Cohen's kappa, except in the case of uniform margins. An application is made to the validity of cancer risk items included in a cancer registry.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 122 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.