Integration and generalization of kappas for multiple raters.

1980-01-01articlePsychological Bulletin545 citationsclosed

No readable copy stored yet — this record is metadata only.

Reliability and Agreement in Measurement Psychometric Methodologies and Testing Multidisciplinary Science and Engineering Research

Abstract

J. A. Cohen's kappa (1960) for measuring agreement between 2 raters, using a nominal scale, has been extended for use with multiple raters by R. J. Light (1971) and J. L. Fleiss (1971). In the present article, these indices are analyzed and reformulated in terms of agreement statistics based on all

Citations in this library

Stored only when both papers are in the corpus — 545 citations exist upstream.

References

1960A Coefficient of Agreement for Nominal Scales

1971Measuring nominal scale agreement among many raters.

1971Measures of response agreement for qualitative data: Some generalizations and alternatives.

Cited by

1999Rape Myth Acceptance: Exploration of Its Structure and Its Measurement Using theIllinois Rape Myth Acceptance Scale

2011The Strategic Management of Innovation: A Systematic Review and Paths for Future Research

2019Reliability from α to ω: A tutorial.

1991The reliability of peer review for manuscript and grant submissions: A cross-disciplinary investigation

2006Handbook of multimethod measurement in psychology.

1989Reproducibility of histomorphologic diagnoses with special reference to the kappa statistic

2014Does stereotype threat influence performance of girls in stereotyped domains? A meta-analysis

1982Measuring Agreement for Multinomial Data