SZodixStudyAcademic Library
ShelvesOpen access
Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated
The Problem with Kappa
12 references·2 citing·39 second hop
The Problem with Kappa (2012)The Problem with KappaInequalities between multi-rater kappas (2010)Inequalities between multi-ra…A Formal Proof of a Paradox Associated with Cohen’s Kappa (2010)A Formal Proof of a Paradox A…Comparison of classification accuracy using Cohen’s Weighted Kappa (2006)Comparison of classification …Inferential Methods for the Tetrachoric Correlation Coefficient (2005)Inferential Methods for the T…The Kappa Statistic: A Second Look (2004)The Kappa Statistic: A Second…Assessing agreement on classification tasks: the kappa statistic (1996)Assessing agreement on classi…Kappa muddles together two sources of disagreement: Tetrachoric correlation is preferable (1993)Kappa muddles together two so…Diversity of decision-making models and the measurement of interrater agreement. (1987)Diversity of decision-making …Estimating the Reliability, Systematic Error and Random Error of Interval Data (1970)Estimating the Reliability, S…Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. (1968)Weighted kappa: Nominal scale…A Coefficient of Agreement for Nominal Scales (1960)A Coefficient of Agreement fo…Reliability of Content Analysis: The Case of Nominal Scale Coding (1955)Reliability of Content Analys…It's the End of the Gold Standard as we Know it. On the Impact of Pre-aggregation on the Evaluation of Highly Subjective Tasks. (2020)It's the End of the Gold Stan…Spontaneous facial expression in unscripted social interactions can be measured automatically (2014)Spontaneous facial expression…Rank Correlation Methods. (1949)Estimation of the Reliability of Ratings (1951)Rank Correlation Methods. (1957)Future work selves: How salient hoped-for identities motivate proactive career behaviors. (2011)CREMA-D: Crowd-Sourced Emotional Multimodal Actors Dataset (2014)AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild (2017)The Measurement of Observer Agreement for Categorical Data (1977)Phonotactic and phrasal properties of speech rhythm. Evidence from Catalan, English, and Spanish (2011)Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation (2015)Apps As Learning Tools: A Systematic Review (2019)Theory of Mental Tests (1950)Theory and Methods of Scaling (1958)Understanding interobserver agreement: the kappa statistic. (2005)Measuring nominal scale agreement among many raters. (1971)Measuring diagnostic accuracy in the absence of a "gold standard" (1994)Infant attractiveness predicts maternal behaviors and attitudes. (1995)Psychopathy, treatment involvement, and subsequent violence among civil psychiatric patients. (2002)High agreement but low Kappa: I. the problems of two paradoxes (1990)High agreement but low kappa: II. Resolving the paradoxes (1990)Lies Kill, Facts Save: Detecting COVID-19 Misinformation in Twitter (2020)On-line anxiety level detection from biosignals: Machine learning based on a randomized controlled trial with spider-fearful individuals (2020)Barriers to sustainability in humanitarian medical supply chains (2021)Statistical Theories of Mental Test Scores (1969)Introduction to Classical and Modern Test Theory (1986)Test Theory: A Unified Treatment (2000)Exploratory factor analysis of a Force Concept Inventory data set (2012)sirt: Supplementary Item Response Theory Models (2013)An Analytic Framework for Evaluating the Validity of Concept Inventory Claims (2015)Content Analysis: An Introduction to its Methodology. (1984)Automatic detection of rumor on Sina Weibo (2012)Computational Sociolinguistics: A Survey (2016)Attention, intentions, and the structure of discourse (1986)Toward detecting emotions in spoken dialogs (2005)Rumor has it: Identifying Misinformation in Microblogs (2011)Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): Initial Reliability and Validity Data (1997)Interrater reliability: the kappa statistic (2012)Content Analysis in Consumer Research (1977)Rethinking validity and reliability in content analysis (1999)Inter-Coder Agreement for Computational Linguistics (2008)
this work references cited by second hop

References

  • 1960A Coefficient of Agreement for Nominal Scales42,335 cited
  • 1968Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.8,719 cited
  • 1996Assessing agreement on classification tasks: the kappa statistic2,088 cited
  • 1955Reliability of Content Analysis: The Case of Nominal Scale Coding1,849 cited
  • 1970Estimating the Reliability, Systematic Error and Random Error of Interval Data493 cited
  • 2004The Kappa Statistic: A Second Look488 cited
  • 2006Comparison of classification accuracy using Cohen’s Weighted Kappa320 cited
  • 1987Diversity of decision-making models and the measurement of interrater agreement.254 cited
  • 2010Inequalities between multi-rater kappas226 cited
  • 2005Inferential Methods for the Tetrachoric Correlation Coefficient126 cited
  • 2010A Formal Proof of a Paradox Associated with Cohen’s Kappa64 cited
  • 1993Kappa muddles together two sources of disagreement: Tetrachoric correlation is preferable58 cited

Cited by

  • 2014Spontaneous facial expression in unscripted social interactions can be measured automatically69 cited
  • 2020It's the End of the Gold Standard as we Know it. On the Impact of Pre-aggregation on the Evaluation of Highly Subjective Tasks.27 cited

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work