SZodixStudyAcademic Library
DashboardShelvesOpen accessMy libraryInboxNotesWriteLearnAlerts
More
Ask your libraryNotificationsQuick citeReview
Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated
Statistical description of interrater variability in ordinal ratings
16 references·16 citing·29 second hopsampled
Statistical description of interrater variability in ordinal ratings (2000)Statistical description of interrater var…Beyond kappa: A review of interrater agreement measures (1999)Beyond kappa: A review of int…Measuring interrater reliability among multiple raters: An example of methods for nominal data (1990)Measuring interrater reliabil…High agreement but low Kappa: I. the problems of two paradoxes (1990)High agreement but low Kappa:…A rEAPPRAISAL OF THE KAPPA COEFFICIENT (1988)A rEAPPRAISAL OF THE KAPPA CO…MISINTERPRETATION AND MISUSE OF THE KAPPA STATISTIC (1987)MISINTERPRETATION AND MISUSE …Measuring Agreement for Multinomial Data (1982)Measuring Agreement for Multi…Coefficient Kappa: Some Uses, Misuses, and Alternatives (1981)Coefficient Kappa: Some Uses,…Extension of the Kappa Coefficient (1980)Extension of the Kappa Coeffi…Ramifications of a Population Model for κ as a Coefficient of Reliability (1979)Ramifications of a Population…The Measurement of Observer Agreement for Categorical Data (1977)The Measurement of Observer A…An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers (1977)An Application of Hierarchica…The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability (1973)The Equivalence of Weighted K…Measuring nominal scale agreement among many raters. (1971)Measuring nominal scale agree…Measures of response agreement for qualitative data: Some generalizations and alternatives. (1971)Measures of response agreemen…Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. (1968)Weighted kappa: Nominal scale…A Coefficient of Agreement for Nominal Scales (1960)A Coefficient of Agreement fo…Robustness of κ‐type coefficients for clinical agreement (2022)Robustness of κ‐type coeffici…Graphical aids for visualizing and interpreting patterns in departures from agreement in ordinal categorical observer agreement data (2016)Graphical aids for visualizin…Measures of agreement between many raters for ordinal classifications (2015)Measures of agreement between…Evaluating observer agreement of scoring systems for foot integrity and footrot lesions in sheep (2012)Evaluating observer agreement…Equivalences of weighted kappas for multiple raters (2011)Equivalences of weighted kapp…Cohen’s linearly weighted kappa is a weighted average (2011)Cohen’s linearly weighted kap…Cohen’s Linearly Weighted Kappa is a Weighted Average of 2×2 Kappas (2011)Cohen’s Linearly Weighted Kap…Cohen’s kappa is a weighted average (2011)Cohen’s kappa is a weighted a…A Formal Proof of a Paradox Associated with Cohen’s Kappa (2010)A Formal Proof of a Paradox A…Resampling Probability Values for Weighted Kappa with Multiple Raters (2008)Resampling Probability Values…On population‐based measures of agreement for binary classifications (2008)On population‐based measures …Assessing Agreement between Multiple Raters with Missing Rating Information, Applied to Breast Cancer Tumour Grading (2008)Assessing Agreement between M…THE EXACT VARIANCE OF WEIGHTED KAPPA WITH MULTIPLE RATERS (2007)THE EXACT VARIANCE OF WEIGHTE…Chance-corrected measures of reliability and validity in K K tables (2005)Chance-corrected measures of …Assessing the reliability of ordered categorical scales using kappa-type statistics (2005)Assessing the reliability of …Reporting Statistical Information in Medical Journal Articles (2003)Reporting Statistical Informa…Theory of Mental Tests (1950)Theory and Methods of Scaling (1958)Understanding interobserver agreement: the kappa statistic. (2005)A Concordance Correlation Coefficient to Evaluate Reproducibility (1989)ASSESSING TEACHING PRESENCE IN A COMPUTER CONFERENCING CONTEXT (2001)Critical thinking, cognitive presence, and computer conferencing in distance education (2001)Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines (2020)Reliability of Content Analysis: The Case of Nominal Scale Coding (1955)Reliability of Nominal Data Based on Qualitative Judgments (1989)Measuring intercultural sensitivity: The intercultural development inventory (2003)Inter-Coder Agreement for Computational Linguistics (2008)The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. (1998)Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement (2015)RoB 2: a revised tool for assessing risk of bias in randomised trials (2019)Is the CVI an acceptable indicator of content validity? Appraisal and recommendations (2007)The spread of true and false news online (2018)High agreement but low kappa: II. Resolving the paradoxes (1990)Bias, prevalence and kappa (1993)Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed (2010)Reliability of the Youth Risk Behavior Survey Questionnaire (1995)Reliability of the 1999 Youth Risk Behavior Survey Questionnaire (2002)Sequential Analysis and Observational Methods for the Behavioral Sciences (2011)Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): Initial Reliability and Validity Data (1997)Interrater reliability: the kappa statistic (2012)Reproducibility and responsiveness of health status measures statistics and strategies for evaluation (1991)Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. (1994)Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. (1999)Measurement of Observer Agreement (2003)Computing inter‐rater reliability and its variance in the presence of high agreement (2006)
this work references cited by second hop· second hop is a sample of the most-cited connections

References

  • 1977The Measurement of Observer Agreement for Categorical Data81,000 cited
  • 1960A Coefficient of Agreement for Nominal Scales42,335 cited
  • 1968Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.8,719 cited
  • 1971Measuring nominal scale agreement among many raters.8,717 cited
  • 1977An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers4,327 cited
  • 1973The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability3,355 cited
  • 1990High agreement but low Kappa: I. the problems of two paradoxes3,024 cited
  • 1981Coefficient Kappa: Some Uses, Misuses, and Alternatives1,575 cited
  • 1999Beyond kappa: A review of interrater agreement measures976 cited
  • 1987MISINTERPRETATION AND MISUSE OF THE KAPPA STATISTIC808 cited
  • 1971Measures of response agreement for qualitative data: Some generalizations and alternatives.750 cited
  • 1988A rEAPPRAISAL OF THE KAPPA COEFFICIENT500 cited
  • 1982Measuring Agreement for Multinomial Data354 cited
  • 1979Ramifications of a Population Model for κ as a Coefficient of Reliability293 cited
  • 1980Extension of the Kappa Coefficient

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work

237 cited
  • 1990Measuring interrater reliability among multiple raters: An example of methods for nominal data229 cited
  • Cited by

    • 2015Measures of agreement between many raters for ordinal classifications77 cited
    • 2010A Formal Proof of a Paradox Associated with Cohen’s Kappa64 cited
    • 2011Cohen’s kappa is a weighted average63 cited
    • 2003Reporting Statistical Information in Medical Journal Articles54 cited
    • 2007THE EXACT VARIANCE OF WEIGHTED KAPPA WITH MULTIPLE RATERS40 cited
    • 2008Resampling Probability Values for Weighted Kappa with Multiple Raters37 cited
    • 2011Cohen’s linearly weighted kappa is a weighted average35 cited
    • 2011Cohen’s Linearly Weighted Kappa is a Weighted Average of 2×2 Kappas32 cited
    • 2008Assessing Agreement between Multiple Raters with Missing Rating Information, Applied to Breast Cancer Tumour Grading29 cited
    • 2005Chance-corrected measures of reliability and validity in K K tables29 cited
    • 2011Equivalences of weighted kappas for multiple raters27 cited
    • 2012Evaluating observer agreement of scoring systems for foot integrity and footrot lesions in sheep27 cited
    • 2008On population‐based measures of agreement for binary classifications27 cited
    • 2022Robustness of κ‐type coefficients for clinical agreement26 cited
    • 2016Graphical aids for visualizing and interpreting patterns in departures from agreement in ordinal categorical observer agreement data25 cited
    • 2005Assessing the reliability of ordered categorical scales using kappa-type statistics24 cited