SZodixStudyAcademic Library
ShelvesOpen access
Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated
HOW reliable are change‐corrected measures of agreement?
16 references·16 citing·35 second hopsampled
HOW reliable are change‐corrected measures of agreement? (1993)HOW reliable are change‐corrected measure…High agreement but low Kappa: I. the problems of two paradoxes (1990)High agreement but low Kappa:…2 x 2 Kappa Coefficients: Measures of Agreement or Association (1989)2 x 2 Kappa Coefficients: Mea…A rEAPPRAISAL OF THE KAPPA COEFFICIENT (1988)A rEAPPRAISAL OF THE KAPPA CO…MISINTERPRETATION AND MISUSE OF THE KAPPA STATISTIC (1987)MISINTERPRETATION AND MISUSE …Modeling Agreement Among Raters (1985)Modeling Agreement Among Rate…A Proposed Solution to the Base Rate Problem in the Kappa Statistic (1985)A Proposed Solution to the Ba…Reliability Studies of Psychiatric Diagnosis (1981)Reliability Studies of Psychi…Coefficient Kappa: Some Uses, Misuses, and Alternatives (1981)Coefficient Kappa: Some Uses,…Clinical biostatistics: LIV. The biostatistics of concordance (1981)Clinical biostatistics: LIV. …Extension of the Kappa Coefficient (1980)Extension of the Kappa Coeffi…Ramifications of a Population Model for κ as a Coefficient of Reliability (1979)Ramifications of a Population…Maximum Likelihood Estimation of Observer Error-Rates Using the EM Algorithm (1979)Maximum Likelihood Estimation…The Reliability of Clinical Methods, Data and Judgments (1975)The Reliability of Clinical M…Measuring Agreement between Two Judges on the Presence or Absence of a Trait (1975)Measuring Agreement between T…A Coefficient of Agreement for Nominal Scales (1960)A Coefficient of Agreement fo…Reliability of Content Analysis: The Case of Nominal Scale Coding (1955)Reliability of Content Analys…Robustness of κ‐type coefficients for clinical agreement (2022)Robustness of κ‐type coeffici…Observer agreement paradoxes in 2x2 tables: comparison of agreement measures (2014)Observer agreement paradoxes …Factors affecting intercoder reliability: a Monte Carlo experiment (2012)Factors affecting intercoder …Chance-Corrected Measures of Reliability and Validity in 2 × 2 Tables (2008)Chance-Corrected Measures of …Assessing Agreement between Multiple Raters with Missing Rating Information, Applied to Breast Cancer Tumour Grading (2008)Assessing Agreement between M…Assessing observer agreement when describing and classifying functioning with the International Classification of Functioning, Disability and Health (2007)Assessing observer agreement …[Comparative analysis of three approaches for rater agreement]. (2006)[Comparative analysis of thre…Chance-corrected measures of reliability and validity in K K tables (2005)Chance-corrected measures of …Assessing the reliability of ordered categorical scales using kappa-type statistics (2005)Assessing the reliability of …The syntax-discourse interface: effects of the main-subordinate distinction on attention structure (2003)The syntax-discourse interfac…Estimating equations for kappa statistics (2001)Estimating equations for kapp…Statistical description of interrater variability in ordinal ratings (2000)Statistical description of in…Validity of a Self-reported History of Doctor-diagnosed Angina (1999)Validity of a Self-reported H…Generalization of the Kappa coeficient for ordinal categorical data, multiple observers and incomplete designs (1999)Generalization of the Kappa c…Modelling covariate effects in observer agreement studies: The case of nominal scale agreement (1995)Modelling covariate effects i…Conditional inference for subject‐specific and marginal agreement: Two families of agreement measures (1995)Conditional inference for sub…Variation Between Observers in Describing Mucosal Appearances in Proctocolitis (1964)Measures of response agreement for qualitative data: Some generalizations and alternatives. (1971)A Re-analysis of the Reliability of Psychiatric Diagnosis (1974)Professional uncertainty and the problem of supplier-induced demand (1982)Individual-patient monitoring in clinical practice: are available health status surveys adequate? (1995)The art and science of clinical knowledge: evidence beyond measures and numbers (2001)Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. (1968)Measuring nominal scale agreement among many raters. (1971)The reliability of peer review for manuscript and grant submissions: A cross-disciplinary investigation (1991)Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. (1994)Latent Structure Analysis. (1969)Exploratory Latent Structure Analysis Using Both Identifiable and Unidentifiable Models (1974)The Measurement of Observer Agreement for Categorical Data (1977)Development and use of a gold-standard data set for subjectivity classifications (1999)CrowdER (2012)Agnostic Learning with Unknown Utilities (2016)Kappa coefficients in medical research (2002)Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure (2004)Measuring inter-rater reliability for nominal data – which coefficients and confidence intervals are appropriate? (2016)High agreement but low kappa: II. Resolving the paradoxes (1990)Bias, prevalence and kappa (1993)Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed (2010)A methodological framework for assessing health indices (1985)Interrater Reliability of the NIH Stroke Scale (1989)Reproducibility and responsiveness of health status measures statistics and strategies for evaluation (1991)Reliability of the Youth Risk Behavior Survey Questionnaire (1995)Reliability of the 1999 Youth Risk Behavior Survey Questionnaire (2002)Sequential Analysis and Observational Methods for the Behavioral Sciences (2011)Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): Initial Reliability and Validity Data (1997)Interrater reliability: the kappa statistic (2012)Content Analysis in Consumer Research (1977)Rethinking validity and reliability in content analysis (1999)Inter-Coder Agreement for Computational Linguistics (2008)Reliability of Nominal Data Based on Qualitative Judgments (1989)Measuring intercultural sensitivity: The intercultural development inventory (2003)
this work references cited by second hop· second hop is a sample of the most-cited connections

References

  • 1960A Coefficient of Agreement for Nominal Scales42,335 cited
  • 1990High agreement but low Kappa: I. the problems of two paradoxes3,024 cited
  • 1955Reliability of Content Analysis: The Case of Nominal Scale Coding1,849 cited
  • 1979Maximum Likelihood Estimation of Observer Error-Rates Using the EM Algorithm1,630 cited
  • 1981Coefficient Kappa: Some Uses, Misuses, and Alternatives1,575 cited
  • 1981Clinical biostatistics: LIV. The biostatistics of concordance1,088 cited
  • 1987MISINTERPRETATION AND MISUSE OF THE KAPPA STATISTIC808 cited
  • 1975The Reliability of Clinical Methods, Data and Judgments653 cited
  • 1975Measuring Agreement between Two Judges on the Presence or Absence of a Trait501 cited
  • 1988A rEAPPRAISAL OF THE KAPPA COEFFICIENT500 cited
  • 1985A Proposed Solution to the Base Rate Problem in the Kappa Statistic478 cited
  • 1981Reliability Studies of Psychiatric Diagnosis450 cited
  • 1979Ramifications of a Population Model for κ as a Coefficient of Reliability293 cited
  • 19892 x 2 Kappa Coefficients: Measures of Agreement or Association291 cited
  • 1980Extension of the Kappa Coefficient237 cited

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work

1985
Modeling Agreement Among Raters
162 cited

Cited by

  • 1999Validity of a Self-reported History of Doctor-diagnosed Angina168 cited
  • 2014Observer agreement paradoxes in 2x2 tables: comparison of agreement measures85 cited
  • 2000Statistical description of interrater variability in ordinal ratings81 cited
  • 2007Assessing observer agreement when describing and classifying functioning with the International Classification of Functioning, Disability and Health59 cited
  • 2012Factors affecting intercoder reliability: a Monte Carlo experiment44 cited
  • 1995Conditional inference for subject‐specific and marginal agreement: Two families of agreement measures43 cited
  • 2008Assessing Agreement between Multiple Raters with Missing Rating Information, Applied to Breast Cancer Tumour Grading29 cited
  • 2005Chance-corrected measures of reliability and validity in K K tables29 cited
  • 2001Estimating equations for kappa statistics29 cited
  • 1999Generalization of the Kappa coeficient for ordinal categorical data, multiple observers and incomplete designs28 cited
  • 2022Robustness of κ‐type coefficients for clinical agreement26 cited
  • 2003The syntax-discourse interface: effects of the main-subordinate distinction on attention structure25 cited
  • 2005Assessing the reliability of ordered categorical scales using kappa-type statistics24 cited
  • 1995Modelling covariate effects in observer agreement studies: The case of nominal scale agreement19 cited
  • 2006[Comparative analysis of three approaches for rater agreement].15 cited
  • 2008Chance-Corrected Measures of Reliability and Validity in 2 × 2 Tables12 cited