Citation map · Study

SZodixStudyAcademic Library

Shelves Open access

Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated

Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks

11 references·1 citing·32 second hop

FromToDepth

this work references cited by second hop

References

1960A Coefficient of Agreement for Nominal Scales42,335 cited
1971Measuring nominal scale agreement among many raters.8,717 cited
2021A Survey on Bias and Fairness in Machine Learning5,798 cited
2004Reliability in Content Analysis.2,158 cited
1955Reliability of Content Analysis: The Case of Nominal Scale Coding1,849 cited
2008Inter-Coder Agreement for Computational Linguistics1,661 cited
2004Reliability in Content Analysis: Some Common Misconceptions and Recommendations1,025 cited
1993Item Response Theory: Parameter Estimation Techniques.826 cited
2015The Unified and Holistic Method Gamma (γ) for Inter-Annotator Agreement Measure and Alignment70 cited
2014Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation65 cited
2012Manual Corpus Annotation: Giving Meaning to the Evaluation Metrics24 cited

Cited by

2023Evaluation of African American Language Bias in Natural Language Generation23 cited

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work