In this chapter we consider the measurement of interrater agreement when the ratings are on categorical scales. First, we discuss the case of the same two raters per subject. Next, we consider weighted kappa to incorporate a notion of distance between rating categories, followed by the case of multiple ratings per subject with different sets of raters. We discuss applications to other problems and then relate the results of the preceding sections to the theory presented in an earlier chapter on correlated binary variables. A problem solving section appears at the end of the chapter.
Stored only when both papers are in the corpus — 513 citations exist upstream.