Coding With R-PAS: Does Prior Training With the Exner Comprehensive System Impact Interrater Reliability Compared to Those Examiners With Only R-PAS-Based Training?

Jennifer H. Lewey · Trisha M. Kivisalu · Luciano Giromini

11 citations0/0 files storedJournal of Personality Assessment

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Psychological Testing and Assessment Psychometric Methodologies and Testing Reliability and Agreement in Measurement

Abstract

The Rorschach Inkblot Method (RIM) is a performance-based personality assessment instrument used in both clinical and research settings worldwide. This investigation examines response-level, interrater reliability of U.S. graduate students enrolled in the same doctoral program and divided into two unique participant groups: 20 of those with previous Comprehensive System (CS) training background who are now trained in Rorschach Performance Assessment System (R-PAS; initial coders N = 11, blind coders N = 9), and 19 of those trained solely with R-PAS (initial coders N = 10, blind coders N = 9). Trainees’ coding was analyzed based on a sample of 50 protocols (half per group) representing a total of 1,189 responses. Blind coding was used among trainees and coding between the two investigated training groups was analyzed for each variable at the response level and expressed as percent agreement, Gwet's AC, and kappa values. Rates of agreement between the trainees were similar across both groups, and most of the concordance rates can be characterized as excellent. Overall, these results suggest that trainees may learn how to code R-PAS variables with similar reliability levels whether or not they had prior CS knowledge.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 11 citations exist upstream.

References

1979Intraclass correlations: Uses in assessing rater reliability.1994Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.1990High agreement but low Kappa: I. the problems of two paradoxes 2002Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs.2006Computing inter‐rater reliability and its variance in the presence of high agreement 1996Meta-analysis of experiments with matched groups or repeated measures designs.2003Biostatistics 104: correlational analysis.2013A comparison of Cohen’s Kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samples

Cited by

2019Introducing the concept of neurobiological foundation of Rorschach responses using the example of Oral Dependent Language 2023Only an inkblot? A literature review of the neural correlates of the Rorschach inkblot test 2021Teaching the Rorschach Comprehensive System 2021How Reliably Can Examiners Make Form Quality (FQ) Judgments in the Absence of the Form Quality (FQ) Tables?

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.