Recent Issues Regarding rWG, rWG, rWG(J), and rWG(J)

James M. LeBreton · Lawrence R. James · Michael K. Lindell

118 citations0/0 files storedOrganizational Research Methods

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Reliability and Agreement in Measurement Psychometric Methodologies and Testing Delphi Technique in Research

Abstract

A recent article by Lindell and Brandt raised two concerns regarding the use of James, Demaree, and Wolf’s interrater agreement indices r WG and r WG(J) . First, they noted that the multi-item rWG(J) equation is mathematically equivalent to inserting r WG into the Spearman-Brown prophecy formula and questioned whether applying a formula developed for a reliability index was also appropriate for an agreement index. Second, they questioned the appropriateness of James et al.’s suggestion of replacing obtained negative values of r WG with zeros. This article addresses these concerns by demonstrating that r WG(J) can be derived independently from the Spearman-Brown prophecy formula and that negative values of r WG can be avoided by reparameterizing the structural equation underlying the data when there is systematic disagreement between subgroups of raters.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 118 citations exist upstream.

References

1984Estimating within-group interrater reliability with and without response bias.1993rwg: An assessment of within-group interrater agreement.1950Theory of Mental Tests 1992A disagreement about within-group agreement: Disentangling issues of consistency versus consensus.1999A Revised Index of Interrater Agreement for Multi-Item Ratings of a Single Target 2001Statistical properties of the rWG(J) index of agreement.

Cited by

2006Leader–member exchange in teams: An examination of the interaction between relationship differentiation and mean LMX in explaining team-level outcomes 2016Psychopathy and Machiavellianism: A Distinction Without a Difference?2009Why People Do What They Do to Protect Against Earthquake Risk: Perceptions of Hazard Adjustment Attributes 2012The Structural Context of Team Learning: Effects of Organizational and Team Structure on Internal and External Learning 2007On what should firms focus in transitional economies? A study of the contingent value of strategic orientations in China 2017Socially Responsible Human Resource Management and Employee Support for External CSR: Roles of Organizational CSR Climate and Perceived CSR Directed Toward Employees

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.