Articlediamond2010

Quantitative Methods for Estimating the Reliability of Qualitative Data

Jason W. Davey · P. Cristian Gugiu · Chris L. S. Coryn

49 citations0/0 files storedJournal of MultiDisciplinary Evaluation

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Reliability and Agreement in Measurement Qualitative Research Methods and Applications Computational and Text Analysis Methods

Abstract

Background: Measurement is an indispensable aspect of conducting both quantitative and qualitative research and evaluation. With respect to qualitative research, measurement typically occurs during the coding process. Purpose: This paper presents quantitative methods for determining the reliability of conclusions from qualitative data sources. Although some qualitative researchers disagree with such applications, a link between the qualitative and quantitative fields is successfully established through data collection and coding procedures. Setting: Not applicable. Intervention: Not applicable. Research Design: Case study. Data Collection and Analysis: Narrative data were collected from a random sample of 528 undergraduate students and 28 professors. Findings: The calculation of the kappa statistic, weighted kappa statistic, ANOVA Binary Intraclass Correlation, and Kuder-Richardson 20 is illustrated through a fictitious example. Formulae are presented so that the researcher can calculate these estimators without the use of sophisticated statistical software.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 49 citations exist upstream.

References

1977The Measurement of Observer Agreement for Categorical Data 1994Qualitative Data Analysis: An Expanded Sourcebook 1985Naturalistic inquiry 1984Content Analysis: An Introduction to its Methodology.2019Content Analysis: An Introduction to Its Methodology 1979Review of Psychometric theory (2nd ed.).1968Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.1971Measuring nominal scale agreement among many raters.

Cited by

2019The role of intermediaries in establishing a sustainable supply chain 2018What do nurses say about their English language needs for patient care and their ESP coursework: The case of Taiwanese nurses 2014Effectiveness of feedback for enhancing English pronunciation in an ASR‐based CALL system 2015Accessing quality early care and education for children in child welfare: Stakeholders' perspectives on barriers and opportunities for interagency collaboration 2021Designing an internet‐based intervention for improving wellbeing in people with acquired vision loss: A Delphi consensus study

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.