LEMS OF ANALYST AND OBSERVER AGREEMENT IN NATURALISTIC NARRATIVE DATA

Myrtle Scott · JAMES G. HATFIELD

29 citations0/0 files storedJournal of Educational Measurement

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Reliability and Agreement in Measurement Psychometric Methodologies and Testing Behavioral and Psychological Studies

Abstract

The use of naturalistic narrative data is increasing but without increasing methodological rigor. Assumptions underlying such methods prohibit an investigator from interrupting the natural habitat by use of such standard laboratory procedures as equal observation intervals for all subjects, equal behavior units, or other artificial equalization of the behavioral data stream. Data analytic techniques commonly used in standard laboratory research present problems in the analysis of naturalistic data of this type inasmuch as most assume equal observation intervals, equal unit intervals, or some other fundamental character of equality. These problems are particularly acute with respect to estimates of analyst and observer agreement. This paper addresses these problems and discusses the advantages and disadvantages of several possible solutions.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 29 citations exist upstream.

References

1960A Coefficient of Agreement for Nominal Scales 1970Content Analysis for the Social Sciences and Humanities.1950Purposive Behavior in Animals and Men 1970Content Analysis for the Social Sciences and Humanities 1962The Handbook of Research on Teaching 1932Purposive Behavior in Animals and Men 1955Reliability of Content Analysis: The Case of Nominal Scale Coding 1982Problems of Reliability and Validity in Ethnographic Research

Cited by

2001Instruction begins in the home: Relations between parental instruction and children's self-regulation in the classroom.1994Thematic segmentation of psychotherapy transcripts for convergent analyses.1990Observational Methods 2002Children's Self-Regulatory Behaviors During Teacher-Directed, Seat-Work, and Small-Group Instructional Contexts

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.