Using Cognitive Interviews to Develop Surveys in Diverse Populations

Anna M. Nápoles‐Springer · Jasmine Santoyo‐Olsson · Helen O Brien · Anita L. Stewart

160 citations0/0 files storedMedical Care

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Survey Methodology and Nonresponse Psychometric Methodologies and Testing Health Education and Validation

Abstract

BACKGROUND: Conceptual equivalence of measures is essential in research that compares health across diverse racial/ethnic groups. Cognitive interviews are pretest methods to explore the conceptual equivalence of survey items. Systematic approaches for using these methods are emerging. OBJECTIVE: We describe an interaction analysis (IA) approach using qualitative data analysis software to analyze transcripts of cognitive interviews in a study to develop a survey instrument of the quality of interpersonal processes of care of diverse patients. Cognitive interviews included standard administration of the survey followed by retrospective probes for selected items. SUBJECTS: Interviews were completed with 48 Latino, black, and non-Latino white respondents 18 years of age or older with at least one doctor's visit in the past 12 months. Participants averaged 45.8 years in age (standard deviation [SD] = 18.4), 58% were women, and mean education was 14.7 years (SD = 4.0). RESULTS: Problems were identified in 126 of 159 items (79%). Behavior coding identified 32 problematic items (20%). IA of the transcript of the survey and retrospective probes identified 94 additional problematic items (59%). IA often revealed the nature of the problems, enabling decisions to modify or drop items based on respondents' comments. Behavior coding and IA identified ethnic and language similarities and differences in the use of response sets and the interpretation of items. CONCLUSIONS: IA and behavior coding of cognitive interview transcripts can identify efficiently problems with items and their source to increase the likelihood of the revised items being conceptually equivalent across ethnic groups.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 160 citations exist upstream.

References

2000The Psychology of Survey Response 1995Thinking About Answers: The Application of Cognitive Processes to Survey Methodology 1995Improving Survey Questions: Design and Evaluation 2004Methods for Testing and Evaluating Survey Questionnaires 2004Methods for Testing and Evaluating Survey Questions 1997Improving question wording in surveys of culturally diverse populations 2004Survey Questionnaire Translation and Assessment 1989Cognitive research improves questionnaires.

Cited by

2011Cross-Cultural Cognitive Interviewing 2015The Practice of Cross-Cultural Cognitive Interviewing 2019PSYCHOMETRIC PROPERTIES OF MEASUREMENT INSTRUMENTS: CONCEPTUAL BASIS AND EVALUATION METHODS - PART II 2023“It's More Of A Me-Thing Than An Evolution Thing”: Exploring The Validity Of Evolution Acceptance Measures Using Student Interviews

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.