Inattentive responding can induce spurious associations between task behaviour and symptom measures

Samuel Zorowitz · Johanne Solis · Yael Niv · Daniel Bennett

97 citations0/0 files storedNature Human Behaviour

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Survey Methodology and Nonresponse Mobile Crowdsensing and Crowdsourcing Mental Health Research Topics

Abstract

Although online samples have many advantages for psychiatric research, some potential pitfalls of this approach are not widely understood. Here we detail circumstances in which spurious correlations may arise between task behaviour and symptom scores. The problem arises because many psychiatric symptom surveys have asymmetric score distributions in the general population, meaning that careless responders on these surveys will show apparently elevated symptom levels. If these participants are similarly careless in their task performance, this may result in a spurious association between symptom scores and task behaviour. We demonstrate this pattern of results in two samples of participants recruited online (total N = 779) who performed one of two common cognitive tasks. False-positive rates for these spurious correlations increase with sample size, contrary to common assumptions. Excluding participants flagged for careless responding on surveys abolished the spurious correlations, but exclusion based on task performance alone was less effective.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 97 citations exist upstream.

References

2006A Brief Measure for Assessing Generalized Anxiety Disorder 2009A typology of reviews: an analysis of 14 review types and associated methodologies 1994Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales.1990Development and validation of the penn state worry questionnaire 2008Validation and Standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the General Population 2012Twelve‐month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States 2007Empirical, Theoretical, and Practical Advantages of the HEXACO Model of Personality Structure 1995A Scale for the Assessment of Hedonic Tone the Snaith–Hamilton Pleasure Scale

Cited by

2025Excessive flexibility? Recurrent neural networks can accommodate individual differences in reinforcement learning through in-context adaptation 2025Excessive flexibility? Recurrent neural networks can accommodate individual differences in reinforcement learning through in-context adaptation

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.