Articlegreen2009

Reliability Concerns in the Repeated Computerized Assessment of Attention in Children

T. Andrew Zabel · Christian von Thomsen · Carolyn A. S. Cole · Rebecca B. Martin · E. Mark Mahone

34 citations0/0 files storedThe Clinical Neuropsychologist

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Developmental and Educational Neuropsychology Attention Deficit Hyperactivity Disorder Psychological Testing and Assessment

Abstract

Assessment of attentional processes via computerized assessment is frequently used to quantify intra-individual cognitive improvement or decline in response to treatment. However, assessment of intra-individual change is highly dependent on sufficient test reliability. We examined the test-retest reliability of selected variables from one popular computerized continuous performance test (CPT)-i.e., the Conners' CPT - Second Edition (CPT-II). Participants were 39 healthy children (20 girls) ages 6-18 without intellectual impairment (mean PPVT-III SS = 102.6), LD, or psychiatric disorders (DICA-IV). Test-retest reliability over the 3-8 month interval (mean = 6 months) was acceptable (Intraclass Correlations [ICC] =.82 to.92) on comparison measures (Beery Test of Visual Perception, WISC-IV Block Design, PPVT-III). In contrast, test-retest reliability was only modest for CPT-II raw scores (ICCs ranging from.62 to.82) and T-scores (ICCs ranging from.33 to.65) for variables of interest (Omissions, Commissions, Variability, Hit Reaction Time, and Attentiveness). Using test-retest reliability information published in the CPT-II manual, 90% confidence intervals based on reliable change index (RCI) methodology were constructed to examine the significance of test-retest difference/change scores. Of the participants in this sample of typically developing youth, 30% generated intra-individual changes in T-scores on the Omissions and Attentiveness variables that exceeded the 90% confidence intervals and qualified as "statistically rare" changes in score. These results suggest a considerable degree of normal variability in CPT-II test scores over extended test-retest intervals, and suggest a need for caution when interpreting test score changes in neurologically unstable clinical populations.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 34 citations exist upstream.

References

2013Diagnostic and Statistical Manual of Mental Disorders 1986STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT 2022Diagnostic and Statistical Manual of Mental Disorders 1991Clinical significance: A statistical approach to defining meaningful change in psychotherapy research.1991Clinical significance: A statistical approach to defining meaningful change in psychotherapy research.1975Four Factor Index of Social Status 1991A compendium of neuropsychological tests: administration, norms, and commentary 1975Four Factor Index of Social Status [1975]

Cited by

2016Exploring the Role of Executive Functioning Measures for Social Competence Research

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.