We investigated whether standardized neuropsychological tests and experimental cognitive paradigms measure the same cognitive faculties. Specifically, do neuropsychological tests commonly used to assess attention measure the same construct as attention paradigms used in cognitive psychology and neuroscience? We built on the “general attention factor”, comprising several widely used experimental paradigms (Huang et al., 2012). Participants (n = 636) completed an on-line battery (TestMyBrain.org) of six experimental tests [Multiple Object Tracking, Flanker Interference, Visual Working Memory, Approximate Number Sense, Spatial Configuration Visual Search, and Gradual Onset Continuous Performance Task (Grad CPT)] and eight neuropsychological tests [Trail Making Test versions A & B (TMT-A, TMT-B), Digit Symbol Coding, Forward and Backward Digit Span, Letter Cancellation, Spatial Span, and Arithmetic]. Exploratory factor analysis in a subset of 357 participants identified a five-factor structure: (1) attentional capacity (Multiple Object Tracking, Visual Working Memory, Digit Symbol Coding, Spatial Span), (2) search (Visual Search, TMT-A, TMT-B, Letter Cancellation); (3) Digit Span; (4) Arithmetic; and (5) Sustained Attention (GradCPT). Confirmatory analysis in 279 held-out participants showed that this model fit better than competing models. A hierarchical model where a general cognitive factor was imposed above the five specific factors fit as well as the model without the general factor. We conclude that Digit Span and Arithmetic tests should not be classified as attention tests. Digit Symbol Coding and Spatial Span tap attentional capacity, while TMT-A, TMT-B, and Letter Cancellation tap search (or attention-shifting) ability. These five tests can be classified as attention tests.
Objective Cancer‐related cognitive impairments (CRCI) are frequently reported among cancer survivors, and attention is the most frequently assessed cognitive domain in CRCI. However, there is no consensus as to whether attention is impaired. We suggest that a major reason for this lack of agreement is a lack of construct validity for neuropsychological attention tests. We propose to assess the construct validity of neuropsychological attention tests with respect to experimental paradigms from cognitive psychology. Methods Self‐reported cancer survivors (N = 314) completed an online battery comprising six experimental attention paradigms and eight neuropsychological tests. Confirmatory factor analysis was used to evaluate the fit of five models derived from a general population sample (N = 636) in a previous study (M. Treviño, Cogn Res Princ Implic, in press). We then subjected the best‐fitting model to a measurement invariance analysis. Results The best‐fitting model was a six intercorrelated factor structure, comprising Capacity, Search, Digit Span, Arithmetic, Sustained Attention, and Flanker Interference factors. Configural and weak invariance held, indicating that the factor loadings were invariant across groups. Strong invariance, indicating that intercepts were also invariant, held except for the Approximate Number Sense test. Conclusions According to our factor model, Spatial Span and Digit Symbol Coding measure attentional capacity, while the Trail Making Test (A&B) and Letter Cancellation tests measure visual search ability. However, Digit Span and Arithmetic tests do not measure attention. We hope that these results will lead to better scientific models, better patient education, and, ultimately, improved outcomes for survivors.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.