Ultra-brief Ambulatory Assessment of Working Memory Capacity via Smart Phones

Abstract

The development of mobile technology with substantial computing power (i.e. smart phones) has enabled the adaptation of performance-based cognitive assessments to remote administration and novel intensive longitudinal study designs (e.g. measurement burst designs). While an “ambulatory” cognitive assessment paradigm provides new opportunities to extend current psychological theories, the adaptation of conventional measures to a mobile format conducive to intensive repeated measurement involves balancing measurement precision, administration time, and procedural consistency. Across 3 studies, we developed mobile adaptations of computerized ‘complex span’ tasks to assess working memory capacity (WMC) and examined their validity, reliability, and sufficiency. Study 1 examined the convergent and criterion validity of a single administration of 3 ultra-brief complex span tasks on smart phones in a laboratory setting (ambulatory Operation Span, Symmetry Span, and Rotation Span tasks). Study 2 adapted the ultra-brief tasks to a 4-day measurement burst design where between- and within-person reliability was assessed over 16 repeated administrations (4 assessments/day). Study 3 involved the implementation of a single ultra-brief complex span task into a 7-day measurement burst design field study involving college students (5 assessments/day). Results of these 3 studies suggest that valid and highly reliable estimates of WMC can be obtained via smart phones, in the absence of intensive onboarding/training, in 3-6 minutes of total testing time (2 ultra-brief, mobile administrations). Considerations for future mobile cognitive assessment design and parameterization are discussed.

Variability in Cognitive Performance on Mobile Devices Is Sensitive to Mild Cognitive Impairment: Results From the Einstein Aging Study

“…Our smartphone-based digital health approach leveraged the innovative platform Mobile Monitoring of Cognitive Change, or M2C2. Part of the larger NIH Mobile Toolbox project, the M2C2 platform is currently in the development, validation, and norming phase with testing underway across a wide range of samples and study designs [e.g., ( 27 , 31 )]. See www.mobiletoolbox.org for additional information about the forthcoming NIH Mobile Toolbox.…”

“…In the present study we leverage the Mobile Monitoring of Cognitive Change (M2C2) platform, an innovative mobile platform funded by the NIH for EMA-based delivery of ultra-brief mobile cognitive testing. M2C2, currently in the development, validation, and norming phase [e.g., ( 27 , 31 )], enables our digital health approach to assess cognitive performance under naturalistic circumstances multiple times per day, across multiple days.…”

Ambulatory Assessment in Concussion Clinical Care and Rehabilitation

“…Our approach intends to improve assessment and monitoring by conducting short surveys and ultra-brief cognitive assessments (typically <60 s) on smart phones in a measurement burst design ( 24 – 27 ). By delivering these assessments remotely, and over the course of participants' daily lives, we hope to capture a more accurate representation of patients' everyday experiences including the frequency and duration of exposures to various, potentially symptom-modifying, environments ( 28 , 29 ).…”

“…An advantage of conducting ambulatory cognitive assessments in such an intensive, longitudinal study design protocol is the ability to distribute an equivalent or greater amount of overall testing that would be completed in the clinic, over the course of a week between visits. Separating performance-based assessments from the clinical environment allows patients to complete the assessments in more familiar surroundings (e.g., home or school), increasing the ecological validity of the testing context ( 24 , 27 ). For example, some patients exhibit significant anxiety related to completing neurocognitive testing for their concussion and discussing their symptoms with the clinician.…”