Mobile facial affect recognition and real-time social experiences in serious mental illness

Parrish, Emma M.; Lin, Jizhen; Scott, Vanessa; Pinkham, Amy E.; Harvey, Philip D.; Moore, Raeanne C.; Ackerman, Robert A.; Depp, Colin A.

doi:10.1016/j.scog.2022.100253

Cited by 2 publications

(1 citation statement)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There have been several impressive smartphone-based studies exploring cognition, but the focus has largely been on finding correlations between individual smartphone assessments and their gold-standard counterparts. For example, prior studies have reported high correlations between smartphone-based metrics related to emotion recognition [ 7 ], the Stroop and letter-verbal fluency test [ 8 ], Hopkins Verbal Learning Test [ 9 ], facial recognition affect [ 10 ], and Trails A/B test [ 11 – 13 ]. Building off these impressive results, we now explore the role of smartphone-based assessments of cognition beyond feasibility and across diverse settings in the United States and India.…”

Section: Introductionmentioning

confidence: 99%

Digital phenotyping correlates of mobile cognitive measures in schizophrenia: A multisite global mental health feasibility trial

Cohen,

Joshi,

Bondre

et al. 2024

PLOS Digit Health

View full text Add to dashboard Cite

Traditional cognitive assessments in schizophrenia are time-consuming and necessitate specialized training, making routine evaluation challenging. To overcome these limitations, this study investigates the feasibility and advantages of utilizing smartphone-based assessments to capture both cognitive functioning and digital phenotyping data and compare these results to gold standard measures. We conducted a secondary analysis of data from 76 individuals with schizophrenia, who were recruited across three sites (one in Boston, two in India) was conducted. The open-source mindLAMP smartphone app captured digital phenotyping data and Trails A/B assessments of attention / memory for up to 12 months. The smartphone-cognitive tasks exhibited potential for normal distribution and these scores showed small but significant correlations with the results from the Brief Assessment of Cognition in Schizophrenia, especially the digital span and symbol coding tasks (r2 = 0.21). A small but significant correlation (r2 = 0.29) between smartphone-derived cognitive scores and health-related behaviors such as sleep duration patterns was observed. Smartphone-based cognitive assessments show promise as cross-cultural tools that can capture relevant data on momentary states among individuals with schizophrenia. Cognitive results related to sleep suggest functional applications to digital phenotyping data, and the potential of this multimodal data approach in research.

show abstract