Validity and reliability of a computerized cognitive function evaluation battery (CogEvo) as a screening tool

Abstract

Aim:The aim of this study was to determine the validity and reliability of cognitive function evaluation battery, CogEvo, a recently developed computerized cognitive function evaluation battery, as a screening tool for decreased cognitive function. Methods:The study sample comprised 123 (age: 57-97 years) community-dwelling elderly people. They were required to perform five CogEvo tasks and complete two questions-based neuropsychological tests, including the Mini-Mental State Examination, so that the correlations could be analyzed. The validity and reliability of CogEvo were examined using factor analysis, MacDonald's omega reliability coefficient, logistic regression analysis, and receiver operating characteristic curve analysis.Results: Exploratory factor analysis revealed the orientation/spatial cognitive function (orientation and spatial cognition) and attention/executive function (attention, memory, and execution) factors. Structural validity was supported by confirmatory factor analysis.All two-factor-based subtasks showed adequate internal consistency (MacDonald's omega ≥0.6). The total CogEvo score and two-factor scores were significantly correlated with neuropsychological test results. Based on the total CogEvo score, the cognitively normal and cognitive decline groups were identified by receiver operating characteristic curve analysis with a moderate predictive performance. The cognitive decline group was well identified using the orientation/spatial cognitive function factor.Conclusions: CogEvo is a valid and reliable screening tool for cognitive function evaluation. It proved useful in the early identification of cognitive decline in our study sample.

Assessment of Mild Cognitive Impairment Using CogEvo: A Computerized Cognitive Function Assessment Tool

“…Participants completed 5 subcategories of CogEvo tasks used in the previous study (Same shape, Orientation, Flashlight, Route 99, and Follow the order; Supplemental Figure 1 ). 14 , 16 , 17 After the test, the computer automatically calculated results based on the number of correct answers and response time using the development company’s proprietary formula. If all 5 tasks have high scores, it is determined that the functions and abilities reflected by each task are high.…”

“…Comprising 12 tasks, 17 CogEvo has undergone validation for the 1-dimensionality, structural and construct validity, and reliability of its core 5 tasks, including “Same shape,” “Orientation,” “Flash light,” “Route 99,” and “Follow the order,” as described later. 14 As demonstrated in Supplemental Figure 1 , these core tasks share many similarities with traditional neuropsychological tests. Participants engage with each task for approximately 10 min using simple finger manipulations, and scoring and recording are automatically conducted on a computer, eliminating the absolute necessity for a skilled examiner.…”

“… 8 - 11 However, these tests, although advantageous for their short duration (approximately 10 min), 12 are prone to ceiling effects (situation where a measurement tool reaches its upper limit of sensitivity, making it unable to differentiate effectively among high-performing individuals) due to their maximum 30-point deduction system, 9 - 11 and their susceptibility to educational bias has been suggested. 10 , 13 , 14 Moreover, requiring skilled evaluators (physicians or psychologists) makes them suitable for hospital assessments but less practical for large-scale health assessments conducted in the community as part of dementia prevention policies. Considering the nature of the test items, they are not designed for reliable assessments at short intervals such as daily or weekly, and their characteristics do not support frequent evaluations (eg, patients remembering test content and answers, hindering accurate status assessment).…”

“…In Japan, where both aging and declining birth rates are ongoing, the proportion of elderly individuals among healthcare professionals is expected to increase. 14 Relying solely on conventional methods may become challenging for adequately assessing age-related cognitive decline, MCI, and mild dementia in the elderly.…”

“…CogEvo (CogEvo ® , Total Brain Care Co. Ltd, Kobe, Japan) is a computerized cognitive assessment tool developed in Japan in 2017, serving as a cloud service for cognitive assessment and training. 14 , 16 , 17 It can be administered on both stationary monitor screens and tablet screens. Comprising 12 tasks, 17 CogEvo has undergone validation for the 1-dimensionality, structural and construct validity, and reliability of its core 5 tasks, including “Same shape,” “Orientation,” “Flash light,” “Route 99,” and “Follow the order,” as described later.…”