Acquisition and evaluation of a human-robot elderly spoken dialog corpus for developing computerized cognitive assessment systems

Abstract

Personal communication robots are expected to assist daily living of elderly people. Aiming at developing computerized cognitive assessment systems, we collected human-robot spoken dialog of a cognitive impairment test scenario based on TICS (Telephone Interview for Cognitive Status) and COGNISTAT (Cognitive Status Examination) in Japanese. For the efficient acquisition of the spoken dialog corpus of this scenario, we implemented a WOz (Wizard of Oz) style spoken dialog system on a commercial personal robot, PaPeRo by NEC. By using this system, we collected 147 dialogs spoken by 48 elderlies whose ages varied about 75-85 and MMSE (Mini Mental State Examination) scores varied around 26.5. Each dialog took about 30 min, and contains around 100 human utterances. In order to evaluate feasibility of automatic assessment, we conducted speech recognition experiments with the speech corpus. In the recognition experiments of the elderly speech of answering to the temporal orientation test of asking today's month and date, the accuracies of discriminating correctness of the answers exceeds 80% by using speech dictation engines. This preliminary results show potential feasibilities for computerized cognitive assessment systems.

Assessment of Cognitive skills via Human-robot Interaction and Cloud Computing

“…However, it seems little work has been done regarding other pathologies. Kojima et al [22] , for instance, published some speech recognition experiments with elderly people using the robot PaPeRo, aimed at the development of a computerized cognitive assessment system.…”

Research on Multi-Domain Intelligent Customer Service Dialog Modeling with Integrated Transfer Learning Strategies

“…The platform evaluated the agent process to enhance the conceptual demonstration. Literature [19] designed a personal communication intelligent robot for daily life application scenarios of elderly people and utilized a dialog corpus to enhance the comprehension of machine conversations by cognitively impaired elderly people. Literature [20] created a communicating robot and explored the effect of the robot's height on the comfort of human-machine dialogue through participatory experiments, and the paper analyzed the guiding principles of human-machine communication with the help of differences in dialog boxes.…”

Social Robots as Psychometric Tools for Cognitive Assessment: A Pilot Test

“…However, it seems not much work has been done regarding other pathologies. Kojima et al [16], for instance, published some speech recognition experiments with elderly people using the robot PaPeRo, aimed at the development of a computerized cognitive assessment system. Therefore, at the best of our knowledge, robotic psychological assessment is almost unexplored.…”