BACKGROUND
Many studies have shown that robots can provide medical help to patients, such as supporting physical movements, managing mood, or simulating cognitive function. However, robotic cognitive/language assessment, which is vital for mental health care, has not been fully explored and is limited to only a few types of assessment.
OBJECTIVE
The aim of this study is to present and evaluate a social robot equipped with a web-based language assessment for sentence comprehension test (SCT) with a dialogue system involving yes/no questions.
METHODS
A total of 50 participants took a SCT with 36 items conducted by a robot (robot SCT), while a total of 55 participants took the same test but conducted by a human examiner (human SCT). Comparative analyses were performed to evaluate the feasibility of the robot SCT in terms of SCT score and time-related measures. The system usability score (SUS) and interview feedback were also analyzed to assess the usability of the robot SCT.
RESULTS
In terms of the feasibility of the robot SCT, the SCT scores showed that there was no significant difference between the robot SCT and human SCT group. Also, there were conditional differences in reaction time for the test items, similar to that of the paper-and-pencil SCT in previous research. The high SUS scores (i.e., mean 78.5, SD 11) demonstrated the high usability of the robot SCT.
CONCLUSIONS
This study demonstrates the feasibility and usability of robotic language assessment among normal individuals. Further evaluation is needed in people with dementia or mild cognitive impairment.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.