Design and Usability Evaluation of Mobile Voice-Added Food Reporting for Elderly People: Randomized Controlled Trial

Abstract

Background Advances in voice technology have raised new possibilities for apps related to daily health maintenance. However, the usability of such technologies for older users remains unclear and requires further investigation. Objective We designed and evaluated two innovative mobile voice-added apps for food intake reporting, namely voice-only reporting (VOR) and voice-button reporting (VBR). Each app features a unique interactive procedure for reporting food intake. With VOR, users verbally report the main contents of each dish, while VBR provides both voice and existing touch screen inputs for food intake reporting. The relative usability of the two apps was assessed through the metrics of accuracy, efficiency, and user perception. Methods The two mobile apps were compared in a head-to-head parallel randomized trial evaluation. A group of 57 adults aged 60-90 years (12 male and 45 female participants) was recruited from a retirement community and randomized into two experimental groups, that is, VOR (n=30) and VBR (n=27) groups. Both groups were tested using the same set of 17 food items including dishes and beverages selected and allocated to present distinct breakfast, lunch, and dinner meals. All participants used a 7-inch tablet computer for the test. The resulting data were analyzed to evaluate reporting accuracy and time efficiency, and the system usability scale (SUS) was used to measure user perception. Results For eight error types identified in the experiment, the VBR group participants were significantly (P<.001) more error prone owing to the required use of button-tapping actions. The highest error rates in the VOR group were related to incomprehensible reporting speech (28/420, 6.7%), while the highest error rates in the VBR group were related to failure to make required button taps (39/378, 10.3%). The VOR group required significantly (P<.001) less time to complete food reporting. The overall subjective reactions of the two groups based on the SUS surpassed the benchmark and were not significantly different (P=.20). Conclusions Experimental results showed that VOR outperformed VBR, suggesting that voice-only food input reporting is preferable for elderly users. Voice-added apps offer a potential mechanism for the self-management of dietary intake by elderly users. Our study contributes an evidence-based evaluation of prototype design and selection under a user-centered design model. The results provide a useful reference for selecting optimal user interaction design. Trial Registration International Standard Randomized Controlled Trial Registry ISRCTN17335889; http://www.isrctn.com/ISRCTN17335889.

Automatic Assessment of Loneliness in Older Adults Using Speech Analysis on Responses to Daily Life Questions

“…In particular, for detecting individuals with high loneliness scores, the binary-classification model using acoustic features achieved the best accuracy. Although user-interface studies reported that voice input was effective and was preferable as an input modality for older adults (94)(95)(96), other studies reported that the performance of automatic speech recognition tended to be worse in older adults than in other age groups (97,98). Because we analyzed only speech data collected in a lab setting, we may need to consider the possibility that there would be a situation where automatic speech recognition would be difficult to use for extracting linguistic features from speech data collected in living situations.…”

Perspective on mHealth Concepts to Ensure Users’ Empowerment–From Adverse Event Tracking for COVID-19 Vaccinations to Oncological Treatment

“…the requirements of older people. This includes adaquetely adapted user interfaces [27,38], big fonts, auditory feedback [39,40], or additional input methods (i.e., voice input) which support their demands [26]. On these grounds, we developed the mHealth application called NEMO (Figure 5).…”

“…On these grounds, we intend to discuss a comprehensive workflow on different approaches and give a perspective on possible strategies to integrate mHealth applications into clinical care routines. Our workflow addresses the main requirements of both healthcare professionals and patients (Table 1) to ensure effective and safe inter-sectorial communication [11,23,24,25,26,27,28,29]. To address these issues and address concerns from patients and healthcare professionals, one must improve the digital patient-doctor communication and relationship.…”

Study on the Types of Elderly Intelligent Health Management Technology and the Influencing Factors of Its Adoption

“…Users are interested in core functions such as speed of running, reminders, notifications, encouragement, follow-up, goal setting, and online video presentation, and in the way they are provided [31,34,[64][65][66] Quality of information Information quality has a significant impact on older people's acceptance of intelligent health management technologies [22,67] Personalization Personalization is a key characteristic that enhances the attractiveness and acceptability of IHMT [35,41,[68][69][70][71] Interactivity Interactive games and healthcare worker or peer interactions can increase interest in older adults [5,17,26,27,45,58,62,[70][71][72] Perceived ease of use User interface design Devices with simple operation, large font, and touch screen interface are more popular [23,26,42,46,48,68,73,74] Efficiency Voice input design can improve time efficiency [75] Security…”

“…In terms of efficiency, the application of touch screens [42] and voice input [75] can facilitate the use by the elderly and improve the use efficiency.…”