Usability Evaluation of an Offline Electronic Data Capture App in a Prospective Multicenter Dementia Registry (digiDEM Bayern): Mixed Method Study

Abstract

Background Digital registries have been shown to provide an efficient way of gaining a better understanding of the clinical complexity and long-term progression of diseases. The paperless method of electronic data capture (EDC) during a patient interview saves both time and resources. In the prospective multicenter project “Digital Dementia Registry Bavaria (digiDEM Bayern),” interviews are also performed on site in rural areas with unreliable internet connectivity. It must be ensured that EDC can still be performed in such a context and that there is no need to fall back on paper-based questionnaires. In addition to a web-based data collection solution, the EDC system REDCap (Research Electronic Data Capture) offers the option to collect data offline via an app and to synchronize it afterward. Objective The aim of this study was to evaluate the usability of the REDCap app as an offline EDC option for a lay user group and to examine the necessary technology acceptance of using mobile devices for data collection. The feasibility of the app-based offline data collection in the digiDEM Bayern dementia registry project was then evaluated before going live. Methods An exploratory mixed method design was employed in the form of an on-site usability test with the “Thinking Aloud” method combined with an online questionnaire including the System Usability Scale (SUS). The acceptance of mobile devices for data collection was surveyed based on five categories of the technology acceptance model. Results Using the “Thinking Aloud” method, usability issues were identified and solutions were accordingly derived. Evaluation of the REDCap app resulted in a SUS score of 74, which represents “good” usability. After evaluating the technology acceptance questionnaire, it can be concluded that the lay user group is open to mobile devices as interview tools. Conclusions The usability evaluation results show that a lay user group generally agree that data collecting partners in the digiDEM project can handle the REDCap app well. The usability evaluation provided statements about positive aspects and could also identify usability issues relating to the REDCap app. In addition, the current technology acceptance in the sample showed that heterogeneous groups of different ages with diverse experiences in handling mobile devices are also ready for the use of app-based EDC systems. Based on these results, it can be assumed that the offline use of an app-based EDC system on mobile devices is a viable solution for collecting data in a decentralized registry–based research project.

Internet-Based Psychological Interventions during SARS-CoV-2 Pandemic: An Experience in South of Italy

“…An innovative approach used in this study is the usability and functionality evaluation of the online solution by using technological tools (smartphone and tablet for telephone and/or video-call), which reported very high values in the I-IG patients. These results could be compared to the results of other studies [33,34] that reported high user satisfaction scores for online health services.…”

Feasibility and Usability of the Job Adjustment Mobile App for Pregnant Women: Longitudinal Observational Study

“…Although the SUS score in this study was slightly lower than the average score of 68 for health care apps [ 38 ], it was maintained at above 50 points. In addition, the extracted usability issues were fewer than those in previous surveys [ 21 , 39 ] because we had conducted a preliminary test. The iterative usability evaluation strategy appeared to be effective.…”

Comparison of German Translations of the System Usability Scale – Which to Take?

“…The version of Lohmann and Schäffer is used in different projects to measure their users satisfaction or the usability of their system [19,20]. The German translation of Gao et al was used for example to evaluate the usability of a data capture app [21] or to determine the feasibility of exergames in rehabilitation [22].…”