Formative Usability Evaluation of a Three-Way Digital Healthcare System for the People with Disabilities and Their Caregivers: A Cross-Sectional Study

Abstract

During the COVID-19 pandemic, there was a growing awareness about the importance of building a health and safety net based on digital healthcare systems, such as ICT-based local community online services and patient monitoring technology. This study was conducted with the aim of evaluating the formative usability of a three-way digital healthcare system, which had been developed to build a health and safety net for people with disabilities and deriving the directions for system improvement in order for them to be used as basic data for further system enhancement. A formative usability evaluation of a three-way digital healthcare system was performed with the participation of 43 healthcare professionals, using the 10-item System Usability Scale (SUS) and five items for satisfaction evaluation. Each item was rated on a five-point Likert scale, with the result converted to a scale of 100. Analysis was performed using the average score and the acceptable system usability level. The overall mean SUS score was 62.4, which corresponds to Grade D according to the SUS grading scale, and the below-average items were complexity (Q2), convenience (Q8), simplicity (Q3), professionalism (technician support, prior learning) (Q4, Q10), and learnability (Q7). The overall mean user satisfaction was 71.2 points, where overall satisfaction, system architecture and understandability, and continuous use intention were marked with below-average scores. The SUS D grade is interpreted as “fair” and the water solubility is “almost acceptable”. For the usability enhancement of the newly developed a three-way digital healthcare system, the overall direction for system architecture improvement was analyzed centering on complexity (Q2), convenience (Q8), professionalism (technician support, prior learning) (Q4, Q10), learnability (Q7), and simplicity (Q3). Efforts need to be directed at enhancing system satisfaction and continuance rate by deriving detailed system improvement strategies and achieving system enhancement to reflect the opinions of not only experts but also users.

ChatGPT-3.5 System Usability Scale early assessment among Healthcare Workers: Horizons of adoption in medical practice

“…That score is interpreted according to Usability.gov website and previous literature as high marginal acceptability of the ChatGPT system ( Fig. 2 Appendix) [ 24 , [41] , [42] , [43] ]. The overall score was further dissected into 2 domains, ease of use (Questions 2,4,6,8,10) with mean score 34.1/50, SD 8.77 [ 44 ].…”

Usability Evaluation for Mobile Health Application: Systematic Literature Review

“…Applications for Type 2 Diabetes Mellitus (T2DM) patients help control their health condition. [80] Three-Way Digital Healthcare System An application designed to monitor the health status of people with disabilities. [81] MHealth Application for Albinism The mobile app created and evaluated in the present research, which aims to help individuals with albinism manage their condition, could serve as a supplementary tool alongside other medical approaches like medication and psychological therapies, resulting in time and cost savings.…”

“…A fresh collection of usability principles for mHealth apps (UGmHA) has been formulated using Quinones et al's structured approach, encompassing seven phases commencing from the Exploratory phase and concluding with the Refining phase. [25], [31], [32], [34], [37], [38], [43], [48], [51], [55], [58], [65], [68], [72], [75], [77], [78] ScreenMen app to improve health screening uptake in men; Squire is a Web-based app to improve the speed and efficiency in reaching the appropriate team member during the care of a hospitalized patient 7 3 [5], [8], [15], [23], [30], [33], [35], [36], [39], [40], [41], [42], [44], [46], [53], [61], [67], [79], [80] Self…”

“…diabetes system [12] Evaluating usability issues [8] Describe the development and usability of mobile applications [50] Measure and compare the usefulness of an online consumer drug information system (OCMIS) [51] Society for Pediatric Anesthesia Pedi Crisis. Mobile Application Development and Usability Testing [53] Assess the usability, perceived usefulness, and acceptability of the m-Rehab system [54] To investigate the usability of an m-Health intervention (LIFE4YOUth) [55] Develop and test the usability of the PL mobile app directory [56] Evaluating the usability of the m-Health P and W applications [58] Determining the use of mobile applications [59] Report usability testing of a Drug Error Reporting Application (MERA) [61] Rate the usability and acceptance of the NoObesity app [62] Assessing the usefulness of swallowing training applications quantitatively and qualitatively [64] Determining the feasibility of commercially available applications [65] Assess user experience [66] Describe the development and assess the usefulness of HOCOS [68] Conduct usability testing studies [69] Explore the usability of the app [70] Develop, design, and test the acceptability, learning ability, heuristics, and usability of MindClimb [71] Evaluating the acceptability and usability of the m-Health system [15] Field user experience testing is carried out [72] develop mobile applications and e plore the patient's perceived usefulness of the application [73] Evaluating the utility and usability of ScreenMen [74] Design and develop Squire and evaluate the use [75] Evaluating the feasibility of a mobile health (m-Health) intervention [78] Evaluating the feasibility and usability of the application [80] Evaluating the formative usability of a three-way digital healthcare system [81] Evaluating the feasibility and usability of the application for albinism selfmanagement…”