Potential effectiveness and efficiency issues in usability evaluation within digital health: A systematic literature review

Maqbool, Bilal; Herold, Sebastian

doi:10.1016/j.jss.2023.111881

Cited by 11 publications

(7 citation statements)

References 110 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Addressing the complexity of the evaluation process, our proposed method prioritizes heuristics to manage the exhaustive nature of assessments involving a higher number of heuristics. By organizing the evaluation sequence based on heuristic relevance, as determined by the Usability Testing Leader, we enhance the efficiency and focus of the assessment process [9,19]. This prioritization ensures that evaluators concentrate on the most critical aspects early on, reducing the risk of fatigue and potential bias towards the end of the evaluation.…”

Section: Discussionmentioning

confidence: 99%

“…inquiry) and quantitative or so-called testing-based approaches presents several challenges [18]. The technology developers need to balance expert-driven insights from heuristic evaluations with user-centric data from tools like usability measurement estimations, requiring an intricate understanding of both approaches [19]. Qualitative methods, rich in contextual information, can be subjective.…”

Section: Of 24mentioning

confidence: 99%

See 1 more Smart Citation

Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment

Talero-Sarmiento,

Gonzalez-Capdevilla,

Granollers

et al. 2024

Preprint

View full text Add to dashboard Cite

This study delves into the realm of heuristic evaluation within usability testing, focusing on refining and applying a tailored algorithm that simplifies the implementation of the Analytic Hierarchy Process for heuristic prioritization. Addressing the prevalent challenge of disparate evaluation methodologies and the absence of a standardized process in usability testing, our research introduces a novel method that leverages the Analytic Hierarchy Process alongside a bespoke algorithm. This algorithm utilizes transitive properties for pairwise comparisons, significantly reducing the evaluative workload. This innovative approach facilitates the estimation of heuristic relevance irrespective of the number of items per heuristic or the item scale and streamlines the overall evaluation process. In addition to rigorous simulation testing of the tailored algorithm, we applied our method in a practical scenario, engaging seven usability experts in evaluating a web interface. This empirical application underscored our method’s capacity to diminish the requisite comparison count and spotlight areas of improvement for critically weighted yet underperforming heuristics. The outcomes of this study underscore the efficacy of our approach in enhancing the efficiency and organization of heuristic evaluations, paving the way for more structured and effective usability testing methodologies in future research endeavors.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Of 24mentioning

confidence: 99%

Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment

Talero-Sarmiento,

Gonzalez-Capdevilla,

Granollers

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

“…VR-based rehabilitation by therapists is explained by eight attributes, namely learnability (easy to learn the system), appropriateness or usefulness (suitability of the product or system according to the patient's need), effectiveness (accuracy and completeness by patients in achieving specified goals), efficiency (efficient system use for high-level productivity), memorability (easy to remember system functions), patient error protection and recovery (degree of protection against errors by the system), satisfaction (the system should be pleasant and acceptable), and operability (ability to control and operate the system software) [16,17].…”

Section: Usability For Therapists: Enhancing Efficiency and Effective...mentioning

confidence: 99%

The Dual Importance of Virtual Reality Usability in Rehabilitation: A Focus on Therapists and Patients

Naqvi,

Mishra

et al. 2024

Cureus

View full text Add to dashboard Cite

Virtual reality (VR) has advanced in medical education and rehabilitation from basic graphical applications due to its ability to generate a virtual three-dimensional (3D) environment. This environment is mostly used to practice professional skills, plan surgery procedures, simulate surgeries, display 3D anatomy, and rehabilitate various disorders. VR has transformed the field of rehabilitation therapy by providing immersive and engaging experiences that go beyond traditional bounds, significantly improving patient care and therapeutic results. Considering the direct impact of VR on the efficacy of the treatment for both therapists and patients, its dual significance for usability and user experience cannot be overstated. The purpose of this article is to determine the synergistic association between VR accessibility and the rehabilitation process, highlighting the significance of VR technology in designing the future of rehabilitation therapy and demonstrating how advancing VR technology can improve therapeutic outcomes despite overcoming obstacles encountered during VR usage. In conclusion, VR offers a personalized, efficient, interesting, and engaging rehabilitative environment for patients, while also assisting therapists in cultivating empathy and efficiency and encouraging innovative approaches in treatment procedures.

show abstract

“…With features such as current weather forecasts, long-term weather forecasts, tsunami warnings and earthquake warnings, Info BMKG is critical in maintaining the safety of many people (Ilham Fannani et al, 2023). Therefore, it is essential to ensure that the BMKG Info application provides a satisfactory user experience (UX) and guarantees the efficient and accurate presentation of critical information, supporting the need for reliable information in emergency situations (Maqbool & Herold, 2024).…”

Section: Introductionmentioning

confidence: 99%

Optimizing User Satisfaction: A Comprehensive Evaluation of the Info BMKG App Using UEQ+ and IPA Methods

Ariyanto,

Ruldeviyani,

Dharmawan

et al. 2024

IJEC

View full text Add to dashboard Cite

An update to the appearance of the BMKG Info app in November 2022 led to a 0.26 drop in the monthly rating, suggesting that the change may not have met users' expectations. This study aims to identify the cause of the rating drop through a user experience (UX) assessment involving 1,237 app users. Using the User Experience Questionnaire Plus (UEQ+) and Importance Performance Analysis (IPA), this study collected and analyzed user feedback related to five aspects of UX: efficiency, novelty, usability, trust in content, and clarity. IPA results show that efficiency is a highly important but underperforming aspect, indicating that interface updates reduce efficiency and negatively impact user satisfaction. Recommendations include prioritizing efficiency improvements, usability evaluations, collecting additional feedback, and using IPA data to drive improvement priorities. The findings of this study contribute to the field of science by demonstrating the importance of a comprehensive UX analysis for updated apps. For future research, it is recommended to conduct longitudinal studies to monitor changes in user satisfaction over time and explore innovative methods to improve the overall user experience.

show abstract

Potential effectiveness and efficiency issues in usability evaluation within digital health: A systematic literature review

Cited by 11 publications

References 110 publications

Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment

Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment

The Dual Importance of Virtual Reality Usability in Rehabilitation: A Focus on Therapists and Patients

Optimizing User Satisfaction: A Comprehensive Evaluation of the Info BMKG App Using UEQ+ and IPA Methods

Contact Info

Product

Resources

About