A Training Smartphone Application for the Simulation of Outdoor Blind Pedestrian Navigation: Usability, UX Evaluation, Sentiment Analysis

Abstract

Training blind and visually impaired individuals is an important but often neglected aspect of Assistive Technology solutions (ATs) that can benefit from systems utilizing multiple sensors and hardware devices. Training serves a dual purpose as it not only enables the target group to effectively utilize the ATs but, also, helps in improving their low acceptance rate. In this paper, we present the design, implementation, and validation of a smartphone-based training application. It is a form of immersive system that enables users to learn the features of an outdoor blind pedestrian navigation application and, simultaneously, to help them develop long-term Orientation and Mobility (O&M) skills. The system consists of an Android application leveraging, as data sources, an external high-accuracy GPS sensor for real-time pedestrian mobility tracking, a second custom-made device attached to traffic lights for identifying their status, and an ultra-sonic sensor for detecting near-field obstacles on the navigation path of the users. The training version running as an Android application employs route simulation with audio and haptic feedback, is functionally equivalent to the main application, and was used in the context of specially designed user-centered training sessions. A Usability and User Experience (UX) evaluation revealed the positive attitude of the users towards the training version as well as their satisfaction with the skills acquired during their training sessions (SUS = 69.1, UEQ+ = 1.53). Further confirming the positive attitude was the conduct of a Recursive Neural Network (RNN)-based sentiment analysis on user responses with a score of 3 on a scale from 0 to 4. Finally, we conclude with the lessons learned and the proposal of general design guidelines concerning the observed lack of accessibility and non-universal interfaces.

Methods, Indicators, and End-User Involvement in the Evaluation of Digital Health Interventions for the Public: Scoping Review

“…In summary, the analysis revealed that there is neither a consensus on the methods for evaluating DHIs nor a commonly agreed definition or usage of the evaluated indicators, resulting in a broad variety of evaluation practices. This aligns with the findings of the existing literature [ 23 , 61 ]. Although several frameworks exist, the problem of heterogenicity and variability according to the evaluation of DHIs remains, and these circumstances appear to hamper gathering of reliable evidence through evaluation.…”

Development and Usability Evaluation of VulcanH, a CMMS Prototype for Preventive and Predictive Maintenance of Mobile Mining Equipment

“…For purposes of comparison, Netflix's and Amazon Prime's KPIs were 1.73 ± 0.74 and 1.35 ± 0.87, respectively. Similarly, a recent study concluded that a KPI value of 1.53 reflected a positive usability of the system [74]. This value was accompanied by a SUS score of 69% which can be considered slightly above average according to SUS benchmarks [75].…”

Multi-Sensor Data Fusion Solutions for Blind and Visually Impaired: Research and Commercial Navigation Applications for Indoor and Outdoor Spaces

“…Usability and UX are two key terms in evaluating assistive technology applications for the BVI which are commonly overlooked and, thus, underexplored. These two have the potential to cast some light on the factors that lead to the low adoption rates of the BVI communities [ 36 ]. We have seen in the context of designing, implementing and evaluating our assistive technology applications that their exploration can lead to uncovering the system’s failing aspects from the perspective of the BVI individuals [ 37 , 38 ].…”