Usability Measures in Mobile-Based Augmented Reality Learning Applications: A Systematic Review

Cheng, Lim Kok; Selamat, Ali; Alias, Rose Alinda; Krejcar, Ondřej; Fujita, Hamido

doi:10.3390/app9132718

Cited by 26 publications

(19 citation statements)

References 120 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Among scales/questionnaires, which constitute the technique most often reported, the most common usability assessment scales were the System Usability Scale [ 29 , 32 , 41 - 43 , 46 , 47 ] and the Post-Study System Usability Questionnaire [ 41 , 42 , 46 , 47 ]. The other scales/questionnaires include the Questionnaire for User Interaction Satisfaction [ 29 , 42 , 47 ], the Software Usability Measurement Inventory [ 32 , 42 ], the Usefulness, Satisfaction, and Ease of use Questionnaire [ 32 , 41 ], the Computer System Usability Questionnaire [ 32 , 47 ], the After-Scenario Questionnaire [ 46 , 47 ], the Perceived Useful and Ease of Use [ 32 ], the IsoMetrics usability inventory [ 32 ], the Health Information Technology Usability Evaluation Scale [ 32 ], the user Mobile Application Rating Scale [ 32 ]; the IBM ease of use [ 42 ], and the ISO 9241–11 Questionnaire [ 43 ]. In addition, several reviews have reported the use of nonvalidated questionnaires [ 32 , 41 , 43 , 46 ].…”

Section: Resultsmentioning

confidence: 99%

Procedures of User-Centered Usability Assessment for Digital Solutions: Scoping Review of Reviews Reporting on Digital Solutions Relevant for Older Adults

Silva¹,

Caravau²,

Martins³

et al. 2021

JMIR Hum Factors

View full text Add to dashboard Cite

Background The assessment of usability is a complex process that involves several steps and procedures. It is important to standardize the evaluation and reporting of usability procedures across studies to guide researchers, facilitate comparisons across studies, and promote high-quality usability studies. The first step to standardizing is to have an overview of how usability study procedures are reported across the literature. Objective This scoping review of reviews aims to synthesize the procedures reported for the different steps of the process of conducting a user-centered usability assessment of digital solutions relevant for older adults and to identify potential gaps in the present reporting of procedures. The secondary aim is to identify any principles or frameworks guiding this assessment in view of a standardized approach. Methods This is a scoping review of reviews. A 5-stage scoping review methodology was used to identify and describe relevant literature published between 2009 and 2020 as follows: identify the research question, identify relevant studies, select studies for review, chart data from selected literature, and summarize and report results. The research was conducted on 5 electronic databases: PubMed, ACM Digital Library, IEEE, Scopus, and Web of Science. Reviews that met the inclusion criteria (reporting on user-centered usability evaluation procedures for any digital solution that could be relevant for older adults and were published in English) were identified, and data were extracted for further analysis regarding study evaluators, study participants, methods and techniques, tasks, and test environment. Results A total of 3958 articles were identified. After a detailed screening, 20 reviews matched the eligibility criteria. The characteristics of the study evaluators and participants and task procedures were only briefly and differently reported. The methods and techniques used for the assessment of usability are the topics that were most commonly and comprehensively reported in the reviews, whereas the test environment was seldom and poorly characterized. Conclusions A lack of a detailed description of several steps of the process of assessing usability and no evidence on good practices of performing it suggests that there is a need for a consensus framework on the assessment of user-centered usability evaluation. Such a consensus would inform researchers and allow standardization of procedures, which are likely to result in improved study quality and reporting, increased sensitivity of the usability assessment, and improved comparability across studies and digital solutions. Our findings also highlight the need to investigate whether different ways of assessing usability are more sensitive than others. These findings need to be considered in light of review limitations.

show abstract

Section: Resultsmentioning

confidence: 99%

Procedures of User-Centered Usability Assessment for Digital Solutions: Scoping Review of Reviews Reporting on Digital Solutions Relevant for Older Adults

Silva¹,

Caravau²,

Martins³

et al. 2021

JMIR Hum Factors

View full text Add to dashboard Cite

show abstract

“…Additionally, parents reported a high level of satisfaction with the different AR applications [ 40 ]. In general, the literature evidences that caregivers and teachers reported that children with ASD improved social interactions through advancements in nonverbal communication, social engagement, and eye contact while using AR technology [ 11 , 13 ].…”

Section: Discussionmentioning

confidence: 99%

“…Studies have identified the advantages provided by computerized learning of different functional and social skills [ 11 , 14 ]. Specifically, among the strengths of the use of technology in interventions addressed at children with ASD, the possibility to clearly define tasks, to keep the focus of attention, to minimize distractions, and to facilitate personal skills and strategies with a tool that can be used for many applications is noteworthy.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Exploring the Impact of Augmented Reality in Children and Adolescents with Autism Spectrum Disorder: A Systematic Review

Berenguer

Baixauli

Gómez

et al. 2020

IJERPH

View full text Add to dashboard Cite

Autistic Spectrum Disorder (ASD) is a neurodevelopmental condition characterized by persistent difficulties in communication and social interaction along with a restriction in interests and the presence of repetitive behaviors. The development and use of augmented reality technology for autism has increased in recent years. However, little is known about the impact of these virtual reality technologies on clinical health symptoms. The aim of this systematic review was to investigate the impact of augmented reality through social, cognitive, and behavioral domains in children and adolescents with autism. This study is the first contribution that has carried out an evidence-based systematic review including relevant science databases about the effectiveness of augmented reality-based intervention in ASD. The initial search identified a total of 387 records. After the exclusion of papers that are not research studies and are duplicated articles and after screening the abstract and full text, 20 articles were selected for analysis. The studies examined suggest promising findings about the effectiveness of augmented reality-based treatments for the promotion, support, and protection of health and wellbeing in children and adolescents with autism. Finally, possible directions for future work are discussed.

show abstract

“…The experiment employed three data collection methods: think-aloud protocol, observation, and interview [52]. The test conductor instructed participants at the beginning of the test to follow the think-aloud protocol so that participants could comment about their opinions, motivations, actions, and any other comments about the test experience.…”

Section: Prototype Evaluationmentioning

confidence: 99%

A Model to Support Fluid Transitions between Environments for Mobile Augmented Reality Applications

Araújo

Santos

Lima

2019

Sensors

View full text Add to dashboard Cite

The adaptability between different environments remains a challenge for Mobile Augmented Reality (MAR). If not done seamlessly, such transitions may cause discontinuities in navigation, consequently disorienting users and undermining the acceptance of this technology. The transition between environments is hard because there are currently no localization techniques that work well in any place: sensor-based applications can be harmed by obstacles that hamper sensor communication (e.g., GPS) and by infrastructure limitations (e.g., Wi-Fi), and image-based applications can be affected by lighting conditions that impair computer vision techniques. Hence, this paper presents an adaptive model to perform transitions between different types of environments for MAR applications. The model has a hybrid approach, choosing the best combination of long-range sensors, short-range sensors, and computer vision techniques to perform fluid transitions between environments that mitigate problems in location, orientation, and registration. To assess the model, we developed a MAR application and conducted a navigation test with volunteers to validate transitions between outdoor and indoor environments, followed by a short interview. The results show that the transitions were well succeeded, since the application self-adapted to the studied environments, seamlessly changing sensors when needed.

show abstract

Usability Measures in Mobile-Based Augmented Reality Learning Applications: A Systematic Review

Cited by 26 publications

References 120 publications

Procedures of User-Centered Usability Assessment for Digital Solutions: Scoping Review of Reviews Reporting on Digital Solutions Relevant for Older Adults

Procedures of User-Centered Usability Assessment for Digital Solutions: Scoping Review of Reviews Reporting on Digital Solutions Relevant for Older Adults

Exploring the Impact of Augmented Reality in Children and Adolescents with Autism Spectrum Disorder: A Systematic Review

A Model to Support Fluid Transitions between Environments for Mobile Augmented Reality Applications

Contact Info

Product

Resources

About