Academic methods for usability evaluation of serious games: a systematic review

Yáñez-Gómez, Rosa; Cascado-Caballero, Daniel; Sevillano, José Luis

doi:10.1007/s11042-016-3845-9

Cited by 55 publications

(23 citation statements)

References 213 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The SUS questionnaire consists of ten statements, evaluated with a Likert scale, which have to be evaluated immediately after the use of the system, even before the debriefings or discussion [41]. As shown in the surveys [44,45], SUS is the most commonly used standard questionnaire for measuring the usability of the serious game approaches.…”

Section: Impact On the Perceived Usability Of The Erp Systemmentioning

confidence: 99%

Introducing ERP Concepts to IT Students Using an Experiential Learning Approach with an Emphasis on Reflection

Beranič

Heričko

2019

Sustainability

View full text Add to dashboard Cite

The introduction of enterprise resource planning (ERP) concepts to IT students entails many challenges. Due to the system’s complexity, newcomers need an extensive amount of time to be able to use it independently. Additionally, the learning preferences and characteristics of digital natives differ significantly from previous generations. Therefore, the use of alternative learning approaches is desirable. To achieve the best possible learning outcomes, it is advisable to implement learning approaches that require students’ active participation, for example, an experiential learning approach. A variation is an ERPsim business simulation game, which we used within the ERP systems course. The game is implemented in sequential rounds, whereby each round ends with a review of the collected experiences. The simulation game was used at the beginning of the course to ease the introduction of ERP concepts for IT-related students. This paper is the result of three years of research into the perceived usability of SAP ERP introduced with the business simulation game, combined with the results of a study evaluating students’ opinions, knowledge, and skills. Perceived usability was measured using a System Usability Scale (SUS), while the students’ experiences were gathered using a self-evaluation questionnaire. The study revealed the positive impact of the experiential learning approach that was used. Students evaluated the usability of SAP ERP as OK, and empirical analysis confirmed that the use of the simulation game for introducing the ERP concepts resulted in anticipated knowledge and skills, while increasing the students’ intent for future engagement.

show abstract

Section: Impact On the Perceived Usability Of The Erp Systemmentioning

confidence: 99%

Introducing ERP Concepts to IT Students Using an Experiential Learning Approach with an Emphasis on Reflection

Beranič

Heričko

2019

Sustainability

View full text Add to dashboard Cite

show abstract

“…These user tests were concentrated within the period of 2002 and 2016 where the majority of the usability tests (83%) were performed with healthy people and the others (17%) involved patients or a combination of users with differing abilities [13]. Demographic data collected from the articles conducting these tests showed that 62% of them tested young participants, mostly university students with an average age of 30 years [12].…”

Section: Literaturementioning

confidence: 99%

“…These previous reviews [9][10][11][12][13] provided a starting point and a reference for structuring this study. Through the selection and classification of the articles, the information was analysed, in order to gain an overview and summary of the research findings.…”

Section: Literaturementioning

confidence: 99%

Usability Assessments for Augmented Reality Motor Rehabilitation Solutions: A Systematic Review

Cavalcanti

Santana

Gama

et al. 2018

International Journal of Computer Games Technology

View full text Add to dashboard Cite

This article aims to understand which methods and user assessment approaches are most commonly used in motor rehabilitation studies that use Augmented Reality (AR) applications. The way in which this was performed and discussed was through a systematic review of the area. Firstly, the different uses of AR in these treatments, and the importance of improving usability studies to evaluate these interfaces and their interactions with their users, were discussed. Then, the systematic review of the literature was structured according to previous studies and covered the period from 2007 to September 2017, using the main scientific journals of the area. Of the 666 results collected in the initial search, 32 articles were selected within the planned requirements and scope. These publications were classified by relevance, using the QualSyst evaluation tool for health technology research, and the type of evaluation, approach, and methods used were catalogued. It was found that most of the studies prioritise methods of data collection, such as task execution and performance analysis. However, through QualSyst, it was verified that the best-evaluated studies chose to use a combination of quantitative and qualitative analysis, through the application of methods such as user preference questionnaires, interviews, and observations. The results presented in this review may benefit designers who intend to design and conduct usability assessments for AR within this context.

show abstract

“…In the study participated 26 patients undergoing treatment for GD, giving high scores in effectiveness, efficiency, and satisfaction with the use of the tablet-based serious game e-Estesia (according to the SUS; Brooke, 1996). This is one of the few studies conducted in order to evaluate usability of a serious game in clinical population (Yáñez-Gómez et al, 2017). The app performed comparatively well in all groups.…”

Section: Discussionmentioning

confidence: 90%

A Serious Game to Improve Emotion Regulation in Treatment-Seeking Individuals With Gambling Disorder: A Usability Study

et al. 2021

View full text Add to dashboard Cite

Background: Serious games have shown positive results in increasing motivation, adherence to treatment and strengthening the therapeutic alliance in multiple psychiatric disorders. In particular, patients with impulse control disorders and other disorders in which the patient suffers from inhibitory control deficits (e.g., behavioral addictions) have been shown to benefit from serious games.Aim: The aim of this study was to describe the characteristics and to evaluate the usability of a new serious videogame, e-Estesia. This serious videogame was designed to improve emotion regulation in patients with gambling disorder (GD). Preliminary results from a pilot sample are also reported.Method: A pilot sample of 26 patients undergoing treatment for GD was recruited (ranging from 22 to 74 years, mean = 41.2 and SD = 12.9; 80.8% men). Participants used e-Estesia on a tablet, which was connected to a thoracic band that sent heart rate (HR) and heart rate variability (HRV) data to the videogame platform in order to provide biofeedback. The System Usability Scale was completed by patients to determine the usability of e-Estesia.Results and Discussion: e-Estesia performed comparatively well for all the explored groups (i.e., sex, age, and online vs. offline gambling: mean usability score = 83.8, SD = 13.1). Around 84.6% of the patients endorsed that it was easy to use. Female patients with GD presented higher HRV during the use of the serious videogame compared to men.

show abstract

Academic methods for usability evaluation of serious games: a systematic review

Cited by 55 publications

References 213 publications

Introducing ERP Concepts to IT Students Using an Experiential Learning Approach with an Emphasis on Reflection

Introducing ERP Concepts to IT Students Using an Experiential Learning Approach with an Emphasis on Reflection

Usability Assessments for Augmented Reality Motor Rehabilitation Solutions: A Systematic Review

A Serious Game to Improve Emotion Regulation in Treatment-Seeking Individuals With Gambling Disorder: A Usability Study

Contact Info

Product

Resources

About