Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

Abstract

BackgroundGestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use.ObjectiveThis study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games.MethodsThe research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface.ResultsIn the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user’s age and limitations.ConclusionsThrough this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence.

A Usability Evaluation Experiment of 3D User Interfaces for Elderly

“…Since these studies are recent researches, we understand that o er a suitable evaluation process is interesting for designers and developers to comprehend and attend the particularities of elderly, providing better experiences to them. In addition, the systematic review presented by Simor et al (2016) points to similar results, showing the lack of human-computer interface evaluation mechanisms designed speci cally for the elderly users.…”

An Approach to Develop a Motion-Sensitive, Locally Multiplayer-Hybrid (Multipid) 3d Video Game

“…We also see other related work in the literature which discuss game experience related issues in terms of Kinect-like motion sensing game input environments. For instance in [25], a systematic review is done by Simor et al to evaluate the usability of gestural interaction over different works. In [26], Bampatzia et al evaluate player experience by comparing game input modalities.…”

Eye-Tracking-based Wizard-of-Oz Usability Evaluation of an Emotional Display Agent Integrated to a Virtual Environment

“…The term 'usability' and the usability evaluation methods are matured in Human-Computer Interaction (HCI) [15], [16]. Already existing empirical usability evaluations, also in 3D virtual environments, have traditions: some of them focus on interaction styles, such as gesture control [17]; some of them focus on specific features of virtual environments, such as colours [18]; others focus on broad term of usability issues [19]- [24].…”