Gamified Motor Learning Through High-Fidelity Sensor Technology

Abstract

In this paper, we present a framework for gamified motor learning through the use of a serious game and highfidelity motion capture sensors. Our implementation features an Inertial Measurement Unit and a set of Force Plates in order to obtain real-time, high-frequency measurements of patients' core movements and centre of pressure displacement during physical rehabilitation sessions. The aforementioned signals enable two mechanisms, namely a) a game avatar controlled through patient motor skills and b) a rich data stream for post-game motor performance analysis. Our main contribution is a fine-grained processing pipeline for sensor signals, enabling the extraction of a reliable and accurate mapping between patient motor movements, in-game avatar controls and overall motor performance. Moreover, we discuss the potential of this framework towards the implementation of personalised therapeutic sessions and present a pilot study conducted in that direction.