Using mixed reality displays for observational learning of motor skills: A design research approach enhancing memory recall and usability

Abstract

When learning an action sequence, observing a demonstration informs the knowledge of movement execution and enhances the efficiency of motor skill acquisition. Three-dimensional (3D) virtual learning environments offer more opportunities for motor skill training as they afford observational learning. Mixed reality platforms (virtual reality, desktop PC, etc.) that render 3D virtual environments can therefore increase accessibility of observational content. To explore the effectiveness of these platforms so as to facilitate observational learning of action sequences, we developed the Recovery Position Application [1] (RPA) at the Interactive System Studio, University of Plymouth. The RPA was originally designed for mobile virtual reality. The RPA displays two virtual avatars performing the steps of the recovery position. We present the design of content and interaction informed by research into observational learning of motor skills. To formatively evaluate the current functional prototype, and potential use within an educational context, RPA was tested on three different platforms. Mobile VR (N=20), desktop PC (N=20) and video recording (N=21). Memory recall of movements was recorded and the usability of the RPA was investigated. Across all three platforms, the average recall of demonstrated information was 61.88%, after using the application for 10 min. No significant differences between recall rates were identified between platforms. Participant responses were positive or very positive for both application effectiveness as a learning resource and for ease of use. These results are discussed with regard to the future development of the RPA and guidelines for virtual demonstration content.

Ragdoll Recovery: Manipulating Virtual Mannequins to Aid Action Sequence Proficiency

“…The common requirements throughout these stages of development are establishing a cognitive representation, developing procedural memory through practice, and feedback to adjust motor skills and refine cognitive representation. Mobile VR has been used to deliver observational learning of the recovery position [11]. By simply watching two virtual avatars perform the sequence, subjects were able to recall much of the steps and perceived to have better knowledge of the action sequence.…”