Augmented reality in the psychomotor phase of a procedural task

Abstract

Figure 1: AR assistance for psychomotor phase of a procedural task. (Left) Dynamic 3D arrows and labels overlaid on aircraft engine components (center) respond to ongoing user activity to provide assistance in achieving (right) alignment of components. (Captured by a video camera looking through optical-see-through display used in study. A post-render filter was applied to remove camera distortion and vignetting.) ABSTRACTProcedural tasks are common to many domains, ranging from maintenance and repair, to medicine, to the arts. We describe and evaluate a prototype augmented reality (AR) user interface designed to assist users in the relatively under-explored psychomotor phase of procedural tasks. In this phase, the user begins physical manipulations, and thus alters aspects of the underlying task environment. Our prototype tracks the user and multiple components in a typical maintenance assembly task, and provides dynamic, prescriptive, overlaid instructions on a see-through head-worn display in response to the user's ongoing activity. A user study shows participants were able to complete psychomotor aspects of the assembly task significantly faster and with significantly greater accuracy than when using 3D-graphics-based assistance presented on a stationary LCD. Qualitative questionnaire results indicate that participants overwhelmingly preferred the AR condition, and ranked it as more intuitive than the LCD condition.

Exploring the Virtuality Continuum for Complex Rule-Set Education in the Context of Soccer Rule Comprehension

“…ToT in AR-based simulations/applications has been studied in the context of assembly or manufacturing tasks [6,7]. Our study extends this current literature by highlighting the need for further research in complex rule set environments, namely in the domain of sports.…”

The effectiveness of an AR-based context-aware assembly support system in object assembly

“…There has also been work to explore the effectiveness of AR as well as AR visualization methods in the assembly, maintenance and repair domains. Henderson et al [11] explore how real-time computer graphics, overlaid on and registered with the actual repaired equipment, can improve the productivity, accuracy, and safety of maintenance personnel. Their user study shows that participants were able to complete psychomotor aspects of the assembly task significantly faster and with significantly greater accuracy with AR than when using 3D- graphics-based assistance presented on a stationary LCD.…”

ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor

“…Several systems implement AR techniques for the purpose of learning. For example, Henderson and Feiner [11] proposed a system to help users learn a procedure of actions by attaching a sequence of 3D arrows to key objects. Another system [12] generates virtual targets for rehabilitating users who have had a stroke.…”

“…Most of them make use of augmented reality (AR), which is the technique of visualizing virtual objects in the real world. Several systems [11,12] provide visual guidance for tasks by overlaying, e.g., arrows and labels on key objects. We especially draw inspiration, however, from systems that allow easy comparison with the learner's own body by using a mirror [1,4].…”