Tech-note: Multimodal feedback in 3D target acquisition

Abstract

We investigated dynamic target acquisition within a 3D scene, rendered on a 2D display. Our focus was on the relative effects of specific perceptual cues provided as feedback. Participants were asked to use a specially designed input device to control the position of a volumetric cursor, and acquire targets as they appeared one by one on the screen. To compensate for the limited depth cues afforded by 2D rendering, additional feedback was offered through audio, visual and haptic modalities. Cues were delivered either as discrete multimodal feedback given only when the target was completely contained within the cursor, or continuously in proportion to the distance between the cursor and the target. Discrete feedback prevailed by improving accuracy without compromising selection times. Continuous feedback resulted in lower accuracy compared to discrete. In addition, reaction to the haptic stimulus was faster than for visual feedback. Finally, while the haptic modality helped decrease completion time, it led to a lower success rate.

Freehand Grasping: An Analysis of Grasping for Docking Tasks in Virtual Reality

“…Target acquisition is one of the most elementary interactions in 3D environments [29]. However, the interaction choice, a critical factor in usability and performance of VR systems, is highly influenced by the task to be performed after target acquisition stage [52].…”

Assessing a Multimodal User Interface in a Target Acquisition Task

“…El-Shimy et al propose using aural and tactile modalities in addition to visual feedback for picking targets in a 3D scene rendered on a regular display (El-Shimy et al 2009). The added modalities are used to provide depth information.…”

Multimodal 3D User Interfaces for Augmented Reality and Omni-Directional Video

“…They also found that auditory and tactile channels alone work better than using visual feedback in this eminently visual task of target acquisition. El-Shimy et al (2009) propose using auditory and tactile modalities in addition to visual feedback for picking targets in a 3D scene rendered on a regular display. The added modalities are used to provide depth information.…”