Using visual feedback to improve hand movement accuracy in confined-occluded spaces in virtual reality

Abstract

Accurate and informative hand-object collision feedback is of vital importance for hand manipulation in virtual reality (VR). However, to our best knowledge, the hand movement performance in fully-occluded and confined VR spaces under visual collision feedback is still under investigation. In this paper, we firstly studied the effects of several popular visual feedback of hand-object collision on hand movement performance. To test the effects, we conducted a within-subject user study (n=18) using a target-reaching task in a confined box. Results indicated that users had the best task performance with see-through visualization, and the most accurate movement with the hybrid of proximity-based gradation and deformation. By further analysis, we concluded that the integration of see-through visualization and proximity-based visual cue could be the best compromise between the speed and accuracy for hand movement in the enclosed VR space. On the basis, we designed a visual collision feedback based on projector decal,which incorporates the advantages of see-through and color gradation. In the end, we present demos of potential usage of the proposed visual cue.

Giant Finger: A Novel Visuo-Somatosensory Approach to Simulating Lower Body Movements in Virtual Reality

“…Thus, the sense of immersion and presence in the virtual simulation is enhanced when the movements of the virtual avatar align with those of the user in the real world [44,45,53]. A distinct example of this is when users observe their virtual hands and arms move in synchronization with their physical actions, enriching their immersive experience [35,46,56].…”

Physically Plausible Realistic Grip-Lift Interaction Based on Hand Kinematics in VR

“…While experiencing advances in the field of virtual reality (VR) research and development, various user interaction mechanisms have been proposed to effectively control virtual objects using different metaphors in immersive VR environments. Bare-hands interaction approaches are considered an effective form of a natural user interface in different use cases and applications, such as simulation, training, and games in VR [1][2][3][4][5][6][7][8]. Grip lifting is one of the most fundamental and important ways that people interact with virtual objects, e.g., to pick up and move things around as they want [9,10].…”