Missing depth cues in virtual reality limit performance and quality of three dimensional reaching movements

Abstract

BackgroundGoal-directed reaching for real-world objects by humans is enabled through visual depth cues. In virtual environments, the number and quality of available visual depth cues is limited, which may affect reaching performance and quality of reaching movements.MethodsWe assessed three-dimensional reaching movements in five experimental groups each with ten healthy volunteers. Three groups used a two-dimensional computer screen and two groups used a head-mounted display. The first screen group received the typically recreated visual depth cues, such as aerial and linear perspective, occlusion, shadows, and texture gradients. The second screen group received an abstract minimal rendering lacking those. The third screen group received the cues of the first screen group and absolute depth cues enabled by retinal image size of a known object, which realized with visual renderings of the handheld device and a ghost handheld at the target location. The two head-mounted display groups received the same virtually recreated visual depth cues as the second or the third screen group respectively. Additionally, they could rely on stereopsis and motion parallax due to head-movements.Results and conclusionAll groups using the screen performed significantly worse than both groups using the head-mounted display in terms of completion time normalized by the straight-line distance to the target. Both groups using the head-mounted display achieved the optimal minimum in number of speed peaks and in hand path ratio, indicating that our subjects performed natural movements when using a head-mounted display. Virtually recreated visual depth cues had a minor impact on reaching performance. Only the screen group with rendered handhelds could outperform the other screen groups. Thus, if reaching performance in virtual environments is in the main scope of a study, we suggest applying a head-mounted display. Otherwise, when two-dimensional screens are used, achievable performance is likely limited by the reduced depth perception and not just by subjects’ motor skills.

Accuracy and precision of stimulus timing and reaction times with Unreal Engine and SteamVR

“…Furthermore, we developed and tested the method only for standard keyboard input and did not include support for the HTC Vive's motion controllers. Motions controllers are increasingly used to investigate naturalistic behavior, as they allow to track the hand movements of the participant [e.g., 52,53]. Future research needs to assess timing errors related to motion controllers.…”

Real-World and Virtual-World Practices for Virtual Reality Games: Effects on Spatial Perception and Game Performance

“…Researchers have been investigating approaches to improve spatial perception in VR, such as depth cues [10], visual effects applied to 3D content [9], haptic feedback [11], freedom of movement [12], visual and audio cues [13], and virtual environment setup [6,14]. These approaches are interventions focusing on user interactions with VR applications.…”

Tactile and kinesthetic feedbacks improve distance perception in virtual reality

“…The advent of modern stereoscopic virtual reality headmounted displays (HMDs, such as the Oculus Rift and HTC Vive) has allowed for improved depth perception in virtual environments [13]. The improvement of depth perception distortion is potentially to the point that the HMDs provide "immersion and depth perception on a level that proved sufficiently realistic for healthy young adults to perform natural reaching movements" [9]. Yet Lin et al suggest that stereoscopic depth cues could be part of the problem of depth perception distortion [16].…”

“…Further research has found that the use of combined, or multimodal, sensory information (visual, aural, tactile) improves virtual environment presence and immersion [23], [12] and has a positive effect on depth perception [15], [9]. Hecht and Reiner suggest that audio and haptic stimuli are dominated by visual stimuli when only one or the other is coupled with the visual stimuli, but not both [11] and are more likely to go unnoticed.…”