Novel Neurostimulation-Based Haptic Feedback Platform for Grasp Interactions With Virtual Objects

Abstract

Haptic perception is a vital part of the human experience that enriches our engagement with the world, but the ability to provide haptic information in virtual reality (VR) environments is limited. Neurostimulation-based sensory feedback has the potential to enhance the immersive experience within VR environments by supplying relevant and intuitive haptic feedback related to interactions with virtual objects. Such feedback may contribute to an increase in the sense of presence and realism in VR and may contribute to the improvement of virtual reality simulations for future VR applications. This work developed and evaluated xTouch, a neuro-haptic platform that extends the sense of touch to virtual environments. xTouch is capable of tracking a user’s grasp and manipulation interactions with virtual objects and delivering haptic feedback based on the resulting grasp forces. Seven study participants received haptic feedback delivered via multi-channel transcutaneous electrical stimulation of the median nerve at the wrist to receive the haptic feedback. xTouch delivered different percept intensity profiles designed to emulate grasp forces during manipulation of objects of different sizes and compliance. The results of a virtual object classification task showed that the participants were able to use the active haptic feedback to discriminate the size and compliance of six virtual objects with success rates significantly better than the chance of guessing it correctly (63.9 ± 11.5%, chance = 16.7%, p < 0.001). We demonstrate that the platform can reliably convey interpretable information about the physical characteristics of virtual objects without the use of hand-mounted devices that would restrict finger mobility. Thus, by offering an immersive virtual experience, xTouch may facilitate a greater sense of belonging in virtual worlds.

A portable, programmable, multichannel stimulator with high compliance voltage for noninvasive neural stimulation of motor and sensory nerves in humans

“…Electrocutaneous stimulation has been used extensively to evoke tactile sensations, often to provide sensory feedback to individuals suffering from limb loss 8 , 46 – 50 or to improve the performance of human–machine interfaces such as virtual reality 51 – 53 . In contrast, transcutaneous nerve stimulation has only recently been explored for use in upper-limb prosthetics 54 and virtual reality 55 . We build on these prior works by providing a direct comparison of the two approaches for artificial sensory feedback.…”

Effects of appearance and gender on pre-touch proxemics in virtual reality

“…With the popularization of VR devices and applications, people have more opportunities for interacting with others in VR environments. Various devices and algorithms have introduced haptic feedback in VR in addition to audiovisual feedback ( Van Erp and Toet, 2015;Huisman, 2016;Zenner and Kruger, 2017;Whitmire et al, 2018;Preechayasomboon and Rombokas, 2021;Kruijff et al, 2022;Kudry and Cohen, 2022;Nunez et al, 2022;Shell et al, 2022;Villa et al, 2022). Due to such devices and algorithms, humans are more often haptically interacting with virtual characters, and human behavior during touch interactions in VR is being actively studied (Bailenson and Yee, 2008;Huisman et al, 2014;Hoppe et al, 2020;Sykownik and Masuch, 2020;Gallace and Girondini, 2022).…”