Augmented Cross-modality: Translating the Physiological Responses, Knowledge and Impression to Audio-visual Information in Virtual Reality

User Representations in Human-Computer Interaction

“…These weight illusions can be further strengthened through modification of the User Representation's visual appearance and based on the inclusion of biofeedback. In a system from Hirao and Kawai (2018), users are provided with visual feedback of their heart rate, and the virtual hands are shown trembling and turning red with the aim of reducing fatigue during the lifting of objects.…”

A Systematic Review of Weight Perception in Virtual Reality: Techniques, Challenges, and Road Ahead

“…C/D ratio [7], [115], [126] [137]- [145] Includes approaches that adjusting the translation and rotation displacement of the object, or the movement offset between virtual hand and actual hand to create an illusion of weight perception Velocity [128], [138], [142], [146]- [149] Includes approaches that alter the moving speed of the object/hand to create the illusion of weight…”

“…[150]- [152] Includes approaches where trigger the user to generate and control the force feedback himself or herself by increasing or decreasing the force exerted on the static interface to give an impression of weight Audio-Visual and Others [83], [146], [148], [149], [152]- [155] Includes approaches that changing the audio-visual representation of the object and others such as manipulating the avatar posture or body gesture, measuring the finger distance, or displaying the liquid movement to create an illusion of weight The visual representation of the pseudo-haptic techniques discussed in this section is shown in Figure 8, grouped by the pseudo-haptic cues.…”

“…Humans always relate the moving speed of an object to its perceived weight, and the faster an object moves, the lighter they seem. Earlier studies [128], [146] have seen to use the visually represented speed of an object in combination with other stimuli to influence the perception of weight in VR. In Rosa et al [128] experiments, with the HMD on, the participants were shown with an avatar sitting on a chair with the arm on the table while wearing a vibrotactile sleeve, the simulated falling speed of a virtual object onto the arm has changed the perceived weight of the object and the intensity of the vibration felt on the skin.…”

“…By using a delay parameter, Hirao et al [146], [157] incorporated the delaying speed of the object into the crossmodality testing during the lifting of a virtual object in VR. The more the delay, the heavier the sense of weight by the participant.…”