Sensory Properties in Fusion of Visual/Haptic Stimuli Using Mixed Reality

Kitahara, Itaru; Nakahara, M.; Ohta, Yuichi

doi:10.5772/8712

Cited by 15 publications

(6 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our work builds upon previous work in combining visual and haptic impressions to influence material perception (Kitahara et al, 2010;Degraen et al, 2019), and fabrication technologies for designing varying psychophysical impressions (Piovarči et al, 2016;Groeger et al, 2019;Degraen et al, 2021b). From our results, we see that haptically-varying metamaterial surfaces enable material perception in combination with visual textures.…”

Section: Metamaterials For Passive Haptic Feedbacksupporting

confidence: 72%

MetaReality: enhancing tactile experiences using actuated 3D-printed metamaterials in Virtual Reality

Feick

Degraen

Hupperich

et al. 2023

Front. Virtual Real.

View full text Add to dashboard Cite

During interaction with objects in Virtual Reality haptic feedback plays a crucial role for creating convincing immersive experiences. Recent work building upon passive haptic feedback has looked towards fabrication processes for designing and creating proxy objects able to communicate objects’ properties and characteristics. However, such approaches remain limited in terms of scalability as for each material a corresponding object needs to be fabricated. To create more flexible 3D-printed proxies, we explore the potential of metamaterials. To this aim, we designed metamaterial structures able to alter their tactile surface properties, e.g., their hardness and roughness, upon lateral compression. In this work, we designed five different metamaterial patterns based on features that are known to affect tactile properties. We evaluated whether our samples were able to successfully convey different levels of roughness and hardness sensations at varying levels of compression. While we found that roughness was significantly affected by compression state, hardness did not seem to follow the same pattern. In a second study, we focused on two metamaterial patterns showing promise for roughness perception and investigated their visuo-haptic perception in Virtual Reality. Here, eight different compression states of our two selected metamaterials were overlaid with six visual material textures. Our results suggest that, especially at low compression states, our metamaterials were the most promising ones to match the textures displayed to the participants. Additionally, when asked which material participants perceived, adjectives, such as “broken” and “damaged” were used. This indicates that metamaterial surface textures could be able to simulate different object states. Our results underline that metamaterial design is able to extend the gamut of tactile experiences of 3D-printed surfaces structures, as a single sample is able to reconfigure its haptic sensation through compression.

show abstract

Section: Metamaterials For Passive Haptic Feedbacksupporting

confidence: 72%

MetaReality: enhancing tactile experiences using actuated 3D-printed metamaterials in Virtual Reality

Feick

Degraen

Hupperich

et al. 2023

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…There are some studies about the influence of MR visual stimulation on haptic perception, including our previous studies [4][5][6][7][8]. Kitahara et al confirmed that visual stimulation in an MR environment affects the haptic perception of texture and sharpness of an edge [18]; this idea is similar to [4]. Nakahara et al described the result of experiments on the curvature factor of edges [19].…”

Section: Related Workmentioning

confidence: 76%

R-V Dynamics Illusion: Psychophysical Influence on Sense of Weight by Mixed-Reality Visual Stimulation of Moving Objects

Hashiguchi

Sano

Shibata

et al. 2014

Lecture Notes in Computer Science

View full text Add to dashboard Cite

When humans sense the weight of real objects, their perception is known to be influenced by not only tactile information but also visual information. In a Mixed-Reality (MR) environment, the appearance of touchable objects can be changed by superimposing a computer-generated image (CGI) onto them (MR visual stimulation). In this paper, we studied the psychophysical influence on the sense of weight by using a real object that has a CGI superimposed on it. In the experiments, we show CGI representing the inertial force caused by the movable objects inside, while the subject swings the real object. The results of the experiments show that the subjects sensed weight differently when being shown the CGI animation.

show abstract

“…While in Experiment 2 we presented the feedback on their forearm, in preliminary studies, we found that users found identification difficult even when the feedback was provided near their shoulder, thigh or calf,or even the finger of their other hand (though performance in this case was improved a bit). This is maybe due to the fact that visual feedback is a crucial contributor for the identification of materials [25], [26]. However, in Fig.…”

Section: Lessons For Direct-texture-feedbackmentioning

confidence: 93%

A Novel Tactile Feedback System with On-Line Texture Decoding and Direct-Texture-Feedback

Sakurada¹,

Ganesh

Yu³

2021

2021 IEEE International Conference on Robotics and Automation (ICRA)

View full text Add to dashboard Cite

Tactile perception on our fingers is a key sensory feedback that enables us to perceive and explore our world using our hands as probes, and is essential for efficient gripping and manipulation of objects. A tactile feedback system can therefore greatly improve the quality of life of individuals with partial or complete sensory loss like during stroke, or with artificial limbs after an amputation. However, most existing tactile texture feedback technologies suffer from two constraints. First, texture decoding and texture feedback have been traditionally examined separately and not as parts of the same problem, and second, texture information has been popularly fed back using sensory modality other than tactile itself. In this study, we propose a prototype on-line direct-texture decoding and feedback system in which the texture touched by a user is decoded using an accelerometer attached to the finger. The feedback is realized by rubbing the user's skin instantaneously with the actual material that, and at the speed at which, the user swipes. The efficacy of the proposed system was tested in two user experiments with five test materials. The results and the corresponding hints for future improvements are discussed.

show abstract

Sensory Properties in Fusion of Visual/Haptic Stimuli Using Mixed Reality

Cited by 15 publications

References 21 publications

MetaReality: enhancing tactile experiences using actuated 3D-printed metamaterials in Virtual Reality

MetaReality: enhancing tactile experiences using actuated 3D-printed metamaterials in Virtual Reality

R-V Dynamics Illusion: Psychophysical Influence on Sense of Weight by Mixed-Reality Visual Stimulation of Moving Objects

A Novel Tactile Feedback System with On-Line Texture Decoding and Direct-Texture-Feedback

Contact Info

Product

Resources

About