The Effect of Sound on Haptic Perception

Kim, Seung-Chan; Kyung, Ki-Uk; Kwon, Dong‐Soo

doi:10.1109/whc.2007.110

Cited by 13 publications

(9 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Last, there is evidence to suggest that the frequency range that is manipulated has perceptually specific influences for surface texture. Kim et al (2007) demonstrated that enhancing specific auditory frequencies of the sound of rubbing sandpaper (paired with virtual touch of a haptic device) alters perceived surface roughness and sensations of 'ruggedness.' Specifically, amplifying frequencies of 30-300 Hz increase perceived surface ruggedness ( Figure 4A) while amplifying frequencies of 30-600 Hz increase perceived surface roughness ( Figure 4B).…”

Section: Auditory Cues and Perception Of Surface Texturementioning

confidence: 99%

“…Specifically, amplifying frequencies of 30-300 Hz increase perceived surface ruggedness ( Figure 4A) while amplifying frequencies of 30-600 Hz increase perceived surface roughness ( Figure 4B). Additionally, the frequency of the sound paired with touch was found to be reciprocally related to the perceived denseness/hardness of the surfacewith amplification of sounds (all frequency levels) increasing perceived denseness and attenuation of sounds decreasing perceived denseness (Kim et al, 2007). • Tapping a virtual horizontal bar with a 'hammer' (hand-held stylus, virtual-user interface; sound generated by a physically based sound synthesis model of interacting objects)…”

Section: Auditory Cues and Perception Of Surface Texturementioning

confidence: 99%

“…In addition, touching stimuli in synchrony with a change in loudness of the white noise (four levels of loudness changed in a pseudorandom order) was found to influence estimates of tactile roughness regardless of the direction of the change, but not tactile estimates of length (Suzuki et al, 2008). Specifically, participants touched abrasive FIGURE 4 | Results from Kim et al's (2007) study evaluating the influence of amplifying and attenuating sound frequency components on: (A) perceived roughness; (B) perceived 'ruggedness.' Snd1 = Sound 1 the sound of rubbing sandpaper (Sound 1, grit size #24) was provided alone ("no Tactile info"), or was paired with haptic interaction (index finger) using two different tactile settings on a texture display mouse.…”

Section: Walkingmentioning

confidence: 99%

“…Amplifying a 30 -300 Hz frequency range results in increased perceptions of ruggedness during virtual haptic interaction (touch conditions) and 56 -96 Hz during no sound conditions. [From Figures 4, 7 of Kim et al (2007). Reprinted, with permission from IEEE Proceedings (Computer Society) in the format Republish in a journal/magazine via Copyright Clearance Center].…”

Section: Walkingmentioning

confidence: 99%

See 3 more Smart Citations

The Influence of Auditory Cues on Bodily and Movement Perception

Stanton

Spence

2020

Front. Psychol.

View full text Add to dashboard Cite

The sounds that result from our movement and that mark the outcome of our actions typically convey useful information concerning the state of our body and its movement, as well as providing pertinent information about the stimuli with which we are interacting. Here we review the rapidly growing literature investigating the influence of non-veridical auditory cues (i.e., inaccurate in terms of their context, timing, and/or spectral distribution) on multisensory body and action perception, and on motor behavior. Inaccurate auditory cues provide a unique opportunity to study cross-modal processes: the ability to detect the impact of each sense when they provide a slightly different message is greater. Additionally, given that similar crossmodal processes likely occur regardless of the accuracy or inaccuracy of sensory input, studying incongruent interactions are likely to also help us predict interactions between congruent inputs. The available research convincingly demonstrates that perceptions of the body, of movement, and of surface contact features (e.g., roughness) are influenced by the addition of non-veridical auditory cues. Moreover, auditory cues impact both motor behavior and emotional valence, the latter showing that sounds that are highly incongruent with the performed movement induce feelings of unpleasantness (perhaps associated with lower processing fluency). Such findings are relevant to the design of auditory cues associated with product interaction, and the use of auditory cues in sport performance and therapeutic situations given the impact on motor behavior.

show abstract

Section: Auditory Cues and Perception Of Surface Texturementioning

confidence: 99%

Section: Auditory Cues and Perception Of Surface Texturementioning

confidence: 99%

Section: Walkingmentioning

confidence: 99%

Section: Walkingmentioning

confidence: 99%

See 2 more Smart Citations

The Influence of Auditory Cues on Bodily and Movement Perception

Stanton

Spence

2020

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…Findings showed that surface roughness and friction of four different virtual fabrics could be perceived, and identified in the correct order, by participants. Kim et al (2007) also found that the experimental results of a haptic-only texture perception experiment were enhanced when auditory feedback is presented simultaneously with the haptic feedback. The researchers found that manipulating sound intensity enabled users to perceive ruggedness and roughness more effectively.…”

Section: Improving Perception Of Tactile Informationmentioning

confidence: 80%

Maintaining and modifying pace through tactile and multimodal feedback

Qian

Kuber

Sears

et al. 2011

Interacting with Computers

View full text Add to dashboard Cite

a b s t r a c tOlder adults are recommended to remain physically active to reduce the risk of chronic diseases and to maintain psychological well-being. At the same time, research also suggests that levels of fitness can be raised among this group. This paper describes the development and evaluation of a mobile technology, which enables older adults to monitor and modify their walking habits, with the long-term aim of sustaining appropriate levels of physical activity. An empirical study was conducted with twenty older adults to determine the feasibility of the proposed solution, with results indicating that tactile signals could be perceived while in motion and could support participants in walking at a range of paces. However, the effects were difficult to discern due to limitations of the hardware. In response, a novel low-cost prototype was developed to amplify vibrations, and effectiveness of redundant auditory information was investigated with the goal of enhancing the perception of the cues. A second study was conducted to determine the impact of multimodal feedback on walking behavior. Findings revealed that participants were able to maintain a desired level of pace more consistently when redundant auditory information was presented alongside the tactile feedback. When the visual channel is not available, these results suggest that tactile cues presented via a mobile device should be augmented with auditory feedback. Our research also suggests that mobile devices could be made more effective for alternative applications if they are designed to allow for stronger tactile feedback.

show abstract