Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2013
DOI: 10.1145/2470654.2481354
|View full text |Cite
|
Sign up to set email alerts
|

Real-time perception-level translation from audio signals to vibrotactile effects

Abstract: In this paper, we propose a real-time perception-level audioto-vibrotactile translation algorithm. Unlike previous signallevel conversion methods, our algorithm considers only perceptual characteristics, such as loudness and roughness, of audio and tactile stimuli. This perception-level approach allows for designing intuitive and explicit conversion models with clear understandings of their perceptual consequences. Our current implementation is tailored to accurate detection of special sound effects to provide… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1

Citation Types

0
13
0

Year Published

2014
2014
2023
2023

Publication Types

Select...
5
1
1

Relationship

0
7

Authors

Journals

citations
Cited by 42 publications
(13 citation statements)
references
References 22 publications
0
13
0
Order By: Relevance
“…One of the key requirements for generating haptic effects is the synchronization with the audiovisual content. There has been mainly three ways to achieve this: capturing physical sensor data during filming [7], having haptic content designers manually add haptic features [31,37], and automatically generating haptic effects based on the video or audio content [17,21,22].…”
Section: Authoring Haptic Effectsmentioning
confidence: 99%
See 2 more Smart Citations
“…One of the key requirements for generating haptic effects is the synchronization with the audiovisual content. There has been mainly three ways to achieve this: capturing physical sensor data during filming [7], having haptic content designers manually add haptic features [31,37], and automatically generating haptic effects based on the video or audio content [17,21,22].…”
Section: Authoring Haptic Effectsmentioning
confidence: 99%
“…For example, these methods will always generate strong tactile stimuli whenever there is a large object moving across the scene. Audio signals have also been used to generate haptic effects by analyzing their frequency characteristics [5] or perception-level intensity [22]. However, simply translating an audio signal to a haptic signal alone without understanding its semantic correspondence with visual content could potentially lead to inadequate haptic effects.…”
Section: Automaticmentioning
confidence: 99%
See 1 more Smart Citation
“…music, voice-over, etc.). Here haptic effects would highlight particular sound effects or music [9]. In a second category, haptic effects underline the context, i.e.…”
Section: Taxonomy Of Haptic Effectsmentioning
confidence: 99%
“…Among the approaches adopted to design vibrotactile feedback for non-visual information display, complex semantics have been investigated [20] on top of simpler vibrotactile codes [3,22]. Focusing in particular on DMIs, the most straightforward solution is to obtain tactile signals directly from their audio output.…”
mentioning
confidence: 99%