Framework for enhancing video viewing experience with haptic effects of motion

Abstract

This work aims at enhancing a classical video viewing experience by introducing realistic haptic feelings in a consumer environment. More precisely, a complete framework to both produce and render the motion embedded in an audiovisual content is proposed to enhance a natural movie viewing session. We especially consider the case of a first-person point of view audiovisual content and we propose a general workflow to address this problem. This latter includes a novel approach to both capture the motion and video of the scene of interest, together with a haptic rendering system for generating a sensation of motion. A complete methodology to evaluate the relevance of our framework is finally proposed and demonstrates the interest of our approach.

Integrating Mid-Air Haptics into Movie Experiences

“…This result is in line with previous work demonstrating the arousing effect of haptic feedback while watching movies [6,16]. While a positive effect was expected for the synchronous condition, the same effect is true for the asynchronous.…”

“…Danieau et al [6], for instance, recorded haptic feedback experienced during specific activities (e.g. horse riding) alongside video and sound.…”

Vibrotactile inputs to the feet can modulate vection

“…Force feedback applied to the hands can also be used for this purpose, where the force intensity is adjusted in accordance to the visual flow during navigation in a virtual environment [7,11,4]. Low-frequency vibration stimuli can also applied through a chair on which subjects are sitting, concomitantly with auditory inputs [12].…”

Inducing self-motion sensations in driving simulators using force-feedback and haptic motion

“…In the context of multimedia applications, Danieau et al [7][8][9] have proposed an application of "haptic motion" to increase the sensation of motion during a passive video viewing experience. They designed the "HapSeat" system (a haptic seat), which applies forcefeedback at the level of the armrests and headrest (on users hands and head) in synchronization with the video or camera movements.…”

“…Interestingly, in the context of multimedia and audiovisual experiences, some researchers have recently shown that using forcefeedback applied to the hands of a seated user could succeed in generating strong sensations of self-motion during a passive video viewing [7][8][9]20]. This phenomenon, called "haptic motion", was demonstrated to be successful at producing a higher sensation of vection (illusion of self-motion) during virtual 3D navigations compared to the use of visual-feedback alone [20].…”