We propose a Haptic Audio Visual System (HAVS) which consists of a touchable video and a tactile audio. Touchable video generates tactile feedback according to the user's real-time interactions on the video. Tactile audio provides the tactile experiences through the automatic generation of vibro-tactile stimuli using a sound detection algorithm. The video screen is divided into a grid, and each cell has customizable tactile information which corresponds to the visual content. At the same time, the sound stream is also analyzed and customizable vibration responses are synchronized to specific sound effects or audio "signatures". One of the important advantages of HAVS is the ability to augment and enhance immersiveness and the interactivity of users in 3D virtual environments. The application of HAVS to commercial, military, educational and medical contexts including: home shopping, online gaming, interactive broadcasting, teaching/learning and teleoperator settings will be discussed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.