A test-bed for quality of multimedia experience evaluation of Sensory Effects

Waltl, Markus; Timmerer, Christian; Hellwagner, Hermann

doi:10.1109/qomex.2009.5246962

Cited by 38 publications

(26 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Computer vision algorithms focusing on the recognition of specific scene features, objects or elements, as well as on human identification, could be also used to boost the visualization of additional content associated with the recognized element/character. Similarly, as pointed out by Timmerer et al [2012], the (semi-) automatic generation of sensory effects presents several challenges that so far, have been only partially addressed (see, for example, the work in Waltl et al [2009] with regard to the automatic extraction of color information from the video frame and the use of such information to control ambient lighting). In this sense, the automatic identification of elements in the video scene could also be used for the release of scents stimulating the olfactory sense in coherence with the presented content.…”

Section: Discussionmentioning

confidence: 99%

Integration of Multisensorial Stimuli and Multimodal Interaction in a Hybrid 3DTV System

Luque

Galloso

Feijóo

et al. 2014

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

This paper proposes the integration of multi-sensorial stimuli and multi-modal interaction components into a sports multimedia asset under two dimensions: immersion and interaction. The first dimension comprises a binaural audio system and a set of sensory effects synchronized with the audiovisual content, whereas the second explores interaction through the insertion of interactive 3D objects into the main screen and on-demand presentation of additional information in a second touchscreen. We present an end-to-end solution integrating these components into a hybrid (internet-broadcast) television system using current 3DTV standards. Results from an experimental study analyzing the perceived quality of these stimuli and their influence in the Quality of Experience are presented. General Terms: Multimedia Information SystemsAdditional Key Words and Phrases: multi-sensorial multi-modal media, immersive media, interactive media, hybrid-based 3DTV, binaural audio, sensory effects, interactive 3D objects integrated into the video scene, second screen, quality of experience. ACM Reference Format:Francisco Pedro Luque, Iris Galloso, Carlos Alberto Martín, Claudio Feijoo and Guillermo Cisneros. 2014. Integration of multisensorial stimuli and multi-modal interaction in a hybrid 3DTV system.

show abstract

Section: Discussionmentioning

confidence: 99%

Integration of Multisensorial Stimuli and Multimodal Interaction in a Hybrid 3DTV System

Luque

Galloso

Feijóo

et al. 2014

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

show abstract

“…Authors of MulSeMedia content can select for themselves the appropriate sensory effects of a scene and determine the attributes of the corresponding sensory effects with existing MulSeMedia content authoring tools [6]- [9]. In other words, authors perceive the sensorial information of a scene and determine (map) the corresponding sensory effects and their attributes.…”

Section: Authoring Of Mulsemedia Contentmentioning

confidence: 99%

“…Sensory effect authoring tools have been proposed to remedy this problem [6]- [9]. The authoring tool known as SEVino [6] includes the ability to verify XML instances from JAXB complied with the XML schema specified in MPEG-V Part 3 [3]. Another authoring tool, known as SMURF [9], is able to support complex authoring functionalities such as GroupOfEffects, Declaration, and ReferenceEffect so that average users can easily create their desired sensory effect metadata.…”

Section: Introductionmentioning

confidence: 99%

“…The existing methods of producing MulSeMedia content incur much time and effort to author sensory effects. Sensory effect authoring tools have been proposed to remedy this problem [6]- [9]. The authoring tool known as SEVino [6] includes the ability to verify XML instances from JAXB complied with the XML schema specified in MPEG-V Part 3 [3].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Sensorial Information Extraction and Mapping to Generate Temperature Sensory Effects

Kim¹,

Yang²,

Ahn³

et al. 2014

ETRI J

View full text Add to dashboard Cite

In this paper, a method to extract temperature effect information using the color temperatures of video scenes with mapping to temperature effects is proposed to author temperature effects of multiple sensorial media content automatically. An authoring tool to apply the proposed method is also introduced. The temperature effects generated by the proposed method are evaluated by a subjective test to measure the level of satisfaction. The mean opinion score results show that most of the test video sequences receive an average of approximately four points (in a five-point scale), indicating that test video sequences (with the temperature effects generated by the proposed method) enhance levels of satisfaction.Keywords: Sensory effects, MPEG-V, MulSeMedia content, MulSeMedia authoring, sensorial information extraction, sensorial information mapping, temperature effect. Manuscript received Sept. 3, 2013; revised Dec. 13, 2013; accepted Dec. 30, 2013. I. IntroductionAlong with the sensation of the 3D film industry, the development of MulSeMedia (Multiple Sensorial Media) [1] or 4D media has received a lot of attention from the public. 4D movies generally add sensory effects to 3D and/or IMAX movies, allowing audiences to immerse themselves more deeply into the movie viewing experience. Along with the two human senses of sight and hearing, such sensory effects as wind, vibration, and scent can stimulate other senses, such as the tactile and olfactory senses. MulSeMedia content indicates audiovisual content annotated with sensory effect metadata.Since 2008, the MPEG International Standardization Group has been working to define interfaces and data formats between the virtual and real worlds, under the project name MPEG-V (ISO/IEC 23005) [2]-[5]. This standard supports the interoperability of data formats between sensory effects authored by content providers, rendering effects of diverse consumer and professional devices, and rendering environments. Due to the standardized format specified by MPEG-V, content providers can convey sensory effects as precisely as intended to consumers.MulSeMedia content contains the metadata of sensory effects that are derived from physical properties of scenes, such as those containing wind, light, temperature, color, motion, and sound effects, as well as the emotional properties of the content. The emotional properties of the content include such feelings as happiness, love, fear, anger, surprise, or hatred. If emotions and feelings were to be expressed as appropriate sensory effects, viewers would be able to immerse themselves more deeply in the content as opposed to simply experiencing the sensory effects of the physical properties in the scenes. Experiences of such sensory effects can also assist with the For the successful industrial deployment of MulSeMedia services, it is important to provide an easy and efficient means of producing MulSeMedia content. The existing methods of producing MulSeMedia content incur much time and effort to author sensory effects. Sensory effect author...

show abstract

“…Furthermore, the tables present the number of annotated vibration and wind effects which are available via SEM descriptions. Please note that light effects are not provided within the SEM descriptions as they can be easily calculated automatically [14] [15]. Only the trigger for the media processing engine for automatic color calculation is given via the SEM descriptions.…”

Section: Sensory Effect Datasetmentioning

confidence: 99%