A Framework for the Creating, Expressing and Sharing of User’s Emotion

Abstract

This paper presents the Emotionally Intelligent Contents (EIC) framework designed to support the rapid development of interactive emotion contents. The EIC framework consists of the Emotion Recognizer for detecting user's emotional states, the Emotion Server for storing and sharing emotion data, the Emotion Content Authoring Tool for customizing user's own emotional expression rules, the Emotion Rule Controller for processing user's emotional rules, and the Emotion Content Player for displaying the content according to the user's emotional states and his/her personalized emotion rules. This framework allows a designer to create the emotion content that interprets a user's emotional state and adapts its visual and aural characteristics based on user-specified emotion rules. It dynamically alters userspecified images or models to express user emotions. It also enables users to share their emotion with others using customized emotion expressions applied in the content. Several prototype EICs were built with this framework. A pilot study was conducted to compare the EIC against the original content and the initial result showed that the EIC had significantly more influence on the subject's emotion than the original content.

Comparative analysis of affective and physiological responses to emotional movies

“…The emotional movie system is built on top of the emotionally intelligent content framework [12] to enable user preference specification of emotion. This framework allows easy creation of emotional expressions so that the contents can be customized for users depending on their own unique emotion rules.…”

“…Emotional contents allow users to specify personalized emotion rule sets, which is stored in and retrieved from a database system [12,21]. Figure 2 shows the emotion rules describing how the emotional movies are rendered visually depending on the users' emotional state.…”

“…This approach is essential for creating more engaging and affective environments. Previous research has revealed that such emotional movies had significantly more influence on the subject's emotional states than the original movies [12].…”

“…This approach is essential for creating more engaging and affective environments. Previous research has revealed that such emotional movies had significantly more influence on the subject's emotional states than the original movies [12].Despite the need for understanding the interactive nature of user emotions elicited by the emotional movie, little is known about the impact of 3D emotional movie and the role that different colors or tones of light play in the scene. This is challenging because emotional response is complex, and arises not just from the video itself, but from the context of the video, such as the storyline, the colors or tones of the scene, and even from the 3D effects.…”

Real-Time Mobile Emotional Content Player Using Smartphone Camera-Based PPG Measurement

“…In other words, recent studies have focused on methods to induce the emotional responses of users and reflect those responses within the content, just as the content can induce emotional responses in the users. Emotional content has been defined as content that not only affects the emotion of the user but also changes the audiovisual elements of the image, such as tone, brightness, contrast, and the strength and speed of sound, within the content according to the user's emotion [12,13]. In this regard, recent studies have been recently conducted on emotional content that can interact with users by recognizing their emotional states and changing the elements of the content accordingly.…”