Fusing Remote Control Usages and Facial Expression for Emotion Recognition

Abstract

This paper proposes a fusion model that merges the context-aware multimodal information of JADE (Java Agent DEvelopment Framework). The context-aware multimodal information system is developed from the multi-heterogeneous context sensing devices. This multimodal not only gathers multidimensional data that aims to recognize and analyze the collected emotion information, but also emotion manages the context-aware information. According to the collections of users use remote control usages during watching TV and the face recognition technology, we developed a context-aware multimodal information system to recognize emotions. The emotion information is reasoned from the action data of remote control usages that combines with the emotion information gathered from the face recognition. These two information fuses with the feedback mechanism of real emotion to acquire the information of personal emotion representation. This fusion model of context-aware multimodal information provides personal emotion information and learning mechanism to reason the information from contextaware ubiquitous environment applied on personal emotion prediction.

General and Interval Type-2 Fuzzy Face-Space Approach to Emotion Recognition

“…Determine α and β for each x, given by (20). 4) For each x, where μ(x, μ jà (x)) lies in [α, β], minimize J j by DE.…”

Expression Detector System based on Facial Images

“…In (Wong and Cho, 2006), using Gabor features, developed a representation of facial emotion in Face Emotion Tree Structure (FEETS) to detect emotions in faces partially covered by sunglasses, veils, or any element that hides from view any area, achieving facial expression recognition results close to 90%. (Fu et al, 2009) conducted a study which used Java Agent Development Framework (JADE), which linked the activity of the viewer using the remote control combined with facial recognition, with the emotions of the human being. Work that can be used to support the research of the Massachusetts Institute of Technology (MIT) on the home of the future, in which changes in the conditions of blood pressure, weight or abnormal sleep, are monitored as precursors of heart failure symptoms.…”