Abstract-This paper presents the fuzzy video based emotion recognition system VISBER, that allows to analyze facial expressions in video sequences. In order to process images in real-time a tracking mechanism is used for face localization. The fuzzy classification itself analyzes the deformation of a face separately in each image. In contrast to most existing approaches, also blended emotions with varying intensities as proposed by psychologists can be handled. For this purpose we propose a fuzzy emotion model which is generally applicable for also for other emotion recognition solutions. Furthermore, VISBER supports the automatic adaptation to the characteristics of individual human faces by a short training phase that can be done before the emotion recognition starts.

Abstract-This paper describes the realization of a natural speech dialogue for the robot head MEXI with focus on its emotion recognition. Specific for MEXI is that it can recognize emotions from natural speech and also produce natural speech output with emotional prosody. For recognizing emotions from the prosody of natural speech we use a fuzzy rule based approach. Since MEXI often communicates with well known persons but also with unknown humans, for instance at exhibitions, we realized a speaker-dependent mode as well as a speaker-independent mode in in the prosody based emotion recognition. A key point of our approach is that it automatically selects the most significant features from a set of twenty analyzed features based on a training data base of speech samples. This is important according to our results, since the set of significant features differs considerably between the distinguished emotions. With our approach we reached average recognition rates of 84% in speaker-dependent mode and 60% in speaker-independent mode.

Abstract-This paper describes the emotion recognition from natural speech as realized for the robot head MEXI. We use a fuzzy logic approach for analysis of prosody in natural speech. Since MEXI often communicates with well known persons but also with unknown humans, for instance at exhibitions, we realized a speaker dependent mode as well as a speaker independent mode in our prosody based emotion recognition. A key point of our approach is that it automatically selects the most significant features from a set of twenty analyzed features based on a training database of speech samples. This is important according to our results, since the set of significant features differs considerably between the distinguished emotions. With our approach we reach average recognition rates of 84% in speaker dependent mode and 60% in speaker independent mode.

No abstract

Emotion recognition and adequate reactions are a crucial part of human communication and hence should also be considered for interactions between humans and robots. In this paper we present the robot head MEXI which is able to recognize emotions of its human counterpart from a video sequence using a fuzzy rule based approach. It reacts on these perceptions in an emotional way. Therefor MEXI maintains an internal state made up of (artificial) emotions and drives. This internal state is used to evaluate its perceptions and action alternatives and controls its behavior on the basis of this evaluation. This is a major difference between MEXI and usual goal based agents that rely on a world model to control and plan their actions. For MEXI the behavior based programming paradigm originally developed by Arkin for robot navigation was extended to support a multidimensional control architecture based on emotions and drives.