No abstract

In this paper a novel application of multimodal emotion recognition algorithms in software engineering is described. Several application scenarios are proposed concerning program usability testing and software process improvement. Also a set of emotional states relevant in that application area is identified. The multimodal emotion recognition method that integrates video and depth channels, physiological signals and input devices usage patterns is proposed and some preliminary results on learning set creation are described.

This paper concerns measurement procedures on an emotion monitoring stand designed for tracking human emotions in the Human-Computer Interaction with physiological characteristics. The paper addresses the key problem of physiological measurements being disturbed by a motion typical for human-computer interaction such as keyboard typing or mouse movements. An original experiment is described, that aimed at practical evaluation of measurement procedures performed at the emotion monitoring stand constructed at GUT. Different locations of sensors were considered and evaluated for suitability and measurement precision in the HumanComputer Interaction monitoring. Alternative locations (ear lobes and forearms) for skin conductance, blood volume pulse and temperature sensors were proposed and verified. Alternative locations proved correlation with traditional locations as well as lower sensitiveness to movements like typing or mouse moving, therefore they can make a better solution for monitoring the Human-Computer Interaction.

No abstract

The article presents a research study on recognizing therapy progress among children with autism spectrum disorder. The progress is recognized on the basis of behavioural data gathered via five specially designed tablet games. Over 180 distinct parameters are calculated on the basis of raw data delivered via the game flow and tablet sensors -i.e. touch screen, accelerometer and gyroscope. The results obtained confirm the possibility of recognizing progress in particular areas of development. The recognition accuracy exceeds 80%. Moreover, the study identifies a subset of parameters which appear to be better predictors of therapy progress than others. The proposed method -consisting of data recording, parameter calculation formulas and prediction models -might be implemented in a tool to support both therapists and parents of autistic children. Such a tool might be used to monitor the course of the therapy, modify it and report its results.Autism is a complex developmental disorder that influences the ability to communicate and learn. Autism is nowadays a growing challenge, as the number of children diagnosed with autism is rising worldwide 1 . The disorder exhibits a spectrum of symptoms that might range from mild to severe in a particular case, varying from skill to skill and from child to child. This makes diagnosis and therapy progress evaluation difficult and at the same time crucial for the effectiveness of the therapy. Early identification and proper therapy translates into a greater chance for preventing a person with autism from social exclusion. Therefore, any idea that might improve therapeutic practice is worth investigating. This paper presents one such idea, which incorporates the analysis of behavioural characteristics observed in autistic children while they play specially designed tablet games. This interdisciplinary study combines computer science and special pedagogy, by applying computer technologies and machine learning methods in the process of therapy for autistic children.Computer technologies may support both the diagnosis of autism and related therapy, although most solutions so far refer to the process of therapy. There are numerous applications designed for individuals with autism. These applications focus on particular issues by teaching specific skills-e.g. expressing needs, learning certain behaviours 2 , improving verbal communication, answering questions, interacting with other people in typical situations 3 , recognizing and expressing emotions 4-6 . These solutions take advantage of the fact, that children with autism are usually enthusiastic about tasks supported by computer technology, which offers a predictable framework without causing stress 2 .Another group of tools is designed for therapists. One of the most commonly used solutions are computer versions of standardized questionnaires that evaluate an individual's state 7 . Another popular way of supporting the therapy is to provide the experts with video recordings of the children's behaviour. However, there are also some...