Affective Recognition in Dynamic and Interactive Virtual Environments

Moghimi, Mohammadhossein; Stone, R.; Rotshtein, Pia

doi:10.1109/taffc.2017.2764896

Cited by 42 publications

(18 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The objective was to recognize frustration through speech and facial expression data. Researchers have also been using games to build extensive physiological datasets such as the work of Moghimi et al [44], where the authors used a speedboat racing game to collect EEG and SC (see Section 3.1) signals of 30 participants. By applying an unsupervised learning approach the authors attempt to cluster over 743 features extracted from the latter signals into four emotional categories derived from the Russel Model [52] and eight discrete labels defined by Ekman [16].…”

Section: Experimental Protocol Games To Evoke Human Behavioursmentioning

confidence: 99%

Towards Designing Games for Experimental Protocols Investigating Human-Based Phenomena

Lopes

Boulic

2020

International Conference on the Foundations of Digital Games

View full text Add to dashboard Cite

Over the past few years scientific research has opened up to the idea of using digital games for human-based studies. Fields such as Neuroscience, Medical and Affective Computing are currently using games to study human-based phenomena. Even though a vast amount of work exists within the field, rarely is the subject of designing such games ever touched upon. In fact a common problem within the field is that the games themselves are often an afterthought, where certain gameplay limitations are never truly acknowledged and tend to be mostly ignored. Thus, this paper intends to provide some game design guidelines to the most common problems found in literature from work specifically using games for human physiological data-collection purposes. Furthermore, a brief description of the most popular physiological recording methods: Skin Conductance (SC), Heart-Rate Variability (HRV), Electromyogram (EMG), Electroencephalogram (EEG) and Functional Magnetic Resonance Imaging (fMRI); are provided as the game-play "limitations" of using such devices are an important factor to take into consideration in the game design process. As such, the objective of this paper is to provide awareness of specific game design limitations found in literature and analyse them from a game design perspective. CCS CONCEPTS • Human-centered computing → Interaction design theory, concepts and paradigms; Virtual reality; Graphical user interfaces.

show abstract

Section: Experimental Protocol Games To Evoke Human Behavioursmentioning

confidence: 99%

Towards Designing Games for Experimental Protocols Investigating Human-Based Phenomena

Lopes

Boulic

2020

International Conference on the Foundations of Digital Games

View full text Add to dashboard Cite

show abstract

“…Figure 3 shows an example of a psychology model with valence Moghim el at. [55,56] has done quality work in an on-going research project that is planned to implement a physiological feed HCI system, which is very related to our research. They first conducted VR exposure experiments [55] to test users' emotional reactions to various of VR contents, and analyzed the recorded physiological data with self-report questionnaires answered by users.…”

Section: Affective Computingmentioning

confidence: 99%

“…A database was constructed to store the stimuli VR events and corresponding physiological reactions, as well as self-reported scaled emotional states. To analyze features being extracted and selected from the data [56], they compared and evaluated four different machine learning algorithms that are applicable in emotion classification. We referred to their results in III.4 and built our model based on that.…”

Section: Affective Computingmentioning

confidence: 99%

“…Hamming window or Turkey window can also be added here to avoid Spectral Leakage effect [56]. As explained in an earlier section, the HF spectral power, LF spectral power, and LF/HF ratio were extracted as features of frequency domain.…”

Section: Feature Extractionmentioning

confidence: 99%

“…Moghimi et al [56] did a great job in exploring and evaluating the performance among them in affective and emotion label classification. Their research results indicated that KNN and SVM generally reached better accuracy in any windowing size than other methods, and each of these two has advantage and disadvantage under certain conditions.…”

Section: Classification Techniquesmentioning

confidence: 99%

See 2 more Smart Citations

Designing interactive virtual environments with feedback in health applications.

Li¹

View full text Add to dashboard Cite

who love me the most in this world.iii One of the most important factors to influence user experience in human-computer interaction is the user emotional reaction. Interactive environments including serious games that are responsive to user emotions improve their effectiveness and user satisfactions. Testing and training for user emotional competence is meaningful in healthcare field, which has motivated us to analyze immersive affective games using emotional feedbacks. In this dissertation, a systematic model of designing interactive environment is presented, which consists of three essential modules: affect modeling, affect recognition, and affect control. In order to collect data for analysis and construct these modules, a series of experiments were conducted using virtual reality (VR) to evoke user emotional reactions and monitoring the reactions by physiological data. The analysis results lead to the novel approach of a framework to design affective gaming in virtual reality, including the descriptions on the aspects of interaction mechanism, graph-based structure, and user modeling. Oculus Rift was used in the experiments to provide immersive virtual reality with affective scenarios, and a sample application was implemented as cross-platform VR physical training serious game for elderly people to demonstrate the essential parts of the framework. The measurements of playability and effectiveness are discussed. The introduced framework should be used as a guiding principle for designing affective VR serious games.

show abstract

Affective Virtual Reality Gaming for Autism

Sokhadze

Luo

et al. 2021

Contemporary Clinical Neuroscience

View full text Add to dashboard Cite

Affective Recognition in Dynamic and Interactive Virtual Environments

Cited by 42 publications

References 33 publications

Towards Designing Games for Experimental Protocols Investigating Human-Based Phenomena

Towards Designing Games for Experimental Protocols Investigating Human-Based Phenomena

Designing interactive virtual environments with feedback in health applications.

Affective Virtual Reality Gaming for Autism

Contact Info

Product

Resources

About