VR-PEER: A Personalized Exer-Game Platform Based on Emotion Recognition

Izountar, Yousra; Benbelkacem, Samir; Otmane, Samir; Khababa, Abdallah; Masmoudi, Mostefa; Zenati, Nadia

doi:10.3390/electronics11030455

Cited by 12 publications

(8 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…B.Recognition: After data preprocessing, we employed the method proposed in [50] to classify the patient's facial expressions into various emotion categories, including positive, negative, neutral (figure 4). Our previous work [7] involved the use of the combination of MoodMe Emotions Barracuda SDK [49] for pre-processing, and DeepFace [48], for emotion classification, DeepFace a neural network model developed by Facebook's AI Research team in 2014. The recognition module (MoodMe + Deep-Face) has demonstrated its capabilities in our previous research [7].…”

Section: Emotion Recognitionmentioning

confidence: 99%

“…Our previous work [7] involved the use of the combination of MoodMe Emotions Barracuda SDK [49] for pre-processing, and DeepFace [48], for emotion classification, DeepFace a neural network model developed by Facebook's AI Research team in 2014. The recognition module (MoodMe + Deep-Face) has demonstrated its capabilities in our previous research [7]. In this paper, our emphasis is on using emotion recognition to estimate the level of motivation in patients during serious games.…”

Section: Emotion Recognitionmentioning

confidence: 99%

“…Positive emotions during therapy and patient motivation are crucial for successful rehabilitation and facilitating recovery after a stroke, emphasizing that positive treatment outcomes depend not only on the efforts of healthcare professionals but also on the willingness, active participation, and motivation of the patient. In contrast, Research has shown that positive emotions lead to positive therapeutic outcomes, while negative emotions can result in unfavorable outcomes [4][5][6][7]; Low motivation in stroke patients has been shown to increase the difficulty of rehabilitation [8,9]. To assist this large number of stroke victims, new therapy methods such as virtual reality (VR) and interactive video games (IVG) have been developed [10][11][12].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation: a novel evaluation method

Masmoudi,

Zenati,

Izountar

et al. 2024

Multimed Tools Appl

Self Cite

View full text Add to dashboard Cite

Background: This paper presents a novel evaluation method for assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation. Stroke, which is a leading cause of long-term disability, requires effective rehabilitation approaches to facilitate motor recovery and enhance patients' quality of life. The study aims to investigate the potential benefits of incorporating VR technology into upper limb rehabilitation for post-stroke patients, with a specific focus on evaluating patient motivation and engagement. The proposed evaluation method provides insights into the effectiveness of VR serious games as a rehabilitation tool and contributes to the understanding of their impact on post-stroke recovery. Methods: This study involved the recruitment of a diverse sample of 20 patients, 1 both male and female, who had experienced left hemiplegia as a result of an ischemic stroke. To ensure a representative sample, patients of different ages were included. Participants were divided into three groups, with each group invited to participate in different stages over a one-year period. During an eight-week period, all groups participated in a rehabilitation program consisting of virtual reality exercises twice a week, alongside five traditional rehabilitation sessions per week. Furthermore, this study introduces a novel approach using camera-based sensors to evaluate patient engagement in virtual reality exercises. By monitoring and analyzing facial expressions throughout each rehabilitation session, our objective is to leverage emotion recognition technology to understand patients' emotional states and levels of motivation and engagement. Results: The findings from this study indicate that a significant number of patients showed motivation during virtual reality rehabilitation exercises. Conclusion:The analysis of facial expressions utilizing camera-based sensors,yielded valuable insights into the emotional state and level of engagement exhibited by the participants.These findings substantiate the efficacy of virtual reality as a potent tool in fostering motivation among post-stroke patients, thereby actively involving them in rehabilitation exercises and facilitating their journey toward recovery.

show abstract

Section: Emotion Recognitionmentioning

confidence: 99%

Section: Emotion Recognitionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation: a novel evaluation method

Masmoudi,

Zenati,

Izountar

et al. 2024

Multimed Tools Appl

Self Cite

View full text Add to dashboard Cite

show abstract

“…For instance, Valve Software has actively experimented with biometrics by including them in a special build of Left 4 Dead 2. Valve Software sees affect emotion as a crucial component of future games [15]. In the literature review, several methods used for facial expression detection are identified, and the existing systems are contrasted.…”

Section: Pure Science and Technology Applications (Scug-psta-2022)mentioning

confidence: 99%

The Impact of Emotions on the Speed and Score of Computer Games

Sharif

Ghareb

Muhamad

2022

PJBAS

View full text Add to dashboard Cite

This Research has examined how video game affects the performance of the player. Unity tool has been used to create an interactive game with several ball objects that accrue additional points for each participant. Different methods have been used to strike the balls, using the mouse, keyboard, combination of both, and facial emotion. Image processing techniques have been used to match the facial expression with the EMOGI of the balls the players hit. The performance of the game has been affected by facial expressions. The study demonstrates how widely used, and highly engaging face-emotion techniques are in video games. The usage of visual observation concerning traditional input control and emotion input has been examined, and the differences are demonstrated. Our results show that facial emotions improve the technology for video games; in our game, we tested three types of facial emotions: sad, happy, and angry.

show abstract

“…Granato et al [ 19 ] predicted the subjects’ emotions during video game sessions and indicated that the obtained results could improve the game design. Izountar et al [ 20 ] proposed a VR-PEER adaptive exergame system and developed a virtual reality-based serious game as a case study. The test results showed that fifteen participants expressed the usefulness of the system in motor rehabilitation processes.…”

Section: Introductionmentioning

confidence: 99%

A System of Emotion Recognition and Judgment and Its Application in Adaptive Interactive Game

Lin

Zhang

2023

Sensors

View full text Add to dashboard Cite

A system of emotion recognition and judgment (SERJ) based on a set of optimal signal features is established, and an emotion adaptive interactive game (EAIG) is designed. The change in a player’s emotion can be detected with the SERJ during the process of playing the game. A total of 10 subjects were selected to test the EAIG and SERJ. The results show that the SERJ and designed EAIG are effective. The game adapted itself by judging the corresponding special events triggered by a player’s emotion and, as a result, enhanced the player’s game experience. It was found that, in the process of playing the game, a player’s perception of the change in emotion was different, and the test experience of a player had an effect on the test results. A SERJ that is based on a set of optimal signal features is better than a SERJ that is based on the conventional machine learning-based method.

show abstract

VR-PEER: A Personalized Exer-Game Platform Based on Emotion Recognition

Cited by 12 publications

References 47 publications

Assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation: a novel evaluation method

Assessing the effectiveness of virtual reality serious games in post-stroke rehabilitation: a novel evaluation method

The Impact of Emotions on the Speed and Score of Computer Games

A System of Emotion Recognition and Judgment and Its Application in Adaptive Interactive Game

Contact Info

Product

Resources

About