Detecting emotional stress during typing task with time pressure

Abstract

Abstract-Automated stress detection is important in developing adaptive e-learning systems. Empirical evidence suggests that mouse dynamics and keyboard dynamics analyses can be both effective in user behaviour modelling as well as emotion detection compared to physiological measures and facial expression recognitions, and yet they are far less expensive and considered non-intrusive. This paper investigates how mouse dynamics and keyboard dynamics can be affected by emotional stress, particularly stress induced by time pressure, text length and language familiarity. Our research findings show that longer text and unfamiliar language raise users' stress perceptions. Demanding job such as long typing task could result in anomalous behaviours once the users have lost motivation. Language familiarity mainly affects keyboard behaviour but text length change mouse behaviour. This shows that there is a good potential of developing an adaptive e-learning system by detecting learners' emotional stress from keyboard and mouse input.

Continuous Stress Monitoring under Varied Demands Using Unobtrusive Devices

“…MEASUREMENT USING MOUSE/KEYSTROKE DYNAMICS This research extends the previous work done by Lim et al, which examined the effects of search task (menu design) (Lim et al, 2014c(Lim et al, , 2016b, assessment (mental arithmetic) (Lim, Ayesh, & Stacey, 2014a, 2015b) and text typing (Lim, Ayesh, & Stacey, 2014b, 2015a demands on user stress perceptions, mouse dynamics, keystroke dynamics and job mouse click was only affected by error rate. On the other side, when the users spent longer time in the search task, they demonstrated longer mouse idle time, but slower mouse speed.…”

“…Self-reporting is believed more relevant as only the participant knows how stressed that he or she felt. On the other side, mouse and keyboard dynamicsdriven approaches, are considered as new methods that are able to collect inner state information from a user automatically , where research by (Carneiro Lim et al, 2014aLim et al, , 2014bLim et al, , 2015aLim, Ayesh, & Stacey, 2016a;Lim et al, 2016b;Vizer, 2009)have shown the correlations between stress and keyboard and mouse dynamics. Therefore, we would like to examine whether the mouse and keyboard dynamics-driven approaches could be used to predict what a user perceives.…”

The effect of socially evaluated multitasking stress on typing rhythms

“…Later studies have attempted to elicit stress either through manipulating the demands associated with the typing stimuli, or through exposure to additional stress. Lim et al (2014a) induced demand through imposing time restraints while participants typed letter strings of varying lengths in either familiar or unfamiliar languages. Greater levels of self‐reported stress were noted following the typing of longer, unfamiliar texts; however, there were no effects of time pressure.…”

“…Specifically, studies typically have small sample sizes; they vary in terms of their measures of typing rhythms and / or the validity of the stressor paradigms and the verification of stress manipulations; or the reporting of methodological details is insufficient to draw appropriate conclusions or allow for replication. Indeed, Lim et al (2014aLim et al ( , 2014b call for more rigorous experiments to verify the effects of psychological state on typing rhythms.…”