Delayed system response times affect immediate physiology and the dynamics of subsequent button press behavior

Abstract

System response time research is an important issue in human-computer interactions. Experience with technical devices and general rules of human-human interactions determine the user's expectation, and any delay in system response time may lead to immediate physiological, emotional, and behavioral consequences. We investigated such effects on a trial-by-trial basis during a human-computer interaction by measuring changes in skin conductance (SC), heart rate (HR), and the dynamics of button press responses. We found an increase in SC and a deceleration of HR for all three delayed system response times (0.5, 1, 2 s). Moreover, the data on button press dynamics was highly informative since subjects repeated a button press with more force in response to delayed system response times. Furthermore, the button press dynamics could distinguish between correct and incorrect decisions and may thus even be used to infer the uncertainty of a user's decision.

The Influence of Emotion on Keyboard Typing: An Experimental Study Using Auditory Stimuli

“…Second, how large are the variances contributed by emotions in these keystroke features? Furthermore, as suggested in earlier studies [21, 38], we expected a significantly longer keystroke duration to negative emotional stimuli.…”

“…Our finding supports previous studies [1, 37, 40, 41] that aimed to build classification model of emotions through keystroke data. Shorter keystroke duration is found when arousal is high (106.70 ms ± 23.80) compared to the keystroke duration when arousal is low (108.76 ms ± 24.52), which implies that button presses may have been carried out with less strength [21] when arousal was low. This result indicates an increased keystroke duration when the subjects experienced tired, sad, or bored [53, 54].…”

“…is an instance with the target label or not with the target label), were 75% on average. The latency features can be understood as the speed of typing on the keys [38], whereas the duration features may be understood as the force used for pressing the keys [21]. The study [1] built the model by using the ML algorithms and also a correlation-based feature subset attribute selection method [39].…”

“…Although the keystroke features that were used to build the model with the highest accuracy rate were reported, the relationship between emotion and keystroke dynamics, still, was not provided. Notably, latest study in the area of psychophysiology [21] examined Heart Rate (HR), Skin Conductance Response (SCR), and the dynamics of button presses after an unexpected delayed system response of a user interface. The study [21] reported that the immediate feedback trials that followed delayed feedback trials showed a significant higher SCR, lower HR, stronger button press intensity, and longer duration compared to trials that followed immediate feedback trials.…”

“…Notably, latest study in the area of psychophysiology [21] examined Heart Rate (HR), Skin Conductance Response (SCR), and the dynamics of button presses after an unexpected delayed system response of a user interface. The study [21] reported that the immediate feedback trials that followed delayed feedback trials showed a significant higher SCR, lower HR, stronger button press intensity, and longer duration compared to trials that followed immediate feedback trials. Furthermore, more results related to classification on emotional data using feature set similar to the feature sets used in the previous studies [1, 36, 37] have been proposed recently.…”