Distributed Remote Psychophysiological Data Collection for UX Evaluation: A Pilot Project

Vasseur, Aurélie; Léger, Pierre‐Majorique; Courtemanche, François; Labonté-LeMoyne, Élise; Georges, Vanessa; Valiquette, Audrey; Brieugne, David; Rucco, Emma; Coursaris, Constantinos K.; Frédette, Marc; Sénécal, Sylvain

doi:10.1007/978-3-030-78462-1_19

Cited by 10 publications

(3 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This is important because understanding how to design appropriate and accessible IT for these populations has become a topic of increasing concern in UX research [ 65 - 67 ]. Moreover, Axon is suitable for remotely moderated experimentation, a popular strategy since the COVID-19 pandemic [ 68 ] and one that mitigates subject recruitment challenges for all population types. Finally, the current advancement in technology, particularly in the field of artificial intelligence, is trending toward a more personalized and user-centric approach, adapting technology to individual user characteristics such as preferences and interests [ 8 , 69 , 70 ].…”

Section: Discussionmentioning

confidence: 99%

Assessing the Relationship Between Digital Trail Making Test Performance and IT Task Performance: Empirical Study

Depauw,

Boasen,

Léger

et al. 2024

JMIR Hum Factors

Self Cite

View full text Add to dashboard Cite

Background Cognitive functional ability affects the accessibility of IT and is thus something that should be controlled for in user experience (UX) research. However, many cognitive function assessment batteries are long and complex, making them impractical for use in conventional experimental time frames. Therefore, there is a need for a short and reliable cognitive assessment that has discriminant validity for cognitive functions needed for general IT tasks. One potential candidate is the Trail Making Test (TMT). Objective This study investigated the usefulness of a digital TMT as a cognitive profiling tool in IT-related UX research by assessing its predictive validity on general IT task performance and exploring its discriminant validity according to discrete cognitive functions required to perform the IT task. Methods A digital TMT (parts A and B) named Axon was administered to 27 healthy participants, followed by administration of 5 IT tasks in the form of CAPTCHAs (Completely Automated Public Turing tests to Tell Computers and Humans Apart). The discrete cognitive functions required to perform each CAPTCHA were rated by trained evaluators. To further explain and cross-validate our results, the original TMT and 2 psychological assessments of visuomotor and short-term memory function were administered. Results Axon A and B were administrable in less than 5 minutes, and overall performance was significantly predictive of general IT task performance ( F 5,19 =6.352; P =.001; Λ=0.374). This result was driven by performance on Axon B ( F 5,19 =3.382; P =.02; Λ=0.529), particularly for IT tasks involving the combination of executive processing with visual object and pattern recognition. Furthermore, Axon was cross-validated with the original TMT ( P corr =.001 and P corr =.017 for A and B, respectively) and visuomotor and short-term memory tasks. Conclusions The results demonstrate that variance in IT task performance among an age-homogenous neurotypical population can be related to intersubject variance in cognitive function as assessed by Axon. Although Axon’s predictive validity seemed stronger for tasks involving the combination of executive function with visual object and pattern recognition, these cognitive functions are arguably relevant to the majority of IT interfaces. Considering its short administration time and remote implementability, the Axon digital TMT demonstrates the potential to be a useful cognitive profiling tool for IT-based UX research.

show abstract

Section: Discussionmentioning

confidence: 99%

Assessing the Relationship Between Digital Trail Making Test Performance and IT Task Performance: Empirical Study

Depauw,

Boasen,

Léger

et al. 2024

JMIR Hum Factors

Self Cite

View full text Add to dashboard Cite

show abstract

“…Considering the nature of the COVID-19 pandemic, a remote experimental laboratory was made mandatory. The experiment followed guidelines established for remote data collection [78,79].…”

Section: Experimental Designmentioning

confidence: 99%

Comparing the Effectiveness of Speech and Physiological Features in Explaining Emotional Responses during Voice User Interface Interactions

et al. 2022

View full text Add to dashboard Cite

The rapid rise of voice user interface technology has changed the way users traditionally interact with interfaces, as tasks requiring gestural or visual attention are swapped by vocal commands. This shift has equally affected designers, required to disregard common digital interface guidelines in order to adapt to non-visual user interaction (No-UI) methods. The guidelines regarding voice user interface evaluation are far from the maturity of those surrounding digital interface evaluation, resulting in a lack of consensus and clarity. Thus, we sought to contribute to the emerging literature regarding voice user interface evaluation and, consequently, assist user experience professionals in their quest to create optimal vocal experiences. To do so, we compared the effectiveness of physiological features (e.g., phasic electrodermal activity amplitude) and speech features (e.g., spectral slope amplitude) to predict the intensity of users’ emotional responses during voice user interface interactions. We performed a within-subjects experiment in which the speech, facial expression, and electrodermal activity responses of 16 participants were recorded during voice user interface interactions that were purposely designed to elicit frustration and shock, resulting in 188 analyzed interactions. Our results suggest that the physiological measure of facial expression and its extracted feature, automatic facial expression-based valence, is most informative of emotional events lived through voice user interface interactions. By comparing the unique effectiveness of each feature, theoretical and practical contributions may be noted, as the results contribute to voice user interface literature while providing key insights favoring efficient voice user interface evaluation.

show abstract

“…Their framework, which includes thorough training, guides this remote data collection. In a related study, Vasseur et al (2021) pilot tested remote electrodermal activity and electrocardiogram data collection. Innovative progress towards improving the ecological validity of neurophysiological tools is continuing.…”

Section: Designing a Research Program With Complementary Neurophysiol...mentioning

confidence: 99%

Embracing brain and behaviour: Designing programs of complementary neurophysiological and behavioural studies

Kirwan

Vance

Jenkins

et al. 2022

Information Systems Journal

View full text Add to dashboard Cite

NeuroIS-the methods and knowledge of neuroscience applied to the information systems (IS) domain-has become an established research field within the IS discipline. A key advantage of NeuroIS is its ability to provide insights into human cognition beyond those obtained using behavioural techniques alone. Nevertheless, in neuroscience, there is renewed interest in examining behaviour together with neurophysiological methods to better inform our understanding of neural processes. In this research opinion article, we argue that in the field of NeuroIS, there is an opportunity for hybrid programs of study that combine neurophysiological and behavioural methods in a complementary manner. We outline four strategies for designing complementary neurophysiological and behavioural experiments in a research program: (1) observe the relationship between neural processes and behavioural change; (2) combine neurophysiological and behavioural methods to enhance internal, external, and ecological validity; (3) extend, rather than replicate, experiments based on theory; and (4) use neurophysiological and behavioural experiments together to evaluate IT artefact design. By applying these strategies, researchers can more effectively design programs using

show abstract

Distributed Remote Psychophysiological Data Collection for UX Evaluation: A Pilot Project

Cited by 10 publications

References 12 publications

Assessing the Relationship Between Digital Trail Making Test Performance and IT Task Performance: Empirical Study

Assessing the Relationship Between Digital Trail Making Test Performance and IT Task Performance: Empirical Study

Comparing the Effectiveness of Speech and Physiological Features in Explaining Emotional Responses during Voice User Interface Interactions

Embracing brain and behaviour: Designing programs of complementary neurophysiological and behavioural studies

Contact Info

Product

Resources

About