Towards developing a tool for UX evaluation using facial expression

Munim, Kazi Md.; Islam, Iyolita; Khatun, Mahmuda; Karim, Mahboob; Islam, Muhammad Nazrul

doi:10.1109/eict.2017.8275227

Cited by 16 publications

(14 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…To understand UX based on emotions and facial expressions, the participants completed a series of tasks while sitting in front of a traditional PC equipped with a camera, allowing the software to measure the emotional reactions they had while interacting with a website, as this approach has been previously explored with positive results from pioneering studies (Hazlett, 2003). The technique of facial expression analysis has been used little by researchers of UX (Branco, 2006;Munim et al, 2017) despite its value in clarifying the frustration and joy of users during their interactions. According to Hancock et al, "Hedonomics, " (Hancock et al, 2005) defined as "the promotion of pleasurable human-machine interaction" by its creators, it is possible to highlight the key role of the so-called "emotional design" (Norman, 2004) as a fundamental factor in UX.…”

Section: Related Research Workmentioning

confidence: 99%

Applying Implicit Association Test Techniques and Facial Expression Analyses in the Comparative Evaluation of Website User Experience

et al. 2021

View full text Add to dashboard Cite

This research project has the goal to verify whether the application of neuromarketing techniques, such as implicit association test (IAT) techniques and emotional facial expressions analyses may contribute to the assessment of user experience (UX) during and after website navigation. These techniques have been widely and positively applied in assessing customer experience (CX); however, little is known about their simultaneous application in the field of UX. As a specific context, the experience raised by different websites from two well-known automotive brands was compared. About 160 Italian university students were enrolled in an online experimental study. Participants performed a Brand Association Reaction Time Test (BARTT) version of the IAT where the two brands were compared according to different semantic dimensions already used in the automotive field. After completing the BARTT test, the participants navigated the target website: 80 participants navigated the first brand website, while the other half navigated the second brand website (between-subject design). During the first 3 min of website navigation, emotional facial expressions were recorded. The participants were asked to freely navigate the website home page, look for a car model and its characteristics and price, use the customising tool, and in the end, look for assistance. After the website navigation, all the participants performed, a second time, the BARTT version of the IAT, where the two brands were compared again, this time to assess whether the website navigation may impact the Implicit Associations previously detected. A traditional evaluation of the two websites was carried on by means of the classic heuristic evaluation. Findings from this study show, first of all, the significant results provided by neuromarketing techniques in the field of UX, as IAT can provide a positive application for assessing UX played by brand websites, thanks to the comparison of eventual changes in time reaction between the test performed before and after website navigation exposure. Secondly, results from emotional facial expression analyses during the navigation of both brand websites showed significant differences between the two brands, allowing the researchers to predict the emotional impact raised by each website. Finally, the positive correlation with heuristic evaluation shows that neuromarketing can be successfully applied in UX.

show abstract

Section: Related Research Workmentioning

confidence: 99%

Applying Implicit Association Test Techniques and Facial Expression Analyses in the Comparative Evaluation of Website User Experience

et al. 2021

View full text Add to dashboard Cite

show abstract

“…Also, there is no standard to follow [6,29,30]. This work aims to select the most important and generic guidelines.…”

Section: Heuristics Guidelines and Recommendationsmentioning

confidence: 99%

“…This work aims to select the most important and generic guidelines. Some of the resources to analyze these guidelines were obtained from [6,11,27,28,[30][31][32][33]. 103 generic recommendations are extracted and analyzed [8,28,33] to choose only those useful for any domain.…”

Section: Heuristics Guidelines and Recommendationsmentioning

confidence: 99%

Compliance and application tests of usability guidelines about giving information quickly and comprehensibly

Alonso-Virgós

Espada

Martínez

et al. 2020

Complex Intell. Syst.

View full text Add to dashboard Cite

The objective of this publication is to analyze compliance with the web usability guidelines on Giving information quickly and comprehensibly. The behavior of 20 IT engineers without experience in web usability is analyzed to collect data on the application and compliance of each of the studied guidelines. The objectives are: (1) make a list of recommendations on the presentation of information and possible actions in a quickly understandable way. And highlight the most forgotten guidelines or the worst followed by web developers to think about the importance of offering specific training in this field. (2) Know the most important guidelines according to the participants themselves. To obtain the results, user tests are performed that evaluate the most ignored and applied guidelines. And its correct compliance is studied, since the participants do not have experience in web usability. Besides, interviews are conducted to find out which are the guidelines that they consider most important. It is expected to know if there are guidelines that apply intuitively and why. It is also intended to know if this innate application is helpful or compliance is wrong and needs specific training.

show abstract

“…The more common type of classification is textual, whether in audio transcription or product reviews on the Internet [1,8,[30][31][32][33][34]. References [8,30,31,33,35] record the user's face for use in sentiment analysis algorithms based on facial expressions. User speech capture is present in six works [8,[30][31][32][33]36] but only four works [8,30,31,36] use audio features to perform sentiment analysis.…”

Section: Related Workmentioning

confidence: 99%

“…References [1,8,30,[35][36][37][38][39][40] present some data visualization techniques to represent the results, with the most common being wordcloud, heatmap, and histogram. Only two studies [8,36] use sensors, such as eye trackers, to identify the area that the user is observing.…”

Section: Related Workmentioning

confidence: 99%

UXmood—A Sentiment Analysis and Information Visualization Tool to Support the Evaluation of Usability and User Experience

et al. 2019

View full text Add to dashboard Cite

This paper presents UXmood, a tool that provides quantitative and qualitative information to assist researchers and practitioners in the evaluation of user experience and usability. The tool uses and combines data from video, audio, interaction logs and eye trackers, presenting them in a configurable dashboard on the web. The UXmood works analogously to a media player, in which evaluators can review the entire user interaction process, fast-forwarding irrelevant sections and rewinding specific interactions to repeat them if necessary. Besides, sentiment analysis techniques are applied to video, audio and transcribed text content to obtain insights on the user experience of participants. The main motivations to develop UXmood are to support joint analysis of usability and user experience, to use sentiment analysis for supporting qualitative analysis, to synchronize different types of data in the same dashboard and to allow the analysis of user interactions from any device with a web browser. We conducted a user study to assess the data communication efficiency of the visualizations, which provided insights on how to improve the dashboard.

show abstract

Towards developing a tool for UX evaluation using facial expression

Cited by 16 publications

References 24 publications

Applying Implicit Association Test Techniques and Facial Expression Analyses in the Comparative Evaluation of Website User Experience

Applying Implicit Association Test Techniques and Facial Expression Analyses in the Comparative Evaluation of Website User Experience

Compliance and application tests of usability guidelines about giving information quickly and comprehensibly

UXmood—A Sentiment Analysis and Information Visualization Tool to Support the Evaluation of Usability and User Experience

Contact Info

Product

Resources

About