The state of user experience evaluation practice

Abstract

Despite the growing importance for practice, user experience is often a blurry and doubtful concept both for newcomers and for the industry. Such ambiguity stems from a emergent community of practitioners with diverse backgrounds, to whom user experience encompasses countless interpretations. This paper reports on an online survey deployed to grasp the state of user experience evaluation practice. We learned that evaluations are mainly conducted by HCIs, software engineers or designers and are perceived to strongly impact the user interface, as well as the business logic level. Additionally, informal, low cost methods are widely used and, although most methods rely on paper prototypes, a single artifact is used per evaluation and working prototypes are favored. Moreover, evaluations happen at multiple project phases and various methods are used. Finally, results shows that evaluations are constrained by evaluators' background or occupation. This compels the community to pursue an end-to-end methodology to prevent it.

Subjectively Experienced Time and User Satisfaction: An Experimental Study of Progress Indicator Design in Mobile Application

“…In recent decades, User Experience (UX) has attracted the interest of both academics and industry practitioners. With increasing maturity of an industry, usability is more and more taken for granted [20]. Hence, it is not surprising that the concept of UX is widely discussed within the Human-Computer Interaction (HCI) community [21,22].…”

UXmood—A Sentiment Analysis and Information Visualization Tool to Support the Evaluation of Usability and User Experience

“…To measure user experience, Alves et al [16] suggest that the main methods used are observation, think aloud, contextual, interviews/inquiries, prototyping, task analysis, cognitive walkthrough and questionnaires. Conventional methods for collecting and subsequently assessing user opinions are post-interaction, as a retrospective verbal or written self-report questionnaires [17][18][19].…”

Evaluación de la experiencia de usuario en el contexto cubano

“…Las investigaciones sobre UX se enfocan en emociones positivas como la alegría, la diversión, confianza u orgullo más que en los detalles negativos de un producto [3]. El trabajo dirigido a potenciar la aprobación del cliente, puede garantizar un lugar prevaleciente en el mercado [23]. Su importancia presiona a las compañías a integrar métodos y técnicas dirigidos a mejorar la UX.…”