Combining Implicit and Explicit Methods for the Evaluation of an Ambient Persuasive Factory Display

Abstract

Abstract. Research in ambient intelligent systems faces a challenging endeavor, namely the evaluation of user experience of ambient displays. Due to the fact that ambient displays should be unobtrusive, it is hard for users to appraise them on a reflective level (i.e. interviews and questionnaires). In this paper we present a methodological approach that combines an implicit (the Affect Misattribution Procedure (AMP)) and an explicit measurement technique (questionnaire for the persuasive effect (PeQ)) to tackle this problem. We used this approach in a study of an interface (Operator Guide) that provides information to operators in a semiconductor factory. Results show that the implicit technique is better suited to assess fine attitudinal differences on how users experience the display than explicit questionnaires. However, explicit measures are valuable to gain suggestions for improvements and thus it is concluded that this method triangulation adds value for the research on ambient persuasive interfaces.

Insights from User Experience Research in the Factory: What to Consider in Interaction Design

“…Furthermore, the studies were the basis for designs and UX prototypes. In these designs, we focused on wearable devices [26], [28], or ambient, persuasive displays in the factory [7], [22], [23], [36].…”

“…How easy the interface is to handle in the interaction [7], [17], [18], [23] Performance Expectancy Degree to which a worker believes that using the system will support his/her performance [31], [34], [35], [36] Satisfaction Workers' contentment with the interaction [17], [18], [33], [35], [44]…”

Designing Socially Embedded Technologies in the Real-World

“…We aim to evaluate all our novel contextual interfaces at some point by the means of observational studies in the factory (taking into account the lessons learned, such as the need for expert discussions before the observation and the company of a technician to discuss behavior observations in parallel). A first "in-the-wild" study was already conducted to explore the actual usage of the Operator Guide and showed us unexpected usages and interpretations of the display (see Strasser et al 2012).…”

“…Thereby, we built our own "HCI-semiconductor experience laboratory," which allows us to study redesigns before going back into the factory. By means of this system, we already successfully evaluated the Operator Guide in a laboratory setting (Strasser et al 2012). However, another challenge that needed to be solved was the recruitment of representative study participants.…”

Designing wearable devices for the factory: Rapid contextual experience prototyping

“…We believe that in a context where it is required to apply carefully adjusted measures in order to avoid affecting user experience evaluation [11], experience prototypes can be a valuable mean to communicate design ideas to industrial stakeholders and to transport the wearable interaction paradigm into the context of a semiconductor factory. To transport such an interaction paradigm in this context is challenging due to a variety of factors that need to be considered.…”