Message Oriented Middleware for Flexible Wizard of Oz Experiments in HCI

Otto, Mirko; Friesen, Rafael; Rösner, Dietmar

doi:10.1007/978-3-642-21602-2_14

Cited by 5 publications

(3 citation statements)

References 8 publications

(14 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…WOZ functionality can also be found in Topiary (Li et al, 2004) and BrickRoad (Liu and Li, 2007), tools for prototyping location-enhanced applications. Finally, Liu et al (2009) describe a WOZ interface to support the study of information presentation strategies for spoken dialogue systems and, Otto et al (2011) developed a tool based on the SEMAINE framework 7 , a multi-modal dialogue system that aims at sustaining conversations with human users.…”

Section: Pure Woz Toolsmentioning

confidence: 99%

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

2014

View full text Add to dashboard Cite

Wizard of OZ (WOZ) is a well-established method for simulating the functionality and user experience of future systems. Using a human wizard to mimic certain operations of a potential system is particularly useful in situations where extensive engineering effort would otherwise be needed to explore the design possibilities offered by such operations. The WOZ method has been widely used in connection with speech and language technologies, but advances in sensor technology and pattern recognition as well as new application areas such as human-robot interaction have made it increasingly relevant to the design of a wider range of interactive systems. In such cases achieving acceptable performance at the user interface level often hinges on resource intensive improvements such as domain tuning, which are better done once the overall design is relatively stable. While WOZ is recognised as a valuable prototyping technique, surprisingly little effort has been put into exploring it from a methodological point of view. Starting from a survey of the literature, this paper presents a systematic investigation and analysis of the design space for WOZ for language technology applications, and proposes a generic architecture for tool support that supports the integration of components for speech recognition and synthesis as well as for machine translation. This architecture is instantiated in WebWOZa new web-based open-source WOZ prototyping platform. The viability of generic support is explored empirically through a series of evaluations. Researchers from a variety of backgrounds were able to create experiments, independent of their previous experience with WOZ. The approach was further validated through a number of real experiments, which also helped to identify a number of possibilities for additional support, and flagged potential issues relating to consistency in Wizard performance.

show abstract

Section: Pure Woz Toolsmentioning

confidence: 99%

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

2014

View full text Add to dashboard Cite

show abstract

“…La plupart des expériences réalisées avec un Magicien d'Oz ne sont pas réutilisables (Salber, Coutaz, 1993 ;Douglas-Cowie et al, 2008 ;Otto et al, 2011) de par leur lien étroit avec le contexte considéré. DiaWOZ-II propose une interface textuelle dans un contexte de tutorat.…”

Section: Magicien D'ozunclassified

Modélisation de dialogues pour personnage virtuel narrateur

Serban¹,

Bersoult²,

Alès³

et al. 2014

Revue d'intelligence artificielle

View full text Add to dashboard Cite

International audienceDans l'optique de concevoir un agent conversationnel animé narratif et affectif, cet article montre l'importance de l'interaction dans le processus de narration à des enfants. Deux méthodes d'extraction de régularités ont été appliquées à des dialogues de narration parent-enfant aﬁn de les modéliser. Les modèles extraits ont été évalués au cours d'une session de narration interactive de type Magicien d'Oz durant laquelle les enfants ont communiqué avec un personnage virtuel et un adulte en visio-conférence. L'expérience montre que les enfants s'engagent bien dans l'interaction avec le personnage virtuel mais que les modalités pour interagir diffèrent légèrement de celles utilisés avec l'adulte. ------------ To develop a narrative affective virtual agent, this article shows the importance of interaction modalities in storytelling environments. Building a narrative dialogue model requires a state transition that is computed automatically using various pattern extraction methods. These models are tested in a "Wizard-of-Oz" context, in a storytelling environment where the children are challenged to interact with a virtual character, by modelling several key points of interaction. We compare the level of engagement in two different narration contexts: virtual character or adult in video conference mode. Our experiments showed that the engagement exists, but the modality of the interaction feedback varies in the two contexts

show abstract

“…Critical events are not induced by a "dysfunction" of the companion system but by an enforced strategy-change and additionally occurring constraints that complicate task completion. The software architecture is described in [13]. The WOZ experiment comprises two submodules [6].…”

Section: A Wizard Of Oz Experimentsmentioning

confidence: 99%

Intentionality in Interacting with Companion Systems – An Empirical Approach

Rösner

Friesen

Otto

et al. 2011

Human-Computer Interaction. Towards Mobile and Intelligent Interaction Environments

Self Cite

View full text Add to dashboard Cite

We report about a WOZ experiment with a carefully designed scenario that allows to investigate how users interact with a companion system in a mundane situation with the need for planning, re-planning and strategy change. The data collection from the experiments comprises multimodal records (audio, video, biopsychological parameters) and transcripts of the verbal interaction, and all subjects fill out a battery of well established psychometric questionnaires about various aspects especially of their personality. This will allow to correlate observed behaviour and detected affects and emotions with measured aspects of the personality of subjects and is expected to serve as a basis for defining a typology of users. In addition, a subgroup of the subjects takes part in semiformal in-depth interviews that focus on retrospective reflexion of the users' subjective experience during the experiments and especially on the intentionality that users ascribed to the system during the course of interaction.

show abstract

Message Oriented Middleware for Flexible Wizard of Oz Experiments in HCI

Cited by 5 publications

References 8 publications

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

Modélisation de dialogues pour personnage virtuel narrateur

Intentionality in Interacting with Companion Systems – An Empirical Approach

Contact Info

Product

Resources

About