A Semi-automatic Wizard of Oz Technique for Let’sFly Spoken Dialogue System

Karpov, Alexey; Ronzhin, Andrey; Leontyeva, Anastasia

doi:10.1007/978-3-540-87391-4_74

Cited by 5 publications

(10 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This expansion in scope continued with Salber and Coutaz (1993b) who looked at multi-modal interaction, leading to the introduction of multiple wizards. In more recent years WOZ experiments have been used for a variety of purposes, including prototyping multimodal information retrieval (Rajman et al, 2006), testing speech-based ight booking systems (Karpov et al, 2008) and simulating a virtual doorman (Mäkelä et al, 2001).…”

Section: Wizard Of Oz and Its Applicationsmentioning

confidence: 99%

“…In the literature we nd a number of experimental dierences. One commonly used setup places the wizard consecutively after an existing component where he/she is used to selectively correct or overwrite component output (Karpov et al, 2008). This A setting could also use an language technology component to`overwrite' a wizard response.…”

Section: Dialogue Management Toolsmentioning

confidence: 99%

See 1 more Smart Citation

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

2014

View full text Add to dashboard Cite

Wizard of OZ (WOZ) is a well-established method for simulating the functionality and user experience of future systems. Using a human wizard to mimic certain operations of a potential system is particularly useful in situations where extensive engineering effort would otherwise be needed to explore the design possibilities offered by such operations. The WOZ method has been widely used in connection with speech and language technologies, but advances in sensor technology and pattern recognition as well as new application areas such as human-robot interaction have made it increasingly relevant to the design of a wider range of interactive systems. In such cases achieving acceptable performance at the user interface level often hinges on resource intensive improvements such as domain tuning, which are better done once the overall design is relatively stable. While WOZ is recognised as a valuable prototyping technique, surprisingly little effort has been put into exploring it from a methodological point of view. Starting from a survey of the literature, this paper presents a systematic investigation and analysis of the design space for WOZ for language technology applications, and proposes a generic architecture for tool support that supports the integration of components for speech recognition and synthesis as well as for machine translation. This architecture is instantiated in WebWOZa new web-based open-source WOZ prototyping platform. The viability of generic support is explored empirically through a series of evaluations. Researchers from a variety of backgrounds were able to create experiments, independent of their previous experience with WOZ. The approach was further validated through a number of real experiments, which also helped to identify a number of possibilities for additional support, and flagged potential issues relating to consistency in Wizard performance.

show abstract

Section: Wizard Of Oz and Its Applicationsmentioning

confidence: 99%

Section: Dialogue Management Toolsmentioning

confidence: 99%

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

2014

View full text Add to dashboard Cite

show abstract

“…[22] used it to test their multi-modal access to a mediadata base and [13] as an analysis instrument for their spoken dialogue system. Other published examples include simulating a virtual doorman [20] and testing a web based companion [2].…”

Section: Woz and Language Technologymentioning

confidence: 99%

“…Systems like Let's Go [23] and DARPA communicator [31] were used to provide customers with schedule information over the telephone for flights [ 13], trains [17] and buses [29]. Speech technologies have been integrated with MT in prototypes which support multilingual communication during meetings [30], doctor-patient consulations [25] and travelling [21].…”

Section: Language Technology Componentsmentioning

confidence: 99%

“…To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. to automate processes such as buying tickets [13], and the increased usage of web-based machine translation (MT) tools such as Google Translate. Developing and tuning applications incorporating language technology to the point where they can be used with end users can be both time and cost intensive, which makes it difficult to explore design options early in the development lifecycle.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

WebWOZ

Schlögl

Doherty

Karamanis

et al. 2010

Proceedings of the 2nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems

View full text Add to dashboard Cite

Language Technology (LT) based applications become more popular as technology improves. Prototyping early in the design process is critical for the development of high quality applications. It is difficult, however, to do low-fidelity prototyping (e.g. paper prototyping) of applications based on LT. One technique that has been used for this kind of prototyping is Wizard of Oz (WOZ). However, this generally involves the development of one-off user and wizard interfaces. A tool that facilitates the flexible integration of LT components into WOZ experiments is desirable. In this paper we explore the requirements for such a tool, drawing from the literature and a first WOZ experiment in which different wizards were observed and their behaviour was analysed.

show abstract