Navigational abilities in audial voice-controlled dialogue structures

Goldstein, Mikael; Bretan, Ivan; Sallnäs, Eva-Lotta; Bjork, H.

doi:10.1080/014492999119138

Cited by 14 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…And so, a related research topic is the development of efficient methods of evaluation. There are a variety of such methods in use, such as "wizard of oz", where the user unwittingly interacts with a human instead of a system [2,4,5,11,16,30,31]. Clearly this is efficient, since implementation is delayed until evidence is gathered on problems in the interface.…”

Section: Discussionmentioning

confidence: 99%

Using paper mockups for evaluating soft keyboard layouts

MacKenzie

Read

2007

Proceedings of the 2007 Conference of the Center for Advanced Studies on Collaborative Research - CASCON '07

View full text Add to dashboard Cite

Five experiments were conducted to compare soft keyboard layouts. The methodology involved paper mockups and manual timing in a classroom situation. Students worked in pairs -one as experimenter, one as participant -swapping roles midway through the experiment. Participants used a stylus to tap the well-known "quick brown fox" phrase five times on each layout. Entry speeds, computed from the measured time to enter the phrase, were 26.5 to 34.5 wpm for the Qwerty keyboard layout, 12.3 to 14.7 wpm for the Opti layout, 15.7 wpm for the Fitaly layout, 12.1 and 12.3 for a Qwerty-Phone (QP) hybrid layout, and 19.0 to 23.0 wpm for the standard phone keypad layout. The merits and limitations of the evaluation method are discussed.

show abstract

Section: Discussionmentioning

confidence: 99%

Using paper mockups for evaluating soft keyboard layouts

MacKenzie

Read

2007

Proceedings of the 2007 Conference of the Center for Advanced Studies on Collaborative Research - CASCON '07

View full text Add to dashboard Cite

show abstract

“…Exploring relatively open interaction spaces, Bradley et al (2009) used WOZ to evaluate users' experiences when interacting with a web-based social companion, Goldstein et al (1999) employed it to investigate navigation in voice-controlled dialogues, and Davis (1998) tested the advantages of active help when using an unfamiliar software application. Further examples of WOZ experimentation and how they are used can be found in Dahlbäck et al (1993).…”

Section: Wizard Of Oz and Its Applicationsmentioning

confidence: 99%

“…In more recent years WOZ experiments have been used for a variety of purposes, including prototyping multimodal information retrieval (Rajman et al, 2006), testing speech-based flight booking systems (Karpov et al, 2008) and simulating a virtual doorman (Mäkelä et al, 2001). Exploring relatively open interaction spaces, Bradley et al (2009) used WOZ to evaluate users' experiences when interacting with a web-based social companion, Goldstein et al (1999) employed it to investigate navigation in voice-controlled dialogues, and Davis (1998) tested the advantages of active help when using an unfamiliar software application. Further examples of WOZ experimentation and how they are used can be found in Dahlbäck et al (1993).…”

Section: Wizard Of Oz and Its Applicationsmentioning

confidence: 99%

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

2014

View full text Add to dashboard Cite

Wizard of OZ (WOZ) is a well-established method for simulating the functionality and user experience of future systems. Using a human wizard to mimic certain operations of a potential system is particularly useful in situations where extensive engineering effort would otherwise be needed to explore the design possibilities offered by such operations. The WOZ method has been widely used in connection with speech and language technologies, but advances in sensor technology and pattern recognition as well as new application areas such as human-robot interaction have made it increasingly relevant to the design of a wider range of interactive systems. In such cases achieving acceptable performance at the user interface level often hinges on resource intensive improvements such as domain tuning, which are better done once the overall design is relatively stable. While WOZ is recognised as a valuable prototyping technique, surprisingly little effort has been put into exploring it from a methodological point of view. Starting from a survey of the literature, this paper presents a systematic investigation and analysis of the design space for WOZ for language technology applications, and proposes a generic architecture for tool support that supports the integration of components for speech recognition and synthesis as well as for machine translation. This architecture is instantiated in WebWOZa new web-based open-source WOZ prototyping platform. The viability of generic support is explored empirically through a series of evaluations. Researchers from a variety of backgrounds were able to create experiments, independent of their previous experience with WOZ. The approach was further validated through a number of real experiments, which also helped to identify a number of possibilities for additional support, and flagged potential issues relating to consistency in Wizard performance.

show abstract

“…Examples of in-house commercial use of the technique include the third generation Wizard's ANswering Device (WAND III) developed by Telia Research AB (Goldstein et al 1999). In many cases, WOZ experiments are outsourced to specialist consultants.…”

Section: Figure2 Typical Architecture Of a Woz Speech Application Exmentioning

confidence: 99%

The Diffusion of WOZ: Expanding the Topology of IS Innovations

Costello

Donnellan

2007

Journal of Information Technology

View full text Add to dashboard Cite

The growth and diffusion of self-service technology (SST) over the last decade has resulted in an increasing number of business and government transactions being completed without human assistance. One innovation in this area, the speech-enabled business system, is characterised by complex implementations that bring together language processing technologies, applications development and end-user psychology. A resulting secondary innovation, the Wizard-of-Oz (WOZ) experiment is a valuable technique for simulating and building human-machine prototypes to ensure successful deployment of the completed service. The objective of the paper is to examine these innovations in relation to the changing business landscape; the technology and innovation literature, and the population of likely adopters. The review is carried out by placing the author's former experience as a practitioner within current theoretical research frameworks. The result is a number of suggestions relating to both IT technology research and IT innovation research. Firstly, it proposes the simplification and diffusion of the WOZ methodology to support the growth in demand for automated e-business transactions that is mindful of human and ethical challenges. Secondly, the paper argues that because self-service technology and business extends the traditional boundaries of the customer service function, it now needs to be incorporated into Swanson's tri-core innovation typology. The paper concludes by presenting the suggested reorientation of IS research that incorporates an outward facing perceptive as a conceptual model.

show abstract

Navigational abilities in audial voice-controlled dialogue structures

Cited by 14 publications

References 5 publications

Using paper mockups for evaluating soft keyboard layouts

Using paper mockups for evaluating soft keyboard layouts

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools

The Diffusion of WOZ: Expanding the Topology of IS Innovations

Contact Info

Product

Resources

About