Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines

Riek, Laurel D.

doi:10.5898/jhri.1.1.riek

Cited by 518 publications

(237 citation statements)

References 74 publications

Supporting

Mentioning

206

Contrasting

Unclassified

Order By: Relevance

“…We may think of teleoperation as deception and as an ethical concern-i.e., that by not telling a person up front that a robot is teleoperated, they are being deceived into acting a particular way and treating the robot a particular way [1], [9]. However, throughout scientific research, we deceive participants in research studies.…”

Section: Research Questionsmentioning

confidence: 99%

“…Teleoperation or Wizard-of-Oz (WoZ) control of social robots is a pervasive method used in empirical studies of human-robot interaction (HRI) [1]. Using WoZ control is usually framed as a way to study human behavior with a robotic system that behaves in certain ways before it is potentially possible to build the system in actuality (usually due to technological challenges that have yet to be surmounted).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Transparency, teleoperation, and children's understanding of social robots

Westlund¹,

Breazeal²

2016

2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)

View full text Add to dashboard Cite

Abstract-Teleoperation or Wizard-of-Oz control of social robots is commonly used in human-robot interaction (HRI) research. This is especially true for child-robot interactions, where technologies like speech recognition (which can help create autonomous interactions for adults) work less well. We propose to study young children's understanding teleoperation, how they conceptualize social robots in a learning context, and how this affects their interactions. Children will be told about the teleoperator's presence either before or after an interaction with a social robot. We will assess children's behavior, learning, and emotions before, during, and after the interaction. Our goal is to learn whether children's knowledge about the teleoperator matters (e.g., for their trust and for learning outcomes), and if so, how and when it matters most (e.g. at what age).

show abstract

Section: Research Questionsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Transparency, teleoperation, and children's understanding of social robots

Westlund¹,

Breazeal²

2016

2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)

View full text Add to dashboard Cite

show abstract

“…Previous guidelines highlight the importance of scenario constraints for WoZ experiments. (Dahlbäck et al 1993;Fraser and Gilbert 1991;Green et al 2004;Riek 2012). The scenario constraints allow participants to have a task to solve that requires the use of the system, and where there is not a single way to solve the problem (Riek 2012;Dahlbäck et al 1993).…”

Section: Wizard Of Ozmentioning

confidence: 99%

“…Finally, the WoZ allows an iterative design approach for building user interfaces as it is easy to use, requires little programming and supports rapid testing and interfaces modifications (Klemmer et al 2000). The design of a WoZ experiment may contain different amounts of control ranging from a complete automation of the interaction to an interaction solely dependent on the wizard, as well as mixed-initiative interactions (Riek 2012). Green, Huttenrauch, and Eklundh (2004) set one of the most recognized conditions for conducting a WoZ experiment: the user should have access to specific instructions, the designers should have a behavior hypothesis as well as a specified robot behavior.…”

Section: Wizard Of Ozmentioning

confidence: 99%

Learning culturally situated dialogue strategies to support language learners

Abou-Khalil

Ishida

Otani

et al. 2018

RPTEL

View full text Add to dashboard Cite

Successful language learning requires an understanding of the target culture in order to make valuable usage of the learned language. To understand a foreign culture, language students need the knowledge of its related products, as well as the skill of comparing them to those of their own culture. One way for students to understand foreign products is by making Culturally Situated Associations (CSA), i.e., relating the products they encountered to products from their own culture. In order to provide students with CSA that they can understand, we must gather information about their culture, provide them with the CSA, and make sure they understand it. In this case, a Culturally Situated Dialogue (CSD) must take place. To carry the dialogue, dialogue systems must follow a dialogue strategy. However, previous work showed that handcrafted dialogue strategies were shown to be ineffective in comparison with machine-learned dialogue strategies. In this research, we proposed a method to learn CSD strategies to support foreign students, using a reinforcement learning algorithm. Since no previous system providing CSA was implemented, the method allowed the creation of CSD strategies when no initial data or prototype exists. The method was applied to generate three different agents: the novice agent was based on an eight states feature-space, the intermediate agent was based on a 144 states feature-space, and the advanced agent was based on a 288 states feature-space. Each of these agents learned a different dialogue strategy. We conducted a Wizard of Oz experiment during which, the agents' role was to support the wizard in their dialogue with students by providing them with the appropriate action to take at each step. The resulting dialogue strategies were evaluated based on the quality of the strategy. The results suggest the use of the novice agent at the first stages of prototyping the dialogue system. The intermediate agent and the advanced agent could be used at later stages of the system's implementation.

show abstract

“…Dahlbäck, Jönsson, and Ahrenberg (1993) showed that this paradigm is suitable when high-quality empirical data is required but gathering the data is not a simple task. When designing a WoZ experiment, it is important to consider the role of the wizard and ensure that this role is properly controlled for (Riek, 2012).…”

Section: Wizard Of Ozmentioning

confidence: 99%

How Should a Robot Approach Two People?

Ball

Rye

Silvera-Tawil

et al. 2017

Journal of Human-Robot Interaction

View full text Add to dashboard Cite

Experiments were conducted to quantify the direction of robot approach that a pair of seated people find most comfortable. Three maximally-different seating configurations and eight directions of robot approach were considered. The data were analysed using Rayleigh's test of uniformity, a directional statistics method. Results from 140 participants showed robot approach directions that minimise participant discomfort align spatially with regions that allow good sight of the robot by both people and are centred on the pair's largest unoccupied area of p-space.

show abstract

Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines

Cited by 518 publications

References 74 publications

Transparency, teleoperation, and children's understanding of social robots

Transparency, teleoperation, and children's understanding of social robots

Learning culturally situated dialogue strategies to support language learners

How Should a Robot Approach Two People?

Contact Info

Product

Resources

About