Playing Charades with a Robot: Collecting a Large Dataset of Human Gestures Through HRI

Wit, Jan de; Willemsen, Bram; Haas, Mirjam de; Krahmer, Emiel; Vogt, Paul; Merckens, Marije; Oostdijk, Reinjet; Savelberg, Chani; Verdult, Sabine; Wolfert, Pieter

doi:10.1109/hri.2019.8673220

Cited by 4 publications

(2 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A poster with the design of this experiment was presented at the Gesture & Technology Workshop 2018 at Warwick University. Furthermore, a short paper was published and presented as a poster at the Annual Conference on Human-Robot Interaction (HRI2019) (de Wit et al, 2019), and this poster was also presented at the GESPIN 2019 conference. We thank the attendees to these events for their valuable feedback.…”

Section: Open Practices Statementmentioning

confidence: 99%

Introducing the NEMO-Lowlands iconic gesture dataset, collected through a gameful human–robot interaction

2020

Self Cite

View full text Add to dashboard Cite

This paper describes a novel dataset of iconic gestures, together with a publicly available robot-based elicitation method to record these gestures, which consists of playing a game of charades with a humanoid robot. The game was deployed at a science museum (NEMO) and a large popular music festival (Lowlands) in the Netherlands. This resulted in recordings of 428 participants, both adults and children, performing 3715 silent iconic gestures for 35 different objects in a naturalistic setting. Our dataset adds to existing collections of iconic gesture recordings in two important ways. First, participants were free to choose how they represented the broad concepts using gestures, and they were asked to perform a second attempt if the robot did not recognize their gesture the first time. This provides insight into potential repair strategies that might be used. Second, by making the interactive game available we enable other researchers to collect additional recordings, for different concepts, and in diverse cultures or contexts. This can be done in a consistent manner because a robot is used as a confederate in the elicitation procedure, which ensures that every data collection session plays out in the same way. The current dataset can be used for research into human gesturing behavior, and as input for the gesture recognition and production capabilities of robots and virtual agents.

show abstract

Section: Open Practices Statementmentioning

confidence: 99%

Introducing the NEMO-Lowlands iconic gesture dataset, collected through a gameful human–robot interaction

2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…While there are numerous works on robot-assisted play in Human-Robot Interaction (HRI) (Adams et al, 2008;Azizi, 2022;Canas et al, 2022;Dautenhahn et al, 2009;de Wit et al, 2019;Kanda et al, 2022;Kronreif et al, 2007;Kronreif et al, 2005;Lathan et al, 2005;Minamoto & Zhang, 2023;Rios-Rincon et al, 2016;Sandoval et al, 2021;Timmerman & Ligthart, 2023;Van den Heuvel et al, 2017a;Van den Heuvel et al, 2017b;Wiberg et al, 2006;Yang et al, 2021) (and many more), such play scenarios usually are setup so that the childrobot interaction is central to the activity, rather than child-child interaction (see (Muñoz & Dautenhahn, 2021) for a review). Using robots as mediators rather than a play partner has been explored in past studies (Papadopoulos et al, 2012;Vázquez et al, 2011), however such studies used robots that were not specifically designed for mediating play.…”

Section: Introductionmentioning

confidence: 99%

Towards accessible robot-assisted physical play for children with physical disabilities

Mahdi,

Jouaiti,

Saleh

et al. 2024

View full text Add to dashboard Cite

MyJay is an open-source robot designed to facilitate play between children with and without physical disabilities. The robot acts as a proxy for children with upper limb challenges, allowing them to participate in physical games with their peers. Our design was inspired by the FIRST Robotics Competition, which involves teleoperating robots to manipulate objects. Taking a user-centred perspective, we consulted therapists and conducted remote interviews with children with disabilities and their guardians at various stages of the design process. We then conducted an in-person feasibility study with 18 typically developing children in a school setting. The study involved children teleoperating the robot to pick up and throw balls into a designated goal, and the interaction was evaluated using the user experience questionnaire and the Robotic Social Attributes Scale. The results of the study show great potential for MyJay to act as a play mediator in various scenarios, and the response from the children was positive. The ultimate aim of our research agenda is to pave the way towards creating more inclusive play environments through robot-mediated interactions, breaking barriers posed by physical limitations.

show abstract

SLAM Based Indoor Autonomous Navigation System For Electric Wheelchair

Sun

Kong

et al. 2022

2022 7th International Conference on Automation, Control and Robotics Engineering (CACRE)

View full text Add to dashboard Cite

Playing Charades with a Robot: Collecting a Large Dataset of Human Gestures Through HRI

Cited by 4 publications

References 5 publications

Introducing the NEMO-Lowlands iconic gesture dataset, collected through a gameful human–robot interaction

Introducing the NEMO-Lowlands iconic gesture dataset, collected through a gameful human–robot interaction

Towards accessible robot-assisted physical play for children with physical disabilities

SLAM Based Indoor Autonomous Navigation System For Electric Wheelchair

Contact Info

Product

Resources

About