Sounding others’ sensations in interaction

Keevallik, Leelo; Hofstetter, Emily; Weatherall, Ann; Wiggins, Sally

doi:10.1080/0163853x.2023.2165027

Cited by 8 publications

(4 citation statements)

References 81 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Such vocalizations are less accountable than lexical speech and can therefore be particularly useful for navigating delicate matters (see e.g. Ogden, 2020) or for conveying a strained body (Hofstetter, Keevallik, & Löfgren, 2021;Keevallik, 2023). For robots, this means that sound is a subtle tool, which is particularly suitable for facilitating interaction in intuitive and implicit ways (Ju, 2015).…”

Section: Discussionmentioning

confidence: 99%

“…There may for instance be an orientation towards whether sounds seem to be produced deliberately or not. In human interaction, bodily sounds like sniffs (Hoey, 2020) and grunts (Hofstetter, Keevallik, & Löfgren, 2021;Keevallik, 2023) may be less accountable than vocalizations that are clearly designed for a specific audience, such as vocalizations that instruct movements in dance classes (see e.g. or that convey sensory experiences (Keevallik et al, 2023;Wiggins, 2002).…”

Section: Future Workmentioning

confidence: 99%

“…In human interaction, bodily sounds like sniffs (Hoey, 2020) and grunts (Hofstetter, Keevallik, & Löfgren, 2021;Keevallik, 2023) may be less accountable than vocalizations that are clearly designed for a specific audience, such as vocalizations that instruct movements in dance classes (see e.g. or that convey sensory experiences (Keevallik et al, 2023;Wiggins, 2002). It would be interesting to further investigate whether hardware sounds in robots (including synthetic motor sounds) are also less accountable and perhaps also missed more easily than explicitly designed beeps or even human-inspired utterances.…”

Section: Future Workmentioning

confidence: 99%

See 2 more Smart Citations

Robot Sound in Interaction : Analyzing and Designing Sound for Human-Robot Coordination

Pelikan

2023

Studies in Language and Culture

View full text Add to dashboard Cite

Robots naturally emit sound, but we still know little about how sound can serve as an interface that makes a robot's behavior explainable to humans. This dissertation draws on insights about human practices for coordinating bodily activities through sound, investigating how they could inform robot design. My work builds on three video corpora, involving i) a Cozmo robot in ten family homes, ii) autonomous public shuttle buses in an urban environment, and iii) a teamwork robot prototype controlled by a researcher and interacting with study participants in an experimental setting. I approached the data from two methodological angles, exploring how they can speak to each other: I first carried out an empirical analysis of the video data from an Ethnomethodology and Conversation Analysis (EMCA) perspective, focusing on how humans make sense of robot sound on a moment-by-moment basis in naturally occurring interaction. Subsequently, taking an Interaction Design perspective, I used my video recordings as a design material for exploring how robot sound could be designed in and for real-time interaction. My work contributes to Human-Robot Interaction through detailed studies of robots in the world (rather than in the lab), focusing on how participants make sense of robot sounds. I present a novel framework for designing sound in and for interaction and a prototyping practice that allows practitioners to embed an EMCA stance into their designs. The dissertation contributes to EMCA by describing how members embed autonomous machines into the social organization of activities and how humans treat robots as participants in the interaction. I make a contribution to the development of EMCA hybrid studies by seeking a synthesis between EMCA and robot interaction design.vi Most importantly, I would like to thank my supervisors for embarking on this journey with me. Leelo Keevallik, I cannot thank you enough for your wise guidance, and for leaving me so much freedom to explore within your project. Your curiosity and leadership continue to inspire me. Mathias Broth, you have sparked my initial interest in interaction analysis, and I am so grateful to have you as a co-supervisor. Malte Jung, while not formally registered as a supervisor, you have been an important mentor far beyond the months that I spent in your lab. I have tremendously benefited from the discussions with my opponents Stuart Reeves and Karola Pitsch, and readers Brian Due, Roberto Bresin, Malte Jung and Jakob Cromdal at the PhD seminars. Thank you for encouraging me to explore new avenues and pushing me to better articulate my ideas.To my amazing colleagues in Leelo's project:

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Future Workmentioning

confidence: 99%

Section: Future Workmentioning

confidence: 99%

See 1 more Smart Citation

Robot Sound in Interaction : Analyzing and Designing Sound for Human-Robot Coordination

Pelikan

2023

Studies in Language and Culture

View full text Add to dashboard Cite

show abstract

“…The repetition of parental lip-smacks, echoing a sequence of the infant's repetitive jaw movements associated with mastication, comes to an end when the infant also opens their lips and produces a responsive lip-smack. As an instance in which one person sounds on behalf of another (Keevallik et al, 2023), this amounts to a joint accomplishment of eating moves in which the parent is finely tuned to the infant's body as they jointly negotiate the length of the engagement with food. Crucially, all the cases of repetition in our collection managed interactional time in one way or another, either by achieving repeated moves, encouraging extension of an ongoing move, managing conversational delay, or achieving a goal in real time.…”

Section: Introductionmentioning

confidence: 99%

Repetition for real-time coordination of action: Lexical and non-lexical vocalizations in collaborative time management

Keevallik,

Hofstetter,

Löfgren

et al. 2024

Discourse Studies

Self Cite

View full text Add to dashboard Cite

Repetition has often been argued to be a semiotic device that iconically signifies ‘more content’, such as intensity and plurality. However, through multimodal interaction analysis of materials in English, Estonian, and Swedish, this paper demonstrates how self-repetition is used to coordinate actions across participants and temporally organize the ongoing activity. The data are taken from infant mealtimes, pilates classes, dance training, boardgames, rock climbing, and opera rehearsals. Repetition of both lexical and non-lexical tokens can prolong, postpone, and generally organize segments of action as well as co-create rhythms and moves in a moment-by-moment reflexive relationship with other (non-vocalizing) participants. A crucial feature of repetitions is that they can be flexibly extended to fit the other’s public performance, its launching, continuation, and projectable completion. We argue that the iconicity of repetition emerges through its indexical relationship to other bodies, as a real-time jointly achieved phenomenon.

show abstract

Claiming and attributing (dis)taste: Issues of sharing a meal as a competent member

Svensson

2024

Appetite

View full text Add to dashboard Cite

Sounding others’ sensations in interaction

Cited by 8 publications

References 81 publications

Robot Sound in Interaction : Analyzing and Designing Sound for Human-Robot Coordination

Robot Sound in Interaction : Analyzing and Designing Sound for Human-Robot Coordination

Repetition for real-time coordination of action: Lexical and non-lexical vocalizations in collaborative time management

Claiming and attributing (dis)taste: Issues of sharing a meal as a competent member

Contact Info

Product

Resources

About