Limits and opportunities for mathematizing communicational conduct for social robotics in the real world? Toward enabling a robot to make use of the human’s competences

Pitsch, Karola

doi:10.1007/s00146-015-0629-0

Cited by 19 publications

(9 citation statements)

References 14 publications

(10 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…If the aim is to facilitate fluid interaction, a first challenge is to achieve the rapid transitions that characterize human language use. This requires incremental and continuous processing (Levinson, 2016;Pitsch, 2016), representing a radical departure from classic reactive spoken dialog systems. Most work in this area is still based on English, potentially jeopardizing the generalizability of findings.…”

Section: The Natural Habitat Of Languagementioning

confidence: 99%

From text to talk: Harnessing conversational corpora for humane and diversity-aware language technology

Dingemanse¹,

Liesenfeld²

2022

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

View full text Add to dashboard Cite

Informal social interaction is the primordial home of human language. Linguistically diverse conversational corpora are an important and largely untapped resource for computational linguistics and language technology. Through the efforts of a worldwide language documentation movement, such corpora are increasingly becoming available. We show how interactional data from 63 languages (26 families) harbours insights about turn-taking, timing, sequential structure and social action, with implications for language technology, natural language understanding, and the design of conversational interfaces. Harnessing linguistically diverse conversational corpora will provide the empirical foundations for flexible, localizable, humane language technologies of the future.

show abstract

Section: The Natural Habitat Of Languagementioning

confidence: 99%

From text to talk: Harnessing conversational corpora for humane and diversity-aware language technology

Dingemanse¹,

Liesenfeld²

2022

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

View full text Add to dashboard Cite

show abstract

“…After greeting the visitors by saying "Hello I am Nao" and suggesting "I could give you some information about the middle ages in Bielefeld" the robot asks: "Are you interested?" At this early stage of the encounter, it is not clear yet how best to deal with the system, expectations are being built and ways of participation in the group are emerging (see Pitsch 2015Pitsch , 2016Gehle et al 2017). Analysis will show how children are interactively established as 'primary coparticipants' for the robot and what interactional work this involves.…”

Section: Facilitating Participation: Establishing a Child As An Active Primary Co-participant For The Robotmentioning

confidence: 99%

Répondre aux questions d’un robot

Pitsch¹,

Relieu²,

Velkovska³

2020

Réseaux

Self Cite

View full text Add to dashboard Cite

Current trends in artificial intelligence and in the digitization of everyday life bring forward the idea that technological artefacts -such as humanoid robots, embodied conversational agents or voice user interfaces -might serve as autonomous assistants or companions in the home, in public and in work settings. From early on, it has been pointed out that their "success […] hinges not only on their utility but also on their ability to be responsive to and interact in a natural and intuitive manner" (Breazeal 2003: 167). As a basis, research in informatics/engineering endows robotic systems with advanced capabilities of monitoring their environment and for acting upon the users' communicational conduct. However, it remains a major challenge for technical systems to deal with the situated, contingent and in principle unpredictable nature of human communicational and interactional conduct (Suchman 1987, Button 1990, Schegloff 1996. In this article, I suggest that interdisciplinary cooperation between informatics/engineering and research on multimodal communication based on Ethnomethodological Conversation Analysis might help researchers to respond to this challenge and to create a novel research instrument for studying situated (inter-)action and human social practices (Pitsch et al. , 2014.To achieve this goal, a team of researchers are exploring how small groups of visitors -comprised of children and adults -engage in question-answer sequences 2 with an autonomous humanoid robot. As part of a larger research 1 The author acknowledges the financial support of the Volkswagen Foundation for the Dilthey Fellowship 'Interaction and Space' and from the Cluster of Excellence Cognitive Interaction Technology (EXC 277, project IP-18 conducted in cooperation with Dr. Sebastian Wrede). The author is indebted to her colleagues Sebastian Wrede, Raphaela Gehle and Timo Dankert for collaborative work on the project and the study investigated in this paper, to Lukas Hindemith and Hannah Pelikan for making the log files accessible, and to Vivien Ebben for her support in anonymizing the video stills.2 Stivers & Robinson (2006) distinguish between 'answers', i.e. specific types of responses which prototypically deal with the conditional relevance established through a question, and 'responses', i.e. anything that occurs (or not) subsequent to the previous turn. Here, I use the concept of 'answer' rather than the broader Postprint Karola Pitsch (2020): Answering a robot's questions. Participation dynamics of adult-child-groups in encounters with a museum guide robot. In: Réseaux, 220-221 (2-3), 113-150, https://doi.org/10.3917/res.220.0113. Postprint Version'response' as the human participants' try to answer within the conditions posed by the robot's questions -even though this is sometimes difficult.

show abstract

“…Consider the following fragment showing case 1 (trial 4_004) and for which a more detailed analysis is provided in [9]. From the three visitors, V1 and V2 follow the robot's initial reference to exhibit 1, while V3 continues to be focused on the robot itself (#00.44.05; #00.48.08).…”

Section: Case Analysis 2 (Problematic): Confusionmentioning

confidence: 99%

“…This is relevant e.g. in the case of shop assistants, household companions or for a robotic museum guide which needs to orient visitors to exhibits when providing information [5,8,9,14]. While most approaches in HRI have considered such deictic (or: referential) practices as an individualistic task of the speaker, [8] reveal the difficulties visitors experience when attempting to follow a robot's reference to an exhibit in a realworld museum scenario: In some cases, they tend to orient to the wrong object realizing this problem only later, or they are confused and search for the correct reference during the robot's explanation.…”

Section: Introductionmentioning

confidence: 99%

Referential practices. Effects of a museum guide robot suggesting a deictic ‘repair’ action to visitors attempting to orient to an exhibit

Pitsch

Dankert²,

Gehle

et al. 2016

2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)

Self Cite

View full text Add to dashboard Cite

An autonomous robot system was equipped with basic means to monitor the users' success/failure in following a robot's verbal-gestural deictic reference to an object and -in case of problems -to provide additional help, i.e. to suggest a 'repair' action. A real-world field trial with the robot acting as museum guide constitutes the basis for analysis of the users' reactions to the first reference and the subsequent 'repair' action in two structurally different conditions. Results indicate that deictic 'repair' actions are mostly successful helping users to correctly orient, but they may also lead to confusion for initially correctly oriented visitors in situations of small groups of users. A recurring user practice is revealed which consists of displaying to co-visitors their understanding of the reference by pointing to the location and thus providing additional orientational help. *The authors acknowledge the financial support from the Cluster of Excellence Cognitive Interaction Technology 'CITEC' (EXC 277) (IP-18 'Interactional Coordination and Incrementality in HRI') and from the Volkswagen Foundation (Dilthey Fellowship 'Interaction and Space').KP has conducted the analysis, written the text and devised the robot's deictic practices. TD has programmed the robotic system; all authors have collaborated preparing and conducting the study) Sebastian Wrede and Timo Dankert are with CITEC. Raphaela Gehle is with the

show abstract

Limits and opportunities for mathematizing communicational conduct for social robotics in the real world? Toward enabling a robot to make use of the human’s competences

Cited by 19 publications

References 14 publications

From text to talk: Harnessing conversational corpora for humane and diversity-aware language technology

From text to talk: Harnessing conversational corpora for humane and diversity-aware language technology

Répondre aux questions d’un robot

Referential practices. Effects of a museum guide robot suggesting a deictic ‘repair’ action to visitors attempting to orient to an exhibit

Contact Info

Product

Resources

About