Addressing joint action challenges in HRI: Insights from psychology and philosophy

Belhassein, Kathleen; Castro, Víctor Fernández; Mayima, Amandine; Clodic, Aurélie; Pacherie, Élisabeth; Guidetti, Michèle; Alami, Rachid; Cochet, Hélène

doi:10.1016/j.actpsy.2021.103476

Cited by 14 publications

(9 citation statements)

References 159 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, a deeper understanding of the developmental trajectories of the two types of social interactions may shed light on early markers of developmental delays and disorders. Finally, with the advances in robotic technology, research in HRC has gained in importance (Bütepage & Kragic, 2017; Henschel et al, 2020; Belhassein et al, 2022; Lemaignan et al, 2017). The current study could provide insight into the HRC in at least two aspects.…”

Section: Discussionmentioning

confidence: 99%

“…The current study could provide insight into the HRC in at least two aspects. First, currently, most of the HRC focuses on the communicative-contingency actions, ignoring the physical-contingency actions (Bütepage & Kragic, 2017; Belhassein et al, 2022). To enhance HRC, we argue that this more basic coordination between human and robot should be paid attention to in future design.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Dual routes of chunking social interaction: Insights from grouping two agent actions in working memory.

Wu,

Guo,

Chen

et al. 2024

Journal of Experimental Psychology: General

View full text Add to dashboard Cite

Humans have evolved the sophisticated ability to extract social relations embedded in interactive entities. One typical demonstration is a social chunking phenomenon wherein the cognitive system chunks individual actions into a unified episode basing on perceived interactive actions. However, the mechanisms underlying social chunking remain to be elucidated. Most studies have adopted static images and manipulated interactions through agents' facingness (face-to-face vs. back-to-back). Connecting agents via directed contingent actions is crucial in forming real-life social interaction. Hence, we employed dynamic actions as stimuli, separated physical-and communicative-contingency interactive actions, and predicted that domain-general physical regularities and domain-specific social relationships are crucial in social interactions, respectively. We tested this prediction by using an involuntary chunking effect in working memory, wherein two individual actions are involuntarily chunked when containing task-irrelevant interactive information. We found that involuntary chunking occurred for both types of upright interactive actions (Experiments 1, 3, 5, and 6). Inverting actions erased the chunking of communicative-but not physical-contingency actions (Experiments 2, 4, and 5). The facingness of dyads did not participate in chunking physical-contingency actions but was a prerequisite for chunking communicative-contingency actions (Experiments 3 and 6). These results reveal the dual routes of chunking interactive actions. Moreover, they suggest that the chunking mechanisms of dynamic social interaction are distinct from those of static images, highlighting the importance of using dynamic stimuli to explore the mechanisms of social interaction in emerging people-watching interdisciplinarity. Public Significance StatementThis study for the first time demonstrates that our mind involuntarily chunks the physical-and communicative-contingency interactive actions via domain-general physical regularities and domain-specific social relationships, respectively. The dual routes of chunking interactive actions in working memory indicate that social cues are only involved in grouping communicative-contingency interactive actions. The finding strongly suggests that the chunking mechanisms of dynamic social interactions are distinct from those of static images, underscoring the importance of using dynamic stimuli in interdisciplinary people-watching.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Dual routes of chunking social interaction: Insights from grouping two agent actions in working memory.

Wu,

Guo,

Chen

et al. 2024

Journal of Experimental Psychology: General

View full text Add to dashboard Cite

show abstract

“…An open question is how such a stability trades off with the necessity to change individual and joint behavior in a continuously changing social environment (Becchio, Sartori, & Castiello, 2010; Pezzulo et al., 2018; Tomasello, 2014). Understanding how the human mind deals with such trade‐offs might be a critical ingredient in future multi‐agent AI systems that have to face complex problems of joint planning and coordination (Belhassein et al., 2022; Castelfranchi & Falcone, 2010; Cohen & Levesque, 1991; Donnarumma, Dindo, & Pezzulo, 2017; Pezzulo et al., 2013; Ramirez & Geffner, 2010; Tambe, 1997). Another open question regards the generalization of our findings about decomposition strategies to situations in which participants can communicate explicitly (e.g., linguistically).…”

Section: Discussionmentioning

confidence: 99%

Strategic Task Decomposition in Joint Action

2023

View full text Add to dashboard Cite

The core of human cooperation is people's ability to perform joint actions. Frequently, this requires effectively decomposing a joint task into individual subtasks, for example, when jointly shopping at the market to buy food. Surprisingly, little is known about how collaborators balance the costs of establishing a joint strategy for such decompositions and its expected benefits for a joint goal. We created a new online task that required pairs of randomly matched participants to jointly collect colored items. We then systematically varied the cognitive costs and benefits of applying a color-splitting strategy. The results showed that pairs adopted a color-splitting strategy more often when necessary to lower cognitive costs. However, once the strategy was jointly adopted, it continued to be used even when the cost-benefits changed. Our results provide first insights on how people decompose joint tasks into individual components and how decomposition strategies may evolve into conventions.

show abstract

“…This research is rooted in the vision that robots will adequately support humans in their everyday tasks and that they will continuously learn and adapt to human needs over time. Engaging in joint action to achieve a task requires a common understanding of the ongoing interaction [1,2]. This can be established through grounding [3] or alignment processes [4], which are typically established by verbal and non-verbal communication.…”

Section: Introductionmentioning

confidence: 99%

EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study

Richter

Putze

Ivucic

et al. 2023

MTI

View full text Add to dashboard Cite

In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies.

show abstract

Addressing joint action challenges in HRI: Insights from psychology and philosophy

Cited by 14 publications

References 159 publications

Dual routes of chunking social interaction: Insights from grouping two agent actions in working memory.

Dual routes of chunking social interaction: Insights from grouping two agent actions in working memory.

Strategic Task Decomposition in Joint Action

EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study

Contact Info

Product

Resources

About