Reading the Mind in Robots: How Theory of Mind Ability Alters Mental State Attributions During Human-Robot Interactions

Schreck, Jacquelyn L.; Newton, Olivia B.; Song, Jihye; Fiore, Stephen M.

doi:10.1177/1071181319631414

Cited by 7 publications

(4 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although the intention perceived in Nio sculptures primarily belongs to a specific sociocultural context (an intention directed toward malevolent spirits attempting to enter the temple door), we suggest that intention is “conveyed” solely through the facial expression, even when the perceiver is unaware of the spiritual narrative behind the scenes. Researchers in human-robot interaction have already exploited in their research this idea of emotion and intention that humans can detect in a computational agent ( Mutlu et al, 2009 ; Kim and Suzuki, 2012 ; Schreck et al, 2019 ). However, in human-robot interaction situations, intentions and emotions are usually expressed through different modalities, either verbal or non-verbal such as body or facial feature movement.…”

Section: From the Icon To The Indexmentioning

confidence: 99%

Facial icons as indexes of emotions and intentions

Achour-Benallegue,

Pelletier,

Kaminski

et al. 2024

Front. Psychol.

View full text Add to dashboard Cite

Various objects and artifacts incorporate representations of faces, encompassing artworks like portraits, as well as ethnographic or industrial artifacts such as masks or humanoid robots. These representations exhibit diverse degrees of human-likeness, serving different functions and objectives. Despite these variations, they share common features, particularly facial attributes that serve as building blocks for facial expressions—an effective means of communicating emotions. To provide a unified conceptualization for this broad spectrum of face representations, we propose the term “facial icons” drawing upon Peirce’s semiotic concepts. Additionally, based on these semiotic principles, we posit that facial icons function as indexes of emotions and intentions, and introduce a significant anthropological theory aligning with our proposition. Subsequently, we support our assertions by examining processes related to face and facial expression perception, as well as sensorimotor simulation processes involved in discerning others’ mental states, including emotions. Our argumentation integrates cognitive and experimental evidence, reinforcing the pivotal role of facial icons in conveying mental states.

show abstract

Section: From the Icon To The Indexmentioning

confidence: 99%

Facial icons as indexes of emotions and intentions

Achour-Benallegue,

Pelletier,

Kaminski

et al. 2024

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…Other interactive protocols showed that humans tend to take into account the behavior and, arguably, internal states of SR when trying to coordinate or synchronize their actions with them during joint task execution [Xu et al 2016, Ciardo et al 2020]. Schreck et al [2019], for instance, evaluated whether a SR's social behavior, the type of social signals it displayed, and the proxemics (how close would the SR get to people) affected the likelihood of ToM-related interpretations. They found that increased experience with a robot through continued interaction decreased the likelihood of mental state attributions, unless the robot showed more socially active behaviors (get close to people when interacting) as well as more human-like expressions, which triggered stable levels of mental state attributions across the experiment.…”

Section: Many Studies Have Examined To What Extent Humans Interpret Social Signals Displayed Bymentioning

confidence: 99%

Theory of Mind and Joint Attention

Perez-Osorio¹,

Wiese²,

Wykowska³

2021

The Handbook on Socially Interactive Agents

View full text Add to dashboard Cite

Published as part ofThe Handbook on Socially Interactive Agents Chapter 9 -Theory of Mind and Joint Attention environment, or coordinate interactions, such as biological motion, facial expressions, and eye and head movements. Furthermore, those signals are tightly linked to higher cognitive processes like recognizing others' feelings and internal states, identifying others' intentions, or deciding whether they are friend or foe. Understanding the neurobiological basis of behavior is crucial for cognitive, developmental, clinical, comparative, and social psychology, as well as philosophy and evolutionary anthropology [Singer 2012]. In this context, examining the engagement of social brain areas in interactions with artificial agents seems like a natural step to follow for HAI as well." Using a combination of subjective/explicit measures like self-report and questionnaires, and objective measures like metrics related to performance, behavior, psychophysiology, and neuroimaging, HAI is able to have a more comprehensive view of behavioral and brain mechanisms involved in social interactions with human and non-human agents. The present chapter provides an overview from the perspective of SCN regarding theory of mind (ToM) and joint attention (JA) as crucial mechanisms of social cognition and discusses how these mechanisms have been investigated in social interaction with artificial agents. In the final sections, the chapter reviews computational models of ToM and JA in social robots (SRs) and intelligent virtual agents (IVAs) and discusses the current challenges and future directions. Theory of Mind and Joint Attention-Crucial Mechanisms of Social Cognition Theory of MindImagine that as you are walking on the street someone is coming from the opposite direction toward you. At some point, and before passing each other, the person all of a sudden puts the palm of her/his hand on their forehead, stops walking, turns around, and goes back to where she/he came from. How would you explain this behavior? Probably, you would guess that she/he might have forgotten something and decided to go back. And you might be right. Importantly, most of the explanations you would choose to explain the observed behavior would refer to mental states, such as thoughts, preferences, intentions, or emotions. This is based on the ability to perceive and understand that others have beliefs, desires, goals, and knowledge different from your

show abstract

“…The conventions required for robot navigations should possess safe and understandable behavior. We have further divided it into three areas (Rossi et al, 2020;Schreck et al, 2019;Vega et al, 2019a) i.e. Social behavior, Proxemics and Social robot abilities as discussed below.…”

Section: Social Conventionsmentioning

confidence: 99%

Understanding Socially Aware Robot Navigation

Singh

Kapoor

Sohi

2021

JER is an international, peer-reviewed journal that publishes f

View full text Add to dashboard Cite

Navigation is an essential skill for autonomous robots and it becomes a cumbersome task in human populated environments. Robots need to perform the tasks without disturbing the humans around them and ensure comfort and safety of humans as well. It is further influenced by various factors like social norms, geometry of environment and surrounding people. It is essential to comprehend three components i.e. Social Conventions (SC), Human Motion (HM) and Context Aware Mapping (CAM) for establishing effective socially aware robot navigation (SARN). This article discusses these different aspects of these components which should be taken into consideration while designing an efficient and optimal SARN. Further, it reports recent experiments conducted by different institutes pertaining to these components.

show abstract

Reading the Mind in Robots: How Theory of Mind Ability Alters Mental State Attributions During Human-Robot Interactions

Cited by 7 publications

References 27 publications

Facial icons as indexes of emotions and intentions

Facial icons as indexes of emotions and intentions

Theory of Mind and Joint Attention

Understanding Socially Aware Robot Navigation

Contact Info

Product

Resources

About