Modelling deception using theory of mind in multi-agent systems

Sarkadi, Ştefan; Panisson, Alison R.; Bordini, Rafael H.; McBurney, Peter; Parsons, Simon; Chapman, Martin

doi:10.3233/aic-190615

Cited by 28 publications

(12 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Othello's fallacy was that he took into consideration only the behaviour a guilty person would exhibit, without taking into consideration all the other cues that might have falsified his beliefs, such as the fact that desperation causes individuals to exhibit some of the behaviours a guilty person would exhibit. In the case of complex reasoning artificial agents, Sarkadi et al have shown in [24] that high levels of scepticism in communicative social interactions between artificial agents could lead to deception even when the deceiver agent's communicative skill is low. This type of artificial agent deception, argue the authors in [24], represents the special case of unintended deception where the deceiver does not act deceptively because it wrongly estimates that deception would fail, but the interrogator (the deceiver's target) is so sceptical that it caused it to believe that the deceiver has attempted deception, and thus the interrogator is caused to infer something that is false from a truthful message.…”

Section: Discussionmentioning

confidence: 99%

“…have shown in [ 24 ] that high levels of scepticism in communicative social interactions between artificial agents could lead to deception even when the deceiver agent’s communicative skill is low. This type of artificial agent deception, argue the authors in [ 24 ], represents the special case of unintended deception where the deceiver does not act deceptively because it wrongly estimates that deception would fail, but the interrogator (the deceiver’s target) is so sceptical that it caused it to believe that the deceiver has attempted deception, and thus the interrogator is caused to infer something that is false from a truthful message.…”

Section: Discussionmentioning

confidence: 99%

“…The risks related to the sharing of knowledge and information as a social good posed by AI is that artificial autonomous agents might develop their own reasons to act deceptively as it is pointed out in [16] and, more recently, in [17,18]. AI has also seen an emerging interest in the problem of fake news and the potential ability of machines (i) to be used for fake news generation [19] and fake news detection [20,21]; or even (ii) to use higher-order cognitive mechanisms to manipulate the beliefs of others in order to deceive [22][23][24]. All of this leaves us with an urgent need to understand deception better, and to devise methods for reducing its impact.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

The evolution of deception

et al. 2021

Self Cite

View full text Add to dashboard Cite

Deception plays a critical role in the dissemination of information, and has important consequences on the functioning of cultural, market-based and democratic institutions. Deception has been widely studied within the fields of philosophy, psychology, economics and political science. Yet, we still lack an understanding of how deception emerges in a society under competitive (evolutionary) pressures. This paper begins to fill this gap by bridging evolutionary models of social good— public goods games (PGGs)—with ideas from interpersonal deception theory (Buller and Burgoon 1996 Commun. Theory 6 , 203–242. ( doi:10.1111/j.1468-2885.1996.tb00127.x )) and truth-default theory (Levine 2014 J. Lang. Soc. Psychol. 33 , 378–392. ( doi:10.1177/0261927X14535916 ); Levine 2019 Duped: truth-default theory and the social science of lying and deception . University of Alabama Press). This provides a well-founded analysis of the growth of deception in societies and the effectiveness of several approaches to reducing deception. Assuming that knowledge is a public good, we use extensive simulation studies to explore (i) how deception impacts the sharing and dissemination of knowledge in societies over time, (ii) how different types of knowledge sharing societies are affected by deception and (iii) what type of policing and regulation is needed to reduce the negative effects of deception in knowledge sharing. Our results indicate that cooperation in knowledge sharing can be re-established in systems by introducing institutions that investigate and regulate both defection and deception using a decentralized case-by-case strategy. This provides evidence for the adoption of methods for reducing the use of deception in the world around us in order to avoid a Tragedy of the Digital Commons (Greco and Floridi 2004 Ethics Inf. Technol. 6 , 73–81. ( doi:10.1007/s10676-004-2895-2 )).

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

The evolution of deception

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…Emotional Well-being Theory. It states description in logic of the OCC model of emotion [60,80,81,86] that has an objective to achieve and maximize happiness of the student [70]. 3.…”

Section: 1mentioning

confidence: 99%

“…The Cecilia architecture has been designed to include a Theory of Mind [80] extended with emotions [60,81] of the User Agent (the student) as a Logic Programming (LP) Theory in the User Model. It is by LP Knowledge Representation that is possible to reason and plan a Dialogue Composition (DC) to help the user human development considering her beliefs, intentions, desires and emotions.…”

Section: Introductionmentioning

confidence: 99%

Creative Composition Problem: A Knowledge Graph Logical-Based AI Construction and Optimization Solution

Galindo

Moreno²

2021

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Contribution of this work is to Define the Creative Composition Problem (CCP) for Human Well-being Optimization by Construction of Knowledge Graph using Knowledge Representation and logic-based Artificial Intelligence reasoning-planning where the computation of the Optimal Solution is achieved by Dynamic Programming or Logic Programming. The Creative Composition Problem is embedded within Cecilia: an architecture of a digital companion artificial intelligence agent system composer of dialogue scripts for Well-being and Mental Health. Where Cecilia Framework is instantiated in Well-being and Mental Health domain for optimal well-being development of first year university students. We define the ‘The Problem of Creating a Dialogue Composition (PCDC)’ and we propose a feasible and optimal solution of it. CCP is instantiated in this applied domain to solve PCDC optimizing the Mental Health and Well-being of the student. CCP as PCDC is applied to optimize maximizing the mental health of the student but also maximizing the smoothness, coherence, enjoyment and engagement each time the dialogue session is composed. Cecilia helps students to manage stress/anxiety to attempt the prevention of depression. Students can interact through the digital companion making questions and answers. While the system “learns” from the user it allows the user to learn from herself. Once the student discovers elements that were unnoticed by her, she will find a better way to improve when discovering her points of improvement.

show abstract

Towards the Role of Theory of Mind in Explanation

Shvo

Klassen

McIlraith

2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Theory of Mind is commonly defined as the ability to attribute mental states (e.g., beliefs, goals) to oneself, and to others. A large body of previous work-from the social sciences to artificial intelligence-has observed that Theory of Mind capabilities are central to providing an explanation to another agent or when explaining that agent's behaviour. In this paper, we build and expand upon previous work by providing an account of explanation in terms of the beliefs of agents and the mechanism by which agents revise their beliefs given possible explanations. We further identify a set of desiderata for explanations that utilize Theory of Mind. These desiderata inform our belief-based account of explanation.

show abstract

Modelling deception using theory of mind in multi-agent systems

Cited by 28 publications

References 20 publications

The evolution of deception

The evolution of deception

Creative Composition Problem: A Knowledge Graph Logical-Based AI Construction and Optimization Solution

Towards the Role of Theory of Mind in Explanation

Contact Info

Product

Resources

About