Multi-agent Reinforcement Learning with Emergent Communication using Discrete and Indifferentiable Message

Ebara, Hiroto; Nakamura, Tomoaki; Taniguchi, Akira; Taniguchi, Tadahiro

doi:10.1109/iiai-aai-winter61682.2023.00073

2023 15th International Congress on Advanced Applied Informatics Winter (IIAI-AAI-Winter) 2023

DOI: 10.1109/iiai-aai-winter61682.2023.00073

|View full text |Cite

Multi-agent Reinforcement Learning with Emergent Communication using Discrete and Indifferentiable Message

Hiroto Ebara,

Tomoaki Nakamura,

Akira Taniguchi

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Collective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference

Taniguchi

2024

Front. Robot. AI

View full text Add to dashboard Cite

Understanding the emergence of symbol systems, especially language, requires the construction of a computational model that reproduces both the developmental learning process in everyday life and the evolutionary dynamics of symbol emergence throughout history. This study introduces the collective predictive coding (CPC) hypothesis, which emphasizes and models the interdependence between forming internal representations through physical interactions with the environment and sharing and utilizing meanings through social semiotic interactions within a symbol emergence system. The total system dynamics is theorized from the perspective of predictive coding. The hypothesis draws inspiration from computational studies grounded in probabilistic generative models and language games, including the Metropolis–Hastings naming game. Thus, playing such games among agents in a distributed manner can be interpreted as a decentralized Bayesian inference of representations shared by a multi-agent system. Moreover, this study explores the potential link between the CPC hypothesis and the free-energy principle, positing that symbol emergence adheres to the society-wide free-energy principle. Furthermore, this paper provides a new explanation for why large language models appear to possess knowledge about the world based on experience, even though they have neither sensory organs nor bodies. This paper reviews past approaches to symbol emergence systems, offers a comprehensive survey of related prior studies, and presents a discussion on CPC-based generalizations. Future challenges and potential cross-disciplinary research avenues are highlighted.

show abstract

Collective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference

Taniguchi

2024

Front. Robot. AI

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Multi-agent Reinforcement Learning with Emergent Communication using Discrete and Indifferentiable Message

Cited by 1 publication

References 8 publications

Collective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference

Collective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference

Contact Info

Product

Resources

About