Multi-agent Approach to Modeling the Dynamics of Urban Processes (on the Example of Urban Movements)

Parygin, Danila; Usov, Andrey; Burov, Sergey; Sadovnikova, Natalia; Ostroukhov, Pavel; Alena, Pyannikova

doi:10.1007/978-3-030-39296-3_18

Cited by 2 publications

(1 citation statement)

References 17 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Моделирование поведения интеллектуальных агентов -задача, находящая применение в мультиагентных системах, моделирующих такие процессы, как потоки городского движения [1,2], эпидемии, поведение толпы [3,4]. Одно из направлений применения мультиагентного подхода -моделирование поведения неигровых персонажей в компьютерных играх.…”

unclassified

Моделирование Поведения Интеллектуальных Агентов На Основе Методов Машинного Обучения в Моделях Конкуренции

Анохин¹,

A.O.²,

Парыгин³

et al. 2023

ППС

View full text Add to dashboard Cite

The article discusses the aspects of applying machine learning methods to existing methods for modeling the behavior of intelligent agents to enable agents to improve their performance in competition models.The practical significance of the study is represented by developing an approach to modeling the behavior of intelligent agents in order to increase the efficiency of their functioning in such areas as computer games, developing unmanned aerial vehicles and search robots, studying urban and transport mobility, as well as other complex systems.There is a review of the existing machine learning methods (reinforcement learning, deep learning, Q-learning) and methods for modeling the agents' behavior (a rule-based model, a finite automaton model of behavior, behavior trees). The authors have chosen the most appropriate combination of a learning method and a behavior model for the task: behavior trees and reinforcement learning.A test platform was implemented using Unity tools, behavior models were developed for the four main archetypes of agents that must compete in collecting resources in a limited time. A trained agent was implemented using Unity ML and TensorFlow tools.The test platform has become a basis for a series of experiments under various conditions: limited resources, resource abundance, average amount of resources. As part of the experiment, the authors tested the ability of the developed intelligent agent's behavior model to win in a competitive environment with agents equipped with various variants of traditional behavior models based on behavior trees. The efficiency and advantages of using the developed behavior model were evaluated. The paper analyzes the experimental results and draws conclusions regarding the potential of the selected combination of methods.

show abstract

unclassified