Communication-Aware Consensus-Based Decentralized Task Allocation in Communication Constrained Environments

Abstract

This paper presents a deep reinforcement learning framework in which agents learn how to schedule and censor themselves amongst the other agents competing for access to a limited communication medium. In particular, the process learns to schedule the communication between agents to improve the performance of task allocation in environments with constrained communication in terms of limited bandwidth and message collision. The proposed approach, called Communication-Aware Consensus-Based Bundle Algorithm (CA-CBBA), extends the previous CBBA [1] in that the learned communication policy enables efficient utilization of the shared medium by prioritizing agents with messages that are important for the mission. Furthermore, agents in denser parts of the network are censored appropriately to alleviate the message collision and hidden node problems. We evaluate our approach in various task assignment scenarios, and the results show that CA-CBBA outperforms CBBA in terms of convergence time, rate of conflict resolution, and task allocation reward. Moreover, we show that CA-CBBA yields a policy that generalizes beyond the training set to handle larger team sizes. Finally, the results on time-critical problems, such as a search-and-rescue mission, show that CA-CBBA also outperforms the baselines considered (e.g., CBBA, MCDGA [2], and ACBBA [3]) in terms of number of unassigned and conflicted tasks in most of the scenarios.

Intelligent Wargaming Approach to Increase Course of Action Effectiveness in Military Operations

“…Most of these methods assume perfect communication with inőnite bandwidth for ensuring that agents have the same situational awareness before the planning. However, this can be easily violated in real world scenarios including search and rescue missions where the agents have limited range of communication or communication channel with limited bandwidth [22]. In the presence of inconsistencies in situational awareness, decentralized task allocation algorithms can be augmented by utilizing consensus-based algorithms such as Consensus-Based Bundle Algorithm (CBBA) in order to converge on a consistent solution [23ś25].…”