Voronoi-Based Multi-Robot Autonomous Exploration in Unknown Environments via Deep Reinforcement Learning

Abstract

Autonomous exploration is an important application of multi-vehicle systems, where a team of networked robots are coordinated to explore an unknown environment collaboratively. This technique has earned significant research interest due to its usefulness in search and rescue, fault detection and monitoring, localization and mapping, etc. In this paper, a novel cooperative exploration strategy is proposed for multiple mobile robots, which reduces the overall task completion time and energy costs compared to conventional methods. To efficiently navigate the networked robots during the collaborative tasks, a hierarchical control architecture is designed which contains a high-level decision making layer and a low-level target tracking layer. The proposed cooperative exploration approach is developed using dynamic Voronoi partitions, which minimizes duplicated exploration areas by assigning different target locations to individual robots. To deal with sudden obstacles in the unknown environment, an integrated deep reinforcement learning based collision avoidance algorithm is then proposed, which enables the control policy to learn from human demonstration data and thus improve the learning speed and performance. Finally, simulation and experimental results are provided to demonstrate the effectiveness of the proposed scheme.

Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey

“…A multi-agent system (MAS) is a distributed system of multiple cooperating or competing agents (physical or virtual), working towards maximizing their own objectives within a shared environment [120]. Each of the agents is equipped with a decision-making model which can be distributed either homogeneously or heterogeneously over the entire group.…”

Robust Formation Coordination of Robot Swarms With Nonlinear Dynamics and Unknown Disturbances: Design and Experiments

“…Swarm robotic systems are usually distinguished by the following features: i) communication of each robot is limited in the sense that only neighboring agents communicate among themselves, ii) all robots in a swarm follow the same set of rules and work in unison to achieve a common goal, and iii) stability of a swarm system will not be affected significantly if some of the agents leave the network [2]. Swarm robotics is being applied in a variety of real-world problems, for instance, autonomous shepherding [3], dynamic mapping [4], cooperative planetary exploration [5], etc.…”

A Review of Deep Learning-Based Contactless Heart Rate Measurement Methods

“…There are challenges in rPPG which include subject motion and ambient lighting variations [ 60 , 61 , 62 ]. Due to the success of deep learning in many computer vision and speech processing applications [ 63 , 64 , 65 ], deep learning methods have been considered for rPPG to deal with its challenges, for example, [ 44 , 49 ]. In deep learning methods, feature extraction and classification are carried out together within one network structure.…”