Curriculum Learning for Cumulative Return Maximization

Foglino, Francesco; Christakou, Christiano Coletto; Gutierrez, Ricardo Luna; Leonetti, Matteo

doi:10.48550/arxiv.1906.06178

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In recent years, deep reinforcement learning has developed rapidly in the field of artificial intelligence. By applying multilayer neural networks to approximate the value function of reinforcement learning, the perception ability of deep learning and the decision-making ability of reinforcement learning can be effectively combined, such as Atari games [ 1 , 2 ], complex robot motion control [ 3 ], and the application of AlphaGo intelligence in Go [ 4 ], etc.…”

Section: Introductionmentioning

confidence: 99%

Curriculum Reinforcement Learning Based on K-Fold Cross Validation

Lin

Lai

Chen

et al. 2022

Entropy

View full text Add to dashboard Cite

With the continuous development of deep reinforcement learning in intelligent control, combining automatic curriculum learning and deep reinforcement learning can improve the training performance and efficiency of algorithms from easy to difficult. Most existing automatic curriculum learning algorithms perform curriculum ranking through expert experience and a single network, which has the problems of difficult curriculum task ranking and slow convergence speed. In this paper, we propose a curriculum reinforcement learning method based on K-Fold Cross Validation that can estimate the relativity score of task curriculum difficulty. Drawing lessons from the human concept of curriculum learning from easy to difficult, this method divides automatic curriculum learning into a curriculum difficulty assessment stage and a curriculum sorting stage. Through parallel training of the teacher model and cross-evaluation of task sample difficulty, the method can better sequence curriculum learning tasks. Finally, simulation comparison experiments were carried out in two types of multi-agent experimental environments. The experimental results show that the automatic curriculum learning method based on K-Fold cross-validation can improve the training speed of the MADDPG algorithm, and at the same time has a certain generality for multi-agent deep reinforcement learning algorithm based on the replay buffer mechanism.

show abstract

Section: Introductionmentioning

confidence: 99%