Simultaneous beam selection and users scheduling evaluation in a virtual world with reinforcement learning

Abstract

The fifth generation of mobile networks evolved to serve applications with distinct requirements, which results in a high management complexity due to simultaneous real-time tasks. In the physical layer, code words that allow proper data exchange between the Base Station (BS) and the served users must be chosen. While, in higher layers, the BS must choose users to be served in a given transmission opportunity. There are approaches based on Machine Learning (ML) to solve these combined tasks. However, due to the high amount of possible inputs, a challenge is the availability of data to train the models. In some cases, there may not even exist a predefined optimal answer to use as a "label" for supervised approaches. In this paper, we evaluate solutions for the combined problems of beam selection and user scheduling with Reinforcement Learning (RL), which does not need labels, as a solution for problems without a predefined answer. The algorithms were proposed for Problem Statement 6 of the challenge organized by the International Telecommunication Union (ITU) in 2021, which ranked as the finalists. We compare the approaches in relation to the cumulative reward received by the agents and show a performance comparison of different RL approaches by comparing them with baselines developed for the challenge. The paper also shows how the action taken by the trained agents affect network operation by comparing the number of packets transmitted, which is highly related to the proper selection of users and code words.

Automatic Generation of Images Using Unreal Engine for Supervised Learning

“…compose the dataset. Thus, complex methodologies which use visual data [5] can be positively influenced by the automatic data generation and labeling process.…”

Deep reinforcement learning‐based routing and resource assignment in quantum key distribution‐secured optical networks

“…DRL has ability to approximate optimal policy by employing DNNs for complex decision-making problems and improves the learning speed and performance of the reinforcement learning algorithms. As a result, the application of DRL [31,32] has received intensive research interest in communication and networking to solve the complex decision-making problems [33,34] and has become one of the most active areas of research in machine learning. However, in QKD-ONs, limited works have been reported using the application of DRL to address the RRA problem [35,36].…”