How to Attack and Defend NextG Radio Access Network Slicing With Reinforcement Learning

Abstract

In this paper, reinforcement learning (RL) for network slicing is considered in next generation (NextG) radio access networks, where the base station (gNodeB) allocates resource blocks (RBs) to the requests of user equipments and aims to maximize the total reward of accepted requests over time. Based on adversarial machine learning, a novel over-the-air attack is introduced to manipulate the RL algorithm and disrupt NextG network slicing. The adversary observes the spectrum and builds its own RL based surrogate model that selects which RBs to jam subject to an energy budget with the objective of maximizing the number of failed requests due to jammed RBs. By jamming the RBs, the adversary reduces the RL algorithm's reward. As this reward is used as the input to update the RL algorithm, the performance does not recover even after the adversary stops jamming. This attack is evaluated in terms of both the recovery time and the (maximum and total) reward loss, and it is shown to be much more effective than benchmark (random and myopic) jamming attacks. Different reactive and proactive defense schemes such as suspending the RL algorithm's update once an attack is detected, introducing randomness to the decision process in RL to mislead the learning process of the adversary, or manipulating the feedback (NACK) mechanism such that the adversary may not obtain reliable information are introduced to show that it is viable to defend NextG network slicing against this attack, in terms of improving the RL algorithm's reward.

AI/ML Enabled Automation System for Software Defined Disaggregated Open Radio Access Networks: Transforming Telecommunication Business

“…Similar to this, in Ref. [3], the C-RAN architecture is discussed. More precisely, a thorough analysis of how resources is allocated in such an RAN architecture.…”

Explainable and Robust Artificial Intelligence for Trustworthy Resource Management in 6G Networks

“…Attackers can deliberately design input data to manipulate the model output and produce inaccurate decisions, posing a significant risk to the integrity of AI models. In the context of RRM, a novel RL-based network slicing framework is proposed to enable the base station to allocate resource blocks (RBs) based on the user's request [11]. However, the victim RL algorithm is shown to be vulnerable to adversarial attacks, where an attacker can observe the spectrum RBs and build a surrogate model to maximize the number of failed requests, thus compromising the algorithm's reward.…”

Against Jamming Attack in Wireless Communication Networks: A Reinforcement Learning Approach

“…Jamming attacks disrupt the wireless signals of terminals, making it impossible to recover accurate information [3]. Smart jammers, which have emerged in recent years, can launch even more threatening attacks by learning terminal communication strategies [4]. Many studies on anti-jamming resource allocation methods have achieved certain results and have shown good performance in dealing with conventional jamming attacks.…”