A Q-learning based SPS Resource Scheduling Algorithm for Reliable C-V2X Communication

Lü, Yan; Wang, Ping; Wang, Shuai; Yao, Wangding

doi:10.1145/3458380.3458415

Cited by 7 publications

(1 citation statement)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the Third Generation Partnership Project (3GPP), e.g., vehicular communications focusing on low latency and high reliability [3] have been studied in 5G scenarios with the high priority of quality of service (QoS). Additionally, the sidelink or direct communications [4] defined in mode 4 can be used to fulfill cellularvehicle-to-everything (C-V2X) / new radio-vehicle-toeverything (NR-V2X) communications. For example, through a sensing-based semi-persistent-scheduling (SPS) [5] algorithm, vehicle nodes could get radio resources in a distributed way without the aid of a central base station.…”

Section: Introductionmentioning

confidence: 99%

A Fairness-Enhanced Intelligent MAC Scheme Using Q-Learning-Based Bidirectional Backoff for Distributed Vehicular Communication Networks

Wang

2023

Tsinghua Sci. Technol.

Self Cite

View full text Add to dashboard Cite

With the increasing attention to front-edge vehicular communication applications, distributed resource allocation is beneficial to the direct communications between vehicle nodes. However, in highly dynamic distributed vehicular networks, quality of service (QoS) of the systems would degrade dramatically because of serious packet collisions in the absence of sufficient link knowledge. Focusing on the fairness optimization, a Q-learning-based collision avoidance (QCA) scheme, which is characterized by an ingenious bidirectional backoff reward model R QCA corresponding to arbitrary backoff stage transitions, has been proposed in an intelligent distributed media access control protocol. In QCA, an intelligent bidirectional backoff agent based on the Markov decision process model can actively motivate each vehicle agent to update itself toward an optimal backoff sub-intervel BSI opt through either positive or negative bidirectional transition individually, resulting in the distinct fair communication with a proper balance of the resource allocation. According to the reinforcement learning theory, the problem of goodness evaluation on the backoff stage self-selection policy is equal to the problem of maximizing Q function of the vehicle in the current environment. The final decision on BSI opt related to an optimal contention window range was solved through maximizing the Q value or Q max . The "-greedy algorithm was used to keep a reasonable convergence of the Q max solution. For the fairness evaluation of QCA, four kinds of dynamic impacts on the vehicular networks were investigated: mobility, density, payload size, and data rate with a network simulator NS2. Consequently, QCA can achieve fair communication efficiently and robustly, with advantages of superior Jain's fairness index, relatively high packet delivery ratio, and low time delay.

show abstract

Section: Introductionmentioning

confidence: 99%