A distributed learning–based user association for heterogeneous networks

Abstract

The coexistence of various base stations (BSs) in heterogeneous networks (HetNets) has emerged as a promising approach to meet the ever increasing network capacity. In these networks, one of the important issues is the problem of associating user equipments (UEs) to BSs. In this paper, we investigate the UE association (UEA) problem in heterogeneous networks and propose a load-aware UEA mechanism based on the BSs' estimated load and signal-to-interference-and-noise ratio. The proposed mechanism can capture the trade-off between UE's quality-of-service requirement and delay. We model this strategic UE-BS association as a noncooperative game. To solve the game, we develop a fully distributed algorithm inspired by machine learning techniques, whereby the proposed UEA scheme corresponds to a Markov chain.In the proposed scheme, each UE senses its environment and decides which BS to select based on the satisfaction technique. Therefore, it achieves a high level of satisfaction for UEs. Furthermore, use of historical information helps UEs select BSs with better long-term performance. Simulation results show that the proposed mechanism reduces fractional transfer time and the number of unsatisfied UEs, respectively, up to about 46% and 52.3% and improves BS throughput up to about 15.4% compared to a benchmark algorithm that is based on the received signal strength and the BS's estimated load.

Online reinforcement learning for adaptive interference coordination

“…Regarding the dynamic nature of the network conditions (eg, traffic intensity, number of users, user positions), most previous works 7,8,14‐17,20,21,29‐34 assume static or stationary conditions. While some works consider nonstationary scenarios, 9,18,19,22,28 their approaches are based on optimization or heuristic algorithms over mathematical models of the network , like in References 6‐8,10,20,21,32,34‐37.…”

An assessment of different user–BS association policies for green HetNets in off‐grid environments

“…To take the association decision, players use a distributed algorithm in trying to maximize their utilities independently. In the work of Hajijamali et al, the user–BS association problem in HetNets is modeled as a noncooperative game and solved with a distributed algorithm inspired by machine learning techniques.…”