DeepRAT: A DRL-Based Framework for Multi-RAT Assignment and Power Allocation in HetNets

Deep Reinforcement Learning for Radio Resource Allocation and Management in Next Generation Heterogeneous Wireless Networks: A Survey

“…Fortunately, the mmWave and the emerging THz bands can considerably overcome this shortcoming by providing an extra 3.25 GHz and 10-100 GHz bandwidth, respectively [38]. It is also expected that modern wireless user devices will be equipped with advanced capabilities that enable them to aggregate all these three frequency bands, i.e., the sub 6GHz, mmWave, and THz, to support future disruptive technologies and services [39]. However, allocating and managing the radio channels across these three frequency bands across multi-RAN to a massive number of user devices mandate developing advanced signal processing techniques.…”

“…In particular, user association defines which BS(s), wireless RAN's AP(s), or wireless edge server that each user device must connect/associate to/with at each time to guarantee its QoS demands. Taken into consideration the multi-RAN and multi-connectivity nature of modern wireless networks [3], it is expected that future smart devices will be equipped with SDR capabilities that enable them to support multi-association/assignment to multiple RANs simultaneously [39]. Based on users'…”

“…QoS demands, devices can operate in a multi-mode or a multi-homing fashion. In the multi-mode fashion, each device will be associated with a single RAN AP at a time [39], [40] similar to the traditional fashion. Whereas in the multi-homing fashion, each user device can be simultaneously associated with multiple RANs APs to aggregate their radio resources, such as radio channels and data rate.…”

“…However, obtaining such parameters in real-time is quite difficult, especially for modern wireless networks, due to their rapid increases in the underlying RANs, the number of user devices, and the type of applications. Moreover, multi-RANs data rate aggregation has also been proposed recently [39], [42] to support the multi-Gbps data rate requirements of the emerging data-hungry wireless applications. Hence, it becomes imperative to develop efficient schemes that enable rate aggregation while having limited knowledge of the wireless channels.…”

“…Hence, it becomes imperative to develop efficient schemes that enable rate aggregation while having limited knowledge of the wireless channels. DRL techniques can be efficiently employed to achieve this goal [39], [40], [42].…”