Markov Approximation Based Resource Allocation Algorithm for Multi - Frequency Cooperative Networks

Semi‐dynamic Markov approximation‐based base station sleep with user association for heterogeneous networks

“…In the mmWave band, the subchannel from the BS to the $${n}_{th}$$ user over $${k}_m$$th subchannel can be expressed as $${\mathop{\rm h}\nolimits} _{n,{k}_m}^m$$. The specific expressions of subchannels can be expressed in Equations () and () [14]. In the sub‐6 GHz band, the subchannel from the BS to the $${n}_{th}$$ user can be expressed as $$$$\begin{equation} \def\eqcellsep{&}\begin{array}{rcl}{{\mathbf{h}}_{n,{k}_{s}}^{s}}& =&\displaystyle {\frac{1}{\sqrt{{\rho}_{n}}}\left(\sqrt{\frac{\kappa}{1+\kappa}}{e}^{j\psi}\sqrt{{M}_{s}}{\mathbf{a}}_{\mathbf{s}}^{\mathbf{H}}\left(\varphi \right)\right.$$…”

“…In the mmWave band, the subchannel from the BS to the n th user over k m th subchannel can be expressed as h m n,k m . The specific expressions of subchannels can be expressed in Equations ( 1) and (2) [14]. In the sub-6 GHz band, the subchannel from the BS to the n th user can be expressed as…”

“…The MA algorithm is a distributed optimization framework [14], and the utility is set to be the total throughput of users in [21,22]. To maximize the total throughput and quickly assign resources to users, the algorithm adopts the MA to obtain the users' reachable rate, network utility, and spectrum efficiency with the sub-6 GHz band and mmWave.…”

“…where  denotes the collection of all feasible configurations. The P1 can be transformed into P2, as expressed in formula (14).…”

“…In [13], the user access problem in sub-6 GHz and mmWave heterogeneous networks first considers the distributed Markov decision process and then optimizes it through deep Q-learning but does not consider the resource allocation problem. [14] shows that in sub-6 GHz and mmWave heterogeneous networks, the resource allocation strategy based on the Markov approximation (MA) algorithm can obtain the optimal solution. However, it is not suitable for the system environment after the BSS, and the user connection in the model is fixed.…”