This paper considers an aerial base station (aerial-BS) assisted terrestrial network where user mobility is taken into account. User movement changes the network dynamically which may result in performance loss. To avoid this loss, guarantee a minimum quality-of-service (QoS) and possibly increase the QoS, we add an aerial-BS to the network. For fair comparison between the conventional terrestrial network and the aerial-BS assisted one, we keep the total number of BSs identical in both networks. Obtaining the best performance in such networks highly depends on the optimal placement of the aerial-BS. To this end, an algorithm which can rely on general and realistic assumptions and can decide where to go based on the past experiences is required. The proposed approach for this goal is based on a discounted reward reinforcement learning which is known as Q-learning. Simulation results show this method provides an effective placement strategy which increases the QoS of wireless networks when it is needed and promises to find the optimum position of the aerial-BS in discrete environments.

No abstract

In this paper, we use an aerial base station (aerial-BS) to enhance fairness in a dynamic environment with user mobility. The problem of optimally placing the aerial-BS is a non-deterministic polynomial-time hard (NP-hard) problem. Moreover, the network topology is subject to continuous changes due to the user mobility. These issues intensify the quest to develop an adaptive and fast algorithm for 3D placement of the aerial-BS. To this end, we propose a method based on reinforcement learning to achieve these goals. Simulation results show that our method increases fairness among users in a reasonable computing time, while the solution is comparatively close to the optimal solution obtained by exhaustive search.

No abstract

No abstract