Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach

Abstract

Modern wireless networks are notorious for being very dense, uncoordinated, and selfish, especially with greedy user needs. This leads to a critical scarcity problem in spectrum resources. The Dynamic Spectrum Access system (DSA) is considered a promising solution for this scarcity problem. With the aid of Unmanned Aerial Vehicles (UAVs), a post-disaster surveillance system is implemented using Cognitive Radio Network (CRN). UAVs are distributed in the disaster area to capture live images of the damaged area and send them to the disaster management center. CRN enables UAVs to utilize a portion of the spectrum of the Electronic Toll Collection (ETC) gates operating in the same area. In this paper, a joint transmission power selection, data-rate maximization, and interference mitigation problem is addressed. Considering all these conflicting parameters, this problem is investigated as a budget-constrained multi-player multi-armed bandit (MAB) problem. The whole process is done in a decentralized manner, where no information is exchanged between UAVs. To achieve this, two power-budget-aware PBA-MAB) algorithms, namely upper confidence bound (PBA-UCB (MAB) algorithm and Thompson sampling (PBA-TS) algorithm, were proposed to realize the selection of the transmission power value efficiently. The proposed PBA-MAB algorithms show outstanding performance over random power value selection in terms of achievable data rate.

A socio-economic multi-objective optimization approach toward enhancing public–private partnerships’ concession agreements in infrastructure development

“…However, the GA produces offsprings from parents through the cross-over operation and mutation, while in the TS algorithm, new data points are generated using sample functions from the Gaussian processes. The TS algorithm formulates m distinct functions from m independent Gaussian processes using spectral sampling (Amrallah et al, 2021).…”

UAV Trajectory Optimization in a Post-Disaster Area Using Dual Energy-Aware Bandits

“…Despite the existence of numerous excellent studies on UAV wireless communication networks, there are only a few works that focus on UAV-assisted emergency wireless communication networks. In our earlier studies [ 28 , 29 ], we investigated the radio resource allocation for a UAV emergency wireless communication network using a dynamic spectrum access system. The purpose of the deployment of UAVs as a cognitive radio network (CRN) was to maximize the downlink data rate in a post-disaster environment.…”

A Dynamic Task Scheduling Method for Multiple UAVs Based on Contract Net Protocol

“…Sudden catastrophic events, such as earthquakes, floods, terrorist attacks, etc., are always random, dynamic, destructive, and emergent. Unmanned aerial vehicles (UAVs) are flexible, low-cost, and high-efficient and can be applicable to emergency disaster relief [1][2][3][4][5][6]. In the pre-disaster stage, sensors installed on UAVs can predict the disaster's time, geographical location, and magnitude by cooperating with current wireless sensor networks [7].…”