Trajectory Optimization for UAV Emergency Communication With Limited User Equipment Energy: A Safe-DQN Approach

Zhang, Tiankui; Lei, Jiayi; Liu, Yuanwei; Feng, Chunyan; Nallanathan, Arumugam

doi:10.1109/tgcn.2021.3068333

Cited by 68 publications

(26 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…First characterizing the interference received by the ground UE, then evaluating the coverage probability, the authors proposed both random and uniform waypoint mobility models to characterize the UAV movement process. In their work, Zhang et al investigated UAVbased emergency communication networks where ground power systems are not operational after a disaster and UE energy is limited [279]. The authors consider this UE energy limitation as well as physical obstacles to UAV flights to develop a trajectory optimization solution by simplifying this problem as a constrained Markov decision-making process and propose a Lyapunov-based deep learning trajectory design algorithm, where the UAV is the agent.…”

Section: E Uavs As User Equipmentmentioning

confidence: 99%

Unmanned Aerial Vehicle Communications for Civil Applications: A Review

et al. 2022

View full text Add to dashboard Cite

The use of drones, formally known as unmanned aerial vehicles (UAVs), has significantly increased across a variety of applications over the past few years. This is due to the rapid advancement towards the design and production of inexpensive and dependable UAVs and the growing request for the utilization of such platforms particularly in civil applications. With their intrinsic attributes such as high mobility, rapid deployment and flexible altitude, UAVs have the potential to be utilized in many wireless system applications. On the one hand, UAVs are able to operate as flying mobile terminals within wireless/cellular networks to support a variety of missions such as goods delivery, search and rescue, precision agriculture monitoring, and remote sensing. On the other hand, UAVs can be utilized as aerial base stations to increase wireless communication coverage, reliability, and the capacity of wireless systems without additional investment in wireless systems infrastructure. The aim of this article is to review the current applications of UAVs for civil and commercial purposes. The focus of this paper is on the challenges and communication requirements associated with UAV-based communication systems. This article initially classifies UAVs in terms of various parameters, some of which can impact UAVs' communication performance. It then provides an overview of aerial networking and investigates UAVs routing protocols specifically, which are considered as one of the challenges in UAV communication. This article later investigates the use of UAV networks in a variety of civil applications and considers many challenges and communication demands of these applications. Subsequently, different types of simulation platforms are investigated from a communication and networking viewpoint. Finally, it identifies areas of future research.

show abstract

Section: E Uavs As User Equipmentmentioning

confidence: 99%

Unmanned Aerial Vehicle Communications for Civil Applications: A Review

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Furthermore, optimal UAV trajectory selection could maximize the resource efficiency significantly [132]. On maximizing uplink throughput and energy efficiency of user equipment, authors in [133] presents a safe-deep-Q-network (safe-DQN) for UAV trajectory.…”

Section: Self-powered Unmanned Aerial Wireless Networkmentioning

confidence: 99%

A Comprehensive Survey of Emergency Communication Network and Management

Debnath

Arif

Roy

et al. 2021

Wireless Pers Commun

View full text Add to dashboard Cite

The performance of wireless communication network is important in emergency rescue operations while ensuring optimum usage of limited wireless resources. Due to the disruption of normal wireless communication in a post-disaster scenario, the sustenance of an emergency communication network plays a significant role in relief operations. Under such a scenario, it becomes crucial to monitor the performance and reliability of the protocol in a time-bound manner. Some of the prominent challenges faced by the communication network during this period are related to energy efficiency, resources allocation, reliable connectivity, QoS, network throughput, and interoperability. A comprehensive performance appraisal of the emergency network considering the above-mentioned aspects is extremely important. This review provides a comprehensive survey of the widely used communication technologies applied for setting up an emergency communication network to mitigate the post disaster aftermath. The article also delivers an overview of the integration of new technologies with the existing standards for improving the performance of the disaster communication networks. Finally, we propose some promising solutions to overcome the limitations of existing emergency communication technologies to improve the overall network performance.

show abstract

“…Moreover, the constraints of limited wireless backhaul capacity and inefficient deployment of ground devices (GDs) (e.g., D2D communication pairs) pose extra challenges on network planning and design of emergency communications [7]. To overcome these challenges, unmanned aerial vehicles (UAVs) can be utilized to provide a flexible and efficient solution for quickly restoring communications in emergency and disaster situations, which has drawn significant attentions from both academia and industry [9]- [11]. Due to their high mobility and flexible deployment in the three-dimensional (3D) space, UAVs are often exploited as aerial communications infrastructure, e.g., flying BSs, for temporary coverage and traffic offloading over the areas following disasters.…”

Section: Introductionmentioning

confidence: 99%

Q-Learning Aided Intelligent Routing with Maximum Utility in Cognitive UAV Swarm for Emergency Communications

Zhang¹,

Ma²,

Zhuang³

et al. 2022

Preprint

View full text Add to dashboard Cite

In this paper, we attempt to deal with the routing problem in a cognitive unmanned aerial vehicle (UAV) swarm (CU-SWARM), which applies the cognitive radio into a swarm of UAVs within a three-hierarchical aerial-ground integrated network architecture for emergency communications. In particular, the flexibly converged architecture utilizes a UAV swarm and a high-altitude platform to support aerial sensing and access, respectively, over the disaster-affected areas. We develop a Q-learning framework to achieve the intelligent routing with maximum utility for CU-SWARM. To characterize the reward function, we take into account both the routing metric design and the candidate UAV selection optimization. The routing metric is determined by maximizing the utility, which jointly captures the achievable rate of UAV pair and the residual energy of UAV. Besides, under the location, arc, and direction constraints, the circular sector is modeled by properly choosing the central angle and the acceptable signal-to-noise ratio for the UAV. With this setup, we further propose a low-complexity iterative algorithm using the dynamic learning rate to update Q-values during the training process for achieving a fast convergence speed. Extensive simulation results are provided to assess the potential of the Q-learning framework of intelligent routing as well as to verify our overall iterative algorithm via the dynamic learning rate for training procedure. Our findings reveal that the proposed algorithm can significantly increase the accumulated rewards significantly with practical complexity compared to other benchmark schemes with fixed and decaying learning rates.

show abstract

Trajectory Optimization for UAV Emergency Communication With Limited User Equipment Energy: A Safe-DQN Approach

Cited by 68 publications

References 30 publications

Unmanned Aerial Vehicle Communications for Civil Applications: A Review

Unmanned Aerial Vehicle Communications for Civil Applications: A Review

A Comprehensive Survey of Emergency Communication Network and Management

Q-Learning Aided Intelligent Routing with Maximum Utility in Cognitive UAV Swarm for Emergency Communications

Contact Info

Product

Resources

About