Autonomous air combat decision‐making of UAV based on parallel self‐play reinforcement learning

Li, Bo; Huang, Jingyi; Bai, Shuangxia; Gan, Zhigang; Liang, Shiyang; Neretin, E S; Yao, Shouwen

doi:10.1049/cit2.12109

Cited by 18 publications

(5 citation statements)

References 37 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The paper suggested a new methodology that reduces the number of operations required to produce secret keys by utilizing elliptic curve cryptography [54]. The next step has been the presentation of research difficulties and future directions for further developing the suggested system [55,56].…”

Section: Blockchain Technologymentioning

confidence: 99%

See 1 more Smart Citation

Enhancement of UAV Data Security and Privacy Via Ethereum Blockchain Technology

Singh Rawat,

Alotaibi,

Malsa

et al. 2023

Computers, Materials &Amp; Continua

View full text Add to dashboard Cite

Unmanned aerial vehicles (UAVs), or drones, have revolutionized a wide range of industries, including monitoring, agriculture, surveillance, and supply chain. However, their widespread use also poses significant challenges, such as public safety, privacy, and cybersecurity. Cyberattacks, targeting UAVs have become more frequent, which highlights the need for robust security solutions. Blockchain technology, the foundation of cryptocurrencies has the potential to address these challenges. This study suggests a platform that utilizes blockchain technology to manage drone operations securely and confidentially. By incorporating blockchain technology, the proposed method aims to increase the security and privacy of drone data. The suggested platform stores information on a public blockchain located on Ethereum and leverages the Ganache platform to ensure secure and private blockchain transactions. The MetaMask wallet for Ethbalance is necessary for BCT transactions. The present research finding shows that the proposed approach's efficiency and security features are superior to existing methods. This study contributes to the development of a secure and efficient system for managing drone operations that could have significant applications in various industries. The proposed platform's security measures could mitigate privacy concerns, minimize cyber security risk, and enhance public safety, ultimately promoting the widespread adoption of UAVs. The results of the study demonstrate that the blockchain can ensure the fulfillment of core security needs such as authentication, privacy preservation, confidentiality, integrity, and access control.

show abstract

Section: Blockchain Technologymentioning

confidence: 99%

“…The article presents a detailed architecture for a blockchain-based UAV communication system and discusses the opportunities and challenges associated with its implementation. [56] 2022 1. This article proposes an autonomous air combat decision-making framework for UAVs based on parallel self-play reinforcement learning.…”

Section: Blockchain Technologymentioning

confidence: 99%

Enhancement of UAV Data Security and Privacy Via Ethereum Blockchain Technology

Singh Rawat,

Alotaibi,

Malsa

et al. 2023

Computers, Materials &Amp; Continua

View full text Add to dashboard Cite

show abstract

“…Leveraging their synergies in perception, communication, payload capacity and localization, they enhance a system's overall capability, flexibility and adaptability to uncharted terrains, thereby accomplishing tasks that are arduous for a standalone UAV or solitary UGV. Primarily, they have important applications in the fields of intelligent transportation [1], urban cleanliness [2], unknown exploration [3], military [4,5], etc., and related research has been extensively carried out. It is worth noting that UAVs have played a significant role in the COVID-19 pandemic due to isolation security and telemedicine [6].…”

Section: Introductionmentioning

confidence: 99%

A Unmanned Aerial Vehicle (UAV)/Unmanned Ground Vehicle (UGV) Dynamic Autonomous Docking Scheme in GPS-Denied Environments

Cheng,

Li,

Xie

et al. 2023

Drones

View full text Add to dashboard Cite

This study designs a navigation and landing scheme for an unmanned aerial vehicle (UAV) to autonomously land on an arbitrarily moving unmanned ground vehicle (UGV) in GPS-denied environments based on vision, ultra-wideband (UWB) and system information. In the approaching phase, an effective multi-innovation forgetting gradient (MIFG) algorithm is proposed to estimate the position of the UAV relative to the target using historical data (estimated distance and relative displacement measurements). Using these estimates, a saturated proportional navigation controller is developed, by which the UAV can approach the target, making the UGV enter the field of view (FOV) of the camera deployed in the UAV. Then, a sensor fusion estimation algorithm based on an extended Kalman filter (EKF) is proposed to achieve accurate landing. Finally, a numerical example and a real experiment are used to support the theoretical results.

show abstract

“…The soft actor critic (SAC) [32] algorithm, in contrast to deterministic policy algorithms, aims to maximise the cumulative reward regularised by entropy rather than merely the cumulative reward. The SAC algorithm can increase the randomness of action, encouraging the agent to explore throughout the training process, hence speeding up subsequent learning speed [33]. Numerous benchmark studies have demonstrated state-of-the-art performance.…”

Section: Introductionmentioning

confidence: 99%

Manoeuvre decision‐making of unmanned aerial vehicles in air combat based on an expert actor‐based soft actor critic algorithm

Bai

Liang

et al. 2023

CAAI Trans on Intel Tech

Self Cite

View full text Add to dashboard Cite

The demand for autonomous motion control of unmanned aerial vehicles in air combat is boosted as taking the initiative in combat appears more and more crucial. Unmanned aerial vehicles inability to manoeuvre autonomously during air combat that features highly dynamic and uncertain manoeuvres of the enemy; however, limits their combat capabilities, which proves to be very challenging. To meet the challenge, this article proposes an autonomous manoeuvre decision model using an expert actor‐based soft actor critic algorithm that reconstructs empirical replay buffer with expert experience. Specifically, the algorithm uses a small amount of expert experience to increase the diversity of the samples, which can largely improve the exploration and utilisation efficiency of deep reinforcement learning. And to simulate the complex battlefield environment, a one‐to‐one air combat model is established and the concept of missile's attack region is introduced. The model enables the one‐to‐one air combat to be simulated under different initial battlefield situations. Simulation results show that the expert actor‐based soft actor critic algorithm can find the most favourable policy for unmanned aerial vehicles to defeat the opponent faster, and converge more quickly, compared with the soft actor critic algorithm.

show abstract

Autonomous air combat decision‐making of UAV based on parallel self‐play reinforcement learning

Cited by 18 publications

References 37 publications

Enhancement of UAV Data Security and Privacy Via Ethereum Blockchain Technology

Enhancement of UAV Data Security and Privacy Via Ethereum Blockchain Technology

A Unmanned Aerial Vehicle (UAV)/Unmanned Ground Vehicle (UGV) Dynamic Autonomous Docking Scheme in GPS-Denied Environments

Manoeuvre decision‐making of unmanned aerial vehicles in air combat based on an expert actor‐based soft actor critic algorithm

Contact Info

Product

Resources

About