Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking

Jiseon Moon, Savvas Papaioannou, Christos Laoudias, Panayiotis Kolios, Sunwoo Kim

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

In this article, we propose a novel deep reinforcement learning (DRL) approach for controlling multiple unmanned aerial vehicles (UAVs) with the ultimate purpose of tracking multiple first responders (FRs) in challenging 3-D environments in the presence of obstacles and occlusions. We assume that the UAVs receive noisy distance measurements from the FRs which are of two types, i.e., Line of Sight (LoS) and non-LoS (NLoS) measurements and which are used by the UAV agents in order to estimate the state (i.e., position) of the FRs. Subsequently, the proposed DRL-based controller selects the optimal joint control actions according to the Cramér-Rao lower bound (CRLB) of the joint measurement likelihood function to achieve high tracking performance. Specifically, the optimal UAV control actions are quantified by the proposed reward function, which considers both the CRLB of the entire system and each UAV's individual contribution to the system, called global reward and difference reward, respectively. Since the UAVs take actions that reduce the CRLB of the entire system, tracking accuracy is improved by ensuring the reception of high quality LoS measurements with high probability. Our simulation results show that the proposed DRL-based UAV controller provides a highly accurate target tracking solution with a very low runtime cost.

Original languageEnglish
Pages (from-to)15441-15455
Number of pages15
JournalIEEE Internet of Things Journal
Volume8
Issue number20
DOIs
StatePublished - 2021 Oct 15

Keywords

  • Multiagent deep reinforcement learning (DRL)
  • multitarget tracking
  • unmanned aerial vehicle (UAV)

Fingerprint

Dive into the research topics of 'Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking'. Together they form a unique fingerprint.

Cite this