A Distributed ADMM Approach to Non-Myopic Path Planning for Multi-Target Tracking

This paper investigates non-myopic path planning of mobile sensors for multi-target tracking. Such problem has posed a high computational complexity issue and/or the necessity of high-level decision making. Existing works tackle these issues by heuristically assigning targets to each sensing agent and solving the split problem for each agent. However, such heuristic methods reduce the target estimation performance in the absence of considering the changes of target state estimation along time. In this work, we detour the task-assignment problem by reformulating the general non-myopic planning problem to a distributed optimization problem with respect to targets. By combining alternating direction method of multipliers (ADMM) and local trajectory optimization method, we solve the problem and induce consensus (i.e., high-level decisions) automatically among the targets. In addition, we propose a modified receding-horizon control (RHC) scheme and edge-cutting method for efficient real-time operation. The proposed algorithm is validated through simulations in various scenarios.

[1]  Edwin K. P. Chong,et al.  A POMDP Framework for Coordinated Guidance of Autonomous UAVs for Multitarget Tracking , 2009, EURASIP J. Adv. Signal Process..

[2]  Sameera S. Ponda,et al.  Information-rich Task Allocation and Motion Planning for Heterogeneous Sensor Platforms , 2011 .

[3]  Emanuel Todorov,et al.  Combining the benefits of function approximation and trajectory optimization , 2014, Robotics: Science and Systems.

[4]  A. Hero,et al.  Efficient methods of non-myopic sensor management for multitarget tracking , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[5]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[6]  Han-Lim Choi,et al.  Continuous trajectory planning of mobile sensors for informative forecasting , 2010, Autom..

[7]  Su-Jin Lee,et al.  Efficient sensor network planning based on approximate potential games , 2018, Int. J. Distributed Sens. Networks.

[8]  Han-Lim Choi,et al.  Periodic sensing trajectory generation for persistent monitoring , 2014, 53rd IEEE Conference on Decision and Control.

[9]  Pramod K. Varshney,et al.  Optimal Periodic Sensor Scheduling in Networks of Dynamical Systems , 2013, IEEE Transactions on Signal Processing.

[10]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[11]  João M. F. Xavier,et al.  D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization , 2012, IEEE Transactions on Signal Processing.

[12]  Claire J. Tomlin,et al.  Mobile Sensor Network Control Using Mutual Information Methods and Particle Filters , 2010, IEEE Transactions on Automatic Control.

[13]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[14]  Alexander Charlish,et al.  Autonomous agents for multi-function radar resource management , 2011 .

[15]  Asuman E. Ozdaglar,et al.  Distributed Alternating Direction Method of Multipliers , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[16]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[17]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[18]  Hyondong Oh,et al.  Coordinated standoff tracking of moving target groups using multiple UAVs , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[19]  Per Skoglar,et al.  UAV Path and Sensor Planning Methods for Multiple Ground Target Search and Tracking - A Literature Survey , 2007 .

[20]  Han-Lim Choi,et al.  On the roles of smoothing in planning of informative paths , 2009, 2009 American Control Conference.

[21]  Su-Jin Lee,et al.  A Potential-Game Approach for Information-Maximizing Cooperative Planning of Sensor Networks , 2014, IEEE Transactions on Control Systems Technology.

[22]  Gerhard Reinelt,et al.  TSPLIB - A Traveling Salesman Problem Library , 1991, INFORMS J. Comput..

[23]  J. Bather,et al.  Tracking and data fusion , 2001 .

[24]  Emanuel Todorov,et al.  General duality between optimal control and estimation , 2008, 2008 47th IEEE Conference on Decision and Control.

[25]  J. Christian Gerdes,et al.  Cooperative Collision Avoidance via proximal message passing , 2015, 2015 American Control Conference (ACC).

[26]  John W. Fisher,et al.  Approximate Dynamic Programming for Communication-Constrained Sensor Network Management , 2007, IEEE Transactions on Signal Processing.

[27]  Han-Lim Choi,et al.  An outer-approximation approach for information-maximizing sensor selection , 2012, Optimization Letters.

[28]  J. How,et al.  Information-rich Path Planning with General Constraints using Rapidly-exploring Random Trees , 2010 .

[29]  Javier Alonso-Mora,et al.  A message-passing algorithm for multi-agent trajectory planning , 2013, NIPS.

[30]  Leslie Pack Kaelbling,et al.  Belief space planning assuming maximum likelihood observations , 2010, Robotics: Science and Systems.

[31]  David Q. Mayne,et al.  Differential dynamic programming , 1972, The Mathematical Gazette.

[32]  Lino Marques,et al.  Robots for Environmental Monitoring: Significant Advancements and Applications , 2012, IEEE Robotics & Automation Magazine.

[33]  Darryl Morrell,et al.  Nonmyopic Sensor Scheduling and its Efficient Implementation for Target Tracking Applications , 2006, EURASIP J. Adv. Signal Process..

[34]  Hao Jiang,et al.  Online Path Planning of Autonomous UAVs for Bearing-Only Standoff Multi-Target Following in Threat Environment , 2018, IEEE Access.

[35]  James T. Kwok,et al.  Asynchronous Distributed ADMM for Consensus Optimization , 2014, ICML.

[36]  Pramod K. Varshney,et al.  Sparsity-Promoting Extended Kalman Filtering for Target Tracking in Wireless Sensor Networks , 2012, IEEE Signal Processing Letters.

[37]  Y. Oshman,et al.  Optimization of observer trajectories for bearings-only target localization , 1999 .

[38]  Nate Derbinsky,et al.  An Improved Three-Weight Message-Passing Algorithm , 2013, ArXiv.

[39]  Liang Sun,et al.  A Scalable Multitarget Tracking System for Cooperative Unmanned Aerial Vehicles , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[40]  A. Rahimi,et al.  Simultaneous localization, calibration, and tracking in an ad hoc sensor network , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[41]  Vladimir Pavlovic,et al.  Fast ADMM Algorithm for Distributed Optimization with Adaptive Penalty , 2015, AAAI.

[42]  Sang-Jo Yoo,et al.  Optimal UAV Path Planning: Sensing Data Acquisition Over IoT Sensor Networks Using Multi-Objective Bio-Inspired Algorithms , 2018, IEEE Access.

[43]  Hyondong Oh,et al.  Coordinated standoff tracking of groups of moving targets using multiple UAVs , 2013, 21st Mediterranean Conference on Control and Automation.

[44]  Sameera S. Ponda,et al.  Trajectory Optimization for Target Localization Using Small Unmanned Aerial Vehicles , 2009 .

[45]  Yoshiaki Kuwata,et al.  Three Dimensional Receding Horizon Control for UAVs , 2004 .

[46]  Edwin K. P. Chong,et al.  UAV Path Planning in a Dynamic Environment via Partially Observable Markov Decision Process , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[47]  Han-Lim Choi,et al.  Consensus-Based Decentralized Auctions for Robust Task Allocation , 2009, IEEE Transactions on Robotics.

[48]  Su-Jin Lee,et al.  Potential Game-Based Non-Myopic Sensor Network Planning for Multi-Target Tracking , 2018, IEEE Access.

[49]  Victor C. M. Leung,et al.  UAV Trajectory Optimization for Data Offloading at the Edge of Multiple Cells , 2018, IEEE Transactions on Vehicular Technology.

[50]  L. Dubins.  On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[51]  Dragan Petrovic,et al.  Multi-step information-directed sensor querying in distributed sensor networks , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[52]  Ron Alterovitz,et al.  Motion planning under uncertainty using iterative local optimization in belief space , 2012, Int. J. Robotics Res..

[53]  A. Papandreou-Suppappola,et al.  Energy efficient target tracking in a sensor network using non-myopic sensor scheduling , 2005, 2005 7th International Conference on Information Fusion.