Unsupervised learning‐based flexible framework for surveillance planning with aerial vehicles

The herein studied problem is motivated by practical needs of our participation in the Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2017 in which a team of Unmanned Aerial Vehicles (UAVs) is requested to collect objects in the given area as quickly as possible and score according to the rewards associated with the objects. The mission time is limited, and the most time-consuming operation is the collection of the objects themselves. Therefore, we address the problem to quickly identify the most valuable objects as surveillance planning with curvature-constrained trajectories. The problem is formulated as a multi-vehicle variant of the Dubins Traveling Salesman Problem with Neighborhoods (DTSPN). Based on the evaluation of existing approaches to the DTSPN, we propose to use unsupervised learning to find satisfiable solutions with low computational requirements. Moreover, the flexibility of unsupervised learning allows considering trajectory parametrization that better fits the motion constraints of the utilized hexacopters that are not limited by the minimal turning radius as the Dubins vehicle. We propose to use Bézier curves to exploit the maximal vehicle velocity and acceleration limits. Besides, we further generalize the proposed approach to 3D surveillance planning. We report on evaluation results of the developed algorithms and experimental verification of the planned trajectories using the real UAVs utilized in our participation in MBZIRC 2017.

[1]  Mario Fernando Montenegro Campos,et al.  An evolutionary approach for the dubins' traveling salesman problem with neighborhoods , 2012, GECCO '12.

[2]  Xin Yu,et al.  A genetic algorithm for the Dubins Traveling Salesman Problem , 2012, 2012 IEEE International Symposium on Industrial Electronics.

[3]  T. Bektaş The multiple traveling salesman problem: an overview of formulations and solution procedures , 2006 .

[4]  E. M. Cochrane,et al.  The co-adaptive neural network approach to the Euclidean Travelling Salesman Problem , 2003, Neural Networks.

[5]  Banu Soylu,et al.  A general variable neighborhood search heuristic for multiple traveling salesmen problem , 2015, Comput. Ind. Eng..

[6]  Xing Zhang,et al.  A memetic algorithm for path planning of curvature-constrained UAVs performing surveillance of multiple ground targets , 2014 .

[7]  Evangelos Papadopoulos,et al.  Polynomial-based obstacle avoidance techniques for nonholonomic mobile manipulator systems , 2005, Robotics Auton. Syst..

[8]  Josep L. Rosselló,et al.  FPGA-Based Stochastic Echo State Networks for Time-Series Forecasting , 2015, Comput. Intell. Neurosci..

[9]  Mario Fernando Montenegro Campos,et al.  An Orientation Assignment Heuristic to the Dubins Traveling Salesman Problem , 2014, IBERAMIA.

[10]  D. R. J. Owen Advanced engineering mathematics, Erwin Kreyszig, Wiley, London, 1972. No. of pages: 898. Price: £6.25 , 1973 .

[11]  Steven M. LaValle,et al.  Time-optimal paths for a Dubins airplane , 2007, 2007 46th IEEE Conference on Decision and Control.

[12]  Martin Saska,et al.  Dubins Orienteering Problem , 2017, IEEE Robotics and Automation Letters.

[13]  Pierre Hansen,et al.  Variable neighborhood search: Principles and applications , 1998, Eur. J. Oper. Res..

[14]  Jan Faigl,et al.  An Application of Self-Organizing Map for Multirobot Multigoal Path Planning with Minmax Objective , 2016, Comput. Intell. Neurosci..

[15]  Eloy García,et al.  Shortest Paths of Bounded Curvature for the Dubins Interval Problem , 2015, ArXiv.

[16]  Bernard Angéniol,et al.  Self-organizing feature maps and the travelling salesman problem , 1988, Neural Networks.

[17]  David Casbeer,et al.  Dubins paths through a sequence of points: Lower and upper bounds , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[18]  Takao Enkawa,et al.  A self-organising model for the travelling salesman problem , 1997 .

[19]  Douglas G. Macharet,et al.  Time-Optimized Routing Problem for Vehicles with Bounded Curvature , 2016, 2016 XIII Latin American Robotics Symposium and IV Brazilian Robotics Symposium (LARS/SBR).

[20]  J. Fort Solving a combinatorial problem via self-organizing process: An application of the Kohonen algorithm to the traveling salesman problem , 1988, Biological Cybernetics.

[21]  Jan Faigl,et al.  The Dubins Traveling Salesman Problem with Neighborhoods in the Three-Dimensional Space , 2018, ICRA 2018.

[22]  Martin Saska,et al.  Embedded model predictive control of unmanned micro aerial vehicles , 2016, 2016 21st International Conference on Methods and Models in Automation and Robotics (MMAR).

[23]  Sivakumar Rathinam,et al.  On Tightly Bounding the Dubins Traveling Salesman's Optimum , 2015 .

[24]  Michel Gendreau,et al.  The m-Traveling Salesman Problem with Minmax Objective , 1995, Transp. Sci..

[25]  Xavier Goaoc,et al.  Bounded-Curvature Shortest Paths through a Sequence of Points Using Convex Optimization , 2013, SIAM J. Comput..

[26]  Satyanarayana G. Manyam,et al.  A Tight Lower Bounding Procedure for the Dubins Traveling Salesman Problem , 2015, ArXiv.

[27]  Swaroop Darbha,et al.  Today's Traveling Salesman Problem , 2010, IEEE Robotics & Automation Magazine.

[28]  F. Bullo,et al.  On Traveling Salesperson Problems for a double integrator , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[29]  Jan Faigl,et al.  Self-Organizing Map for the Curvature-Constrained Traveling Salesman Problem , 2016, ICANN.

[30]  Jan Faigl,et al.  Online planning for multi-robot active perception with self-organising maps , 2018, Auton. Robots.

[31]  Xiang Ma,et al.  Receding Horizon Planning for Dubins Traveling Salesman Problems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[32]  Mario Fernando Montenegro Campos,et al.  Efficient target visiting path planning for multiple vehicles with bounded curvature , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Mario Fernando Montenegro Campos,et al.  Nonholonomic path planning optimization for Dubins' vehicles , 2011, 2011 IEEE International Conference on Robotics and Automation.

[34]  Martin Saska,et al.  Dubins orienteering problem with neighborhoods , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[35]  Xin Yu,et al.  Optimization Approaches for a Dubins Vehicle in Coverage Planning Problem and Traveling Salesman Problems , 2015 .

[36]  Jan Faigl,et al.  On the Dubins Traveling Salesman Problem with Neighborhoods , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[37]  Salah Sukkarieh,et al.  An Analytical Continuous-Curvature Path-Smoothing Algorithm , 2010, IEEE Transactions on Robotics.

[38]  Emilio Frazzoli,et al.  On the Dubins Traveling Salesman Problem , 2012, IEEE Transactions on Automatic Control.

[39]  Yu Wang,et al.  Real-Time Dynamic Dubins-Helix Method for 3-D Trajectory Smoothing , 2015, IEEE Transactions on Control Systems Technology.

[40]  R. Sreerama Kumar,et al.  A Bezier curve based path planning in a multi-agent robot soccer system without violating the acceleration limits , 2009, Robotics Auton. Syst..

[41]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[42]  S. Darbha,et al.  Sampling-Based Roadmap Methods for a Visual Reconnaissance UAV ∗ , 2010 .

[43]  Tal Shima,et al.  Motion planning algorithms for the Dubins Travelling Salesperson Problem , 2015, Autom..

[44]  Keld Helsgaun,et al.  An effective implementation of the Lin-Kernighan traveling salesman heuristic , 2000, Eur. J. Oper. Res..

[45]  Takao Enkawa,et al.  Competition-based neural network for the multiple travelling salesmen problem with minmax objective , 1999, Comput. Oper. Res..

[46]  F. Bullo,et al.  On the point-to-point and traveling salesperson problems for Dubins' vehicle , 2005, Proceedings of the 2005, American Control Conference, 2005..

[47]  Joao P. Hespanha,et al.  Algorithms for the traveling Salesman Problem with Neighborhoods involving a dubins vehicle , 2011, Proceedings of the 2011 American Control Conference.

[48]  João Pedro Hespanha,et al.  Dubins Traveling Salesman Problem with Neighborhoods: A Graph-Based Approach , 2013, Algorithms.

[49]  Jan Faigl,et al.  Unsupervised learning for surveillance planning with team of aerial vehicles , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[50]  Geoffrey A. Hollinger,et al.  Autonomous Data Collection Using a Self-Organizing Map , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[51]  Mandell Bellmore,et al.  Transformation of Multisalesman Problem to the Standard Traveling Salesman Problem , 1974, JACM.

[52]  S. Darbha,et al.  Sampling-Based Path Planning for a Visual Reconnaissance Unmanned Air Vehicle , 2012 .

[53]  Vijay Kumar,et al.  Model Predictive Trajectory Tracking and Collision Avoidance for Reliable Outdoor Deployment of Unmanned Aerial Vehicles , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[54]  William J. Cook,et al.  The Traveling Salesman Problem: A Computational Study , 2007 .

[55]  Do-Hyeun Kim,et al.  An Extended Self-Organizing Map based on 2-opt algorithm for solving symmetrical Traveling Salesperson Problem , 2014, Neural Computing and Applications.

[56]  K. Obermeyer Path Planning for a UAV Performing Reconnaissance of Static Ground Targets in Terrain , 2009 .

[57]  Justin R. Thomas,et al.  Cooperative Autonomous Search, Grasping and Delivering in a Treasure Hunt Scenario by a Team of UAVs , 2017 .

[58]  G. Croes A Method for Solving Traveling-Salesman Problems , 1958 .

[59]  P. Bézier Numerical control : mathematics and applications , 1972 .

[60]  Jan Faigl,et al.  GSOA: Growing Self-Organizing Array - Unsupervised learning for the Close-Enough Traveling Salesman Problem and other routing problems , 2018, Neurocomputing.

[61]  Martin Saska,et al.  On solution of the Dubins touring problem , 2017, 2017 European Conference on Mobile Robots (ECMR).

[62]  Igor Skrjanc,et al.  Time optimal path planning considering acceleration limits , 2003, Robotics Auton. Syst..

[63]  Jan Faigl,et al.  Rescue Operation Planning by Soft Computing Techniques , 2004 .

[64]  Yu Wang,et al.  Path Generation of Autonomous Approach to a Moving Ship for Unmanned Vehicles , 2015, IEEE Transactions on Industrial Electronics.

[65]  Andreas Müller,et al.  Smooth orientation path planning with quaternions using B-splines , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).