Sense and avoid technologies with applications to unmanned aircraft systems: Review and prospects

Abstract Unmanned Aircraft Systems (UASs) are becoming ever more promising over the last decade. The Sense and Avoid (S&A) system plays a profoundly important role in integrating UASs into the National Airspace System (NAS) with reliable and safe operations. After analyzing the manner of S&A system, this paper systematically presents an overview on the recent progress in S&A technologies in the sequence of fundamental functions/components of S&A in sensing techniques, decision making, path planning, and path following. The approaches to these four aspects are outlined and summarized, based on which the existing challenges and potential solutions are highlighted for facilitating the development of S&A systems.

[1]  Andrey V. Savkin,et al.  A method for guidance and control of an autonomous vehicle in problems of border patrolling and obstacle avoidance , 2011, Autom..

[2]  N. Harris McClamroch,et al.  Tracking and maneuver regulation control for nonlinear nonminimum phase systems: application to flight control , 2002, IEEE Trans. Control. Syst. Technol..

[3]  F. M. Dommermuth,et al.  The estimation of target motion parameters from cpa time measurements in a field of acoustic sensors , 1988 .

[4]  Fatiha Nejjari,et al.  Modelling and adaptive backstepping control for TX-1570 UAV path tracking , 2014 .

[5]  Jong-Hun Kim,et al.  Development of an electro-optical system for small UAV , 2010 .

[6]  F. Dommermuth,et al.  Estimating the trajectory of an accelerationless aircraft by means of a stationary acoustic sensor , 1984 .

[7]  Mengdao Xing,et al.  Motion Compensation for UAV SAR Based on Raw Radar Data , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Antonio Bicchi,et al.  Planning shortest bounded-curvature paths for a class of nonholonomic vehicles among obstacles , 1996, J. Intell. Robotic Syst..

[9]  L. F. Bertuccelli,et al.  Robust Adaptive Markov Decision Processes: Planning with Model Uncertainty , 2012, IEEE Control Systems.

[10]  Yohannes Ketema,et al.  Controllability and Reachability for Micro-Aerial-Vehicle Trajectory Planning in Winds , 2010 .

[11]  Ahmad A. Masoud,et al.  Motion planning with gamma-harmonic potential fields , 2012, 2010 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[12]  David Sislák,et al.  Agent-Based Cooperative Decentralized Airplane-Collision Avoidance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[13]  Kimon P. Valavanis,et al.  Evolutionary algorithm based offline/online path planner for UAV navigation , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Luca Consolini,et al.  On the VTOL Exact Tracking With Bounded Internal Dynamics via a PoincarÉ Map Approach , 2007, IEEE Transactions on Automatic Control.

[15]  C. Ascher,et al.  Adaptive path planning for VTOL-UAVs , 2009, IEEE Aerospace and Electronic Systems Magazine.

[16]  João Borges de Sousa,et al.  Receding horizon flight control for trajectory tracking of autonomous aerial vehicles , 2013 .

[17]  Andrew D Zeitlin,et al.  Sense & Avoid capability development challenges , 2010, IEEE Aerospace and Electronic Systems Magazine.

[18]  F. Borrelli,et al.  MILP and NLP Techniques for centralized trajectory planning of multiple unmanned air vehicles , 2006, 2006 American Control Conference.

[19]  Sanjiv Singh,et al.  Prototype Sense-and-Avoid System for UAVs , 2009 .

[20]  K. W. Lo,et al.  Aircraft flight parameter estimation using acoustic multipath delays , 2003 .

[21]  J. Betts.  Survey of Numerical Methods for Trajectory Optimization , 1998 .

[22]  Kai-Yuan Cai,et al.  Tracking control for a velocity-sensorless VTOL aircraft with delayed outputs , 2009, Autom..

[23]  Takeshi Yamasaki,et al.  Separate-Channel Integrated Guidance and Autopilot for Automatic Path-Following , 2013 .

[24]  Nobuhiro Yokoyama,et al.  Path Generation Algorithm for Turbulence Avoidance Using Real-Time Optimization , 2013 .

[25]  LinLin Shen,et al.  Cooperative and Geometric Learning Algorithm (CGLA) for path planning of UAVs with limited information , 2014, Autom..

[26]  Tae Soo No,et al.  Control and simulation of arbitrary flight trajectory-tracking , 2005 .

[27]  Yi Lin,et al.  Mini-UAV-Borne LIDAR for Fine-Scale Mapping , 2011, IEEE Geoscience and Remote Sensing Letters.

[28]  Weiyi Liu,et al.  Probabilistic Trajectory Prediction and Conflict Detection for Air Traffic Control , 2011 .

[29]  Nikhil Nigam,et al.  Control of Multiple UAVs for Persistent Surveillance: Algorithm and Flight Test Results , 2012, IEEE Transactions on Control Systems Technology.

[30]  Petter Ögren,et al.  Minimizing Mission Risk in Fuel-Constrained Unmanned Aerial Vehicle Path Planning , 2008 .

[31]  Y. Volkan Pehlivanoglu,et al.  A new vibrational genetic algorithm enhanced with a Voronoi diagram for path planning of autonomous UAV , 2012 .

[32]  Jonathan P. How,et al.  Performance and Lyapunov Stability of a Nonlinear Path Following Guidance Method , 2007 .

[33]  Darius Burschka,et al.  Toward a Fully Autonomous UAV: Research Platform for Indoor and Outdoor Urban Search and Rescue , 2012, IEEE Robotics & Automation Magazine.

[34]  Joseph Z. Ben-Asher,et al.  Near-Optimal Horizontal Trajectories for Autonomous Air Vehicles , 1997 .

[35]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[36]  Kimon P. Valavanis,et al.  On unmanned aircraft systems issues, challenges and operational restrictions preventing integration into the National Airspace System , 2008 .

[37]  Rogelio Lozano,et al.  Predictor-based Position Control of a Quad-rotor with Delays in GPS and Vision Measurements , 2013, J. Intell. Robotic Syst..

[38]  Tarak Gandhi,et al.  Detection of obstacles in the flight path of an aircraft , 2003 .

[39]  Antonios Tsourdos,et al.  Multiple Threats Sense and Avoid Algorithm for Static and Dynamic Obstacles , 2015, J. Intell. Robotic Syst..

[40]  Mykel J. Kochenderfer,et al.  Collision avoidance for general aviation , 2011, IEEE Aerospace and Electronic Systems Magazine.

[41]  Youmin Zhang,et al.  Flatness-Based Trajectory Planning/Replanning for a Quadrotor Unmanned Aerial Vehicle , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[42]  M. Shanmugavel,et al.  Cooperative Path Planning of Unmanned Aerial Vehicles , 2010 .

[43]  Guray Yilmaz,et al.  Establishing Obstacle and Collision Free Communication Relay for UAVs with Artificial Potential Fields , 2012, Journal of Intelligent & Robotic Systems.

[44]  Emilio Frazzoli,et al.  Real-Time Motion Planning for Agile Autonomous Vehicles , 2000 .

[45]  E. Valovage,et al.  Enhanced ADS-B Research , 2006, 2006 ieee/aiaa 25TH Digital Avionics Systems Conference.

[46]  Craig A. Woolsey,et al.  Minimum-Time Path Planning for Unmanned Aerial Vehicles in Steady Uniform Winds , 2009 .

[47]  Huili Yu,et al.  Vision-based Navigation Frame Mapping and Planning for Collision Avoidance for Miniature Air Vehicles , 2010 .

[48]  Panagiotis Tsiotras,et al.  On-Line Path Generation for Unmanned Aerial Vehicles Using B-Spline Path Templates , 2008 .

[49]  Liang Tang,et al.  From mission planning to flight control of unmanned aerial vehicles: Strategies and implementation tools , 2005, Annu. Rev. Control..

[50]  Alison Eele,et al.  Path Planning with Avoidance Using Nonlinear Branch-and-Bound , 2007 .

[51]  Narendra Ahuja,et al.  An analytically tractable potential field model of free space and its application in obstacle avoidance , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[52]  Michael A. Goodrich,et al.  Hierarchical Heuristic Search Using a Gaussian Mixture Model for UAV Coverage Planning , 2014, IEEE Transactions on Cybernetics.

[53]  P. B. Sujit,et al.  Unmanned Aerial Vehicle Path Following: A Survey and Analysis of Algorithms for Fixed-Wing Unmanned Aerial Vehicless , 2014, IEEE Control Systems.

[54]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[55]  P. Tsiotras,et al.  Trajectory Optimization Using Multiresolution Techniques , 2008 .

[56]  K. Subbarao,et al.  Hybrid Genetic Algorithm Collocation Method for Trajectory Optimization , 2009 .

[57]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[58]  David J. N. Limebeer,et al.  Optimal Trajectory Regulation for Radar Imaging Guidance , 2008 .

[59]  Timothy W. McLain,et al.  Decentralized Cooperative Aerial Surveillance Using Fixed-Wing Miniature UAVs , 2006, Proceedings of the IEEE.

[60]  J. Vian,et al.  Trajectory Optimization with Risk Minimization for Military Aircraft , 1987 .

[61]  M. Pachter,et al.  Optimal Cooperative Sensing using a Team of UAVs , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[62]  S. Gutman,et al.  Linear Quadratic Integrated Versus Separated Autopilot-Guidance Design , 2013 .

[63]  Zhong-Ping Jiang,et al.  On global tracking control of a VTOL aircraft without velocity measurements , 2003, IEEE Trans. Autom. Control..

[64]  Mark P. DeAngelo,et al.  Neural Network-Based Trajectory Optimization for Unmanned Aerial Vehicles , 2012 .

[65]  George J. Vachtsevanos,et al.  Handbook of Unmanned Aerial Vehicles , 2014 .

[66]  Arko Lucieer,et al.  Evaluating Tree Detection and Segmentation Routines on Very High Resolution UAV LiDAR Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[68]  Zhaodan Kong,et al.  A Survey of Motion Planning Algorithms from the Perspective of Autonomous UAV Guidance , 2010, J. Intell. Robotic Syst..

[69]  Bérénice Mettler,et al.  Control system design and evaluation for robust autonomous rotorcraft guidance , 2013 .

[70]  Vijay Kumar,et al.  Cooperative air and ground surveillance , 2006, IEEE Robotics & Automation Magazine.

[71]  Anthony Finn,et al.  Acoustic sense & avoid for UAV's , 2011, 2011 Seventh International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[72]  Warren E. Dixon,et al.  Decentralized formation control with connectivity maintenance and collision avoidance under limited and intermittent sensing , 2013, 2014 American Control Conference.

[73]  Naira Hovakimyan,et al.  Path Following for Unmanned Aerial Vehicles Using L1 Adaptive Augmentation of Commercial Autopilots , 2010 .

[74]  Lorenz T. Biegler,et al.  Dynamic Optimization Strategies for Three-Dimensional Conflict Resolution of Multiple Aircraft , 2004 .

[75]  Brian G. Ferguson,et al.  Broadband passive acoustic technique for target motion parameter estimation , 2000, IEEE Trans. Aerosp. Electron. Syst..

[76]  Panagiotis Tsiotras,et al.  Time-Optimal Path Following for Fixed-Wing Aircraft , 2013 .

[77]  Kemal Leblebicioglu,et al.  Path Planning for UAVs for Maximum Information Collection , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[78]  Peter Willett,et al.  Design of an Adaptive Passive Collision Warning System for UAVs , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[79]  Daniel E. Hastings,et al.  A Logical Approach to Real Options Identification With Application to UAV Systems , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[80]  Matthew J. Rutherford,et al.  Radar-based detection and identification for miniature air vehicles , 2011, 2011 IEEE International Conference on Control Applications (CCA).

[81]  T.A. Mazzuchi,et al.  Addressing uncertainty in UAV navigation decision-making , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[82]  Kuo-Chu Chang,et al.  UAV Path Planning with Tangent-plus-Lyapunov Vector Field Guidance and Obstacle Avoidance , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[83]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[84]  Plamen Angelov.  Sense and Avoid in UAS : Research and Applications , 2012 .

[85]  Sion Jennings,et al.  Flight test evaluation of a prototype optical instrument for airborne sense-and-avoid applications , 2012, Defense, Security, and Sensing.

[86]  YangQuan Chen,et al.  Low-cost UAV-based thermal infrared remote sensing: Platform, calibration and applications , 2010, Proceedings of 2010 IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications.

[87]  John Lygeros,et al.  A probabilistic approach to aircraft conflict detection , 2000, IEEE Trans. Intell. Transp. Syst..

[88]  Wright Patterson,et al.  SENSE AND AVOID, PHASE I (MAN-IN-THE-LOOP) ADVANDED TECHNOLOGY DEMONSTRATION , 2005 .

[89]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[90]  James K. Kuchar,et al.  A review of conflict detection and resolution modeling methods , 2000, IEEE Trans. Intell. Transp. Syst..

[91]  Mingyue Ding,et al.  Phase Angle-Encoded and Quantum-Behaved Particle Swarm Optimization Applied to Three-Dimensional Route Planning for UAV , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[92]  Douglas Marshall,et al.  Introduction to Unmanned Aircraft Systems , 2011 .

[93]  Duncan A. Campbell,et al.  Unmanning UAVs: Addressing challenges in on-board planning and decision making , 2008 .

[94]  Hok K. Ng,et al.  Aircraft Trajectory Optimization and Contrails Avoidance in the Presence of Winds , 2011 .

[95]  Inseok Hwang,et al.  Multiple-Target Tracking and Identity Management with Application to Aircraft Tracking , 2007 .

[96]  J. Hedrick,et al.  Optimal Path Planning with a Kinematic Airplane Model , 2007 .

[97]  Yiyuan Zhao,et al.  Trajectory Planning for Autonomous Aerospace Vehicles amid Known Obstacles and Conflicts , 2004 .

[98]  Inseok Hwang,et al.  Distributed Multitarget Tracking and Identity Management , 2008 .

[99]  Rita Cunha,et al.  A nonlinear quadrotor trajectory tracking controller with disturbance rejection , 2014 .

[100]  Sophie Lentilhac.  UAV Flight plan optimzed for sensor requirements , 2009, 2009 International Radar Conference "Surveillance for a Safer World" (RADAR 2009).

[101]  Randal W. Beard,et al.  Fixed Wing UAV Path Following in Wind With Input Constraints , 2014, IEEE Transactions on Control Systems Technology.

[102]  Haibin Duan,et al.  Chaotic predator–prey biogeography-based optimization approach for UCAV path planning , 2014 .

[103]  Youmin Zhang,et al.  Trajectory Planning and Replanning Strategies Applied to a Quadrotor Unmanned Aerial Vehicle , 2012 .

[104]  Mario Innocenti,et al.  Guidance of Unmanned Air Vehicles Based on Fuzzy Sets and Fixed Waypoints , 2004 .

[105]  Wen-Qin Wang,et al.  Waveform-Diversity-Based Millimeter-Wave UAV SAR Remote Sensing , 2009, IEEE Trans. Geosci. Remote. Sens..

[106]  B.C. Karhoff,et al.  Eyes in the Domestic Sky: An Assessment of Sense and Avoid Technology for the Army's "Warrior" Unmanned Aerial Vehicle , 2006, 2006 IEEE Systems and Information Engineering Design Symposium.

[107]  Alexander L. Fradkov,et al.  Combined adaptive controller for UAV guidance , 2003, 2003 European Control Conference (ECC).

[108]  B. L. Pierson,et al.  Minimum-fuel aircraft transition trajectories , 1989 .

[109]  J. Karl Hedrick,et al.  Autonomous UAV path planning and estimation , 2009, IEEE Robotics & Automation Magazine.

[110]  B. Bethke,et al.  Group health management of UAV teams with applications to persistent surveillance , 2008, 2008 American Control Conference.

[111]  Pierre Feyzeau,et al.  Path planning: A 2013 survey , 2013, Proceedings of 2013 International Conference on Industrial Engineering and Systems Management (IESM).

[112]  B. Conway,et al.  Numerical Trajectory Optimization with Swarm Intelligence and Dynamic Assignment of Solution Structure , 2012 .

[113]  Karl J. Obermeyer,et al.  Robust probabilistic conflict prediction for sense and avoid , 2014, 2014 American Control Conference.

[114]  Naira Hovakimyan,et al.  Design and Analysis of a Novel ${\cal L}_1$ Adaptive Control Architecture With Guaranteed Transient Performance , 2008, IEEE Transactions on Automatic Control.

[115]  Brian R. Geiger,et al.  Flight Testing a Real-Time Direct Collocation Path Planner , 2008 .

[116]  Richard G. Cobb,et al.  Multiple Method 2-D Trajectory Optimization Satisfying Waypoints and No-Fly Zone Constraints , 2008 .

[117]  Fang Liu,et al.  Chaotic artificial bee colony approach to Uninhabited Combat Air Vehicle (UCAV) path planning , 2010 .

[118]  Guilherme V. Raffo,et al.  Path Tracking of a UAV via an Underactuated H∞ Control Strategy , 2011, Eur. J. Control.

[119]  A.D. Zeitlin,et al.  Safety of Cooperative Collision Avoidance for Unmanned Aircraft , 2006, 2006 ieee/aiaa 25TH Digital Avionics Systems Conference.

[120]  Ran Dai,et al.  Path Planning and State Estimation for Unmanned Aerial Vehicles in Hostile Environments , 2010 .

[121]  Debasish Ghose,et al.  Radar-assisted collision avoidance/guidance strategy for planar flight , 2001 .

[122]  Liam Paull,et al.  Sensor-Driven Area Coverage for an Autonomous Fixed-Wing Unmanned Aerial Vehicle , 2014, IEEE Transactions on Cybernetics.

[123]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[124]  Y. Ochi,et al.  Path Planning Algorithms for Skid-to-Turn Unmanned Aerial Vehicles , 2009 .

[125]  G. Sadowy,et al.  UAVSAR: New NASA Airborne SAR System for Research , 2007, IEEE Aerospace and Electronic Systems Magazine.

[126]  Ioannis K. Nikolos,et al.  Path Planning for Cooperating Unmanned Vehicles over 3-D Terrain , 2009 .

[127]  Jur P. van den Berg,et al.  Automatic collision avoidance for manually tele-operated unmanned aerial vehicles , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[128]  Youmin Zhang,et al.  Bibliographical review on reconfigurable fault-tolerant control systems , 2003, Annu. Rev. Control..

[129]  Carlos Silvestre,et al.  Trajectory Tracking for Autonomous Vehicles: An Integrated Approach to Guidance and Control , 1998 .

[130]  L. Rodrigues,et al.  Preliminary results on UAV path following using piecewise-affine control , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[131]  Seid H. Pourtakdoust,et al.  Optimal maneuver-based motion planning over terrain and threats using a dynamic hybrid PSO algorithm , 2013 .

[132]  João P. Hespanha,et al.  Trajectory-Tracking and Path-Following of Underactuated Autonomous Vehicles With Parametric Modeling Uncertainty , 2007, IEEE Transactions on Automatic Control.

[133]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[134]  Xavier Prats,et al.  Requirements, Issues, and Challenges for Sense and Avoid in Unmanned Aircraft Systems , 2012 .

[135]  P. Goulart,et al.  Trajectory Generation for Aircraft Avoidance Maneuvers Using Online Optimization , 2011 .

[136]  Mykel J. Kochenderfer,et al.  Electro-Optical System Analysis for Sense and Avoid , 2008 .

[137]  Ian Postlethwaite,et al.  A Probabilistically Robust Path Planning Algorithm for UAVs Using Rapidly-Exploring Random Trees , 2013, J. Intell. Robotic Syst..

[138]  H. Erzberger,et al.  OPTIMUM HORIZONTAL GUIDANCE TECHNIQUES FOR AIRCRAFT , 1971 .

[139]  Michael P. Owen,et al.  Unmanned aircraft sense and avoid radar: Surrogate flight testing performance evaluation , 2014, 2014 IEEE Radar Conference.

[140]  Hyondong Oh,et al.  Decentralised Standoff Tracking of Moving Targets Using Adaptive Sliding Mode Control for UAVs , 2014, J. Intell. Robotic Syst..

[141]  S. Darbha,et al.  Sampling-Based Path Planning for a Visual Reconnaissance Unmanned Air Vehicle , 2012 .

[142]  Timothy W. McLain,et al.  Vector Field Path Following for Miniature Air Vehicles , 2007, IEEE Transactions on Robotics.

[143]  Lei Yang,et al.  A Robust Motion Compensation Approach for UAV SAR Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[144]  Kai Virtanen,et al.  Automated Generation of Realistic Near-Optimal Aircraft Trajectories , 2008 .

[145]  S. LaValle.  Rapidly-exploring random trees : a new tool for path planning , 1998 .

[146]  Mingyue Ding,et al.  Route Planning for Unmanned Aerial Vehicle (UAV) on the Sea Using Hybrid Differential Evolution and Quantum-Behaved Particle Swarm Optimization , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[147]  Giancarmine Fasano,et al.  Morphological filtering and target tracking for vision-based UAS sense and avoid , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[148]  P. Williams.  Hermite-Legendre-Gauss-Lobatto Direct Transcription in Trajectory Optimization , 2009 .

[149]  Ian Postlethwaite,et al.  Real-time path planning with limited information for autonomous unmanned air vehicles , 2008, Autom..

[150]  Michael B. Bragg,et al.  Fuel-Optimal Trajectory Generation for Persistent Contrail Mitigation , 2013 .

[151]  Tor Arne Johansen,et al.  UAVs Trajectory Planning by Distributed MPC under Radio Communication Path Loss Constraints , 2015, J. Intell. Robotic Syst..

[152]  B.D. Rigling,et al.  Low-Cost Acoustic Array for Small UAV Detection and Tracking , 2008, 2008 IEEE National Aerospace and Electronics Conference.

[153]  Jonathan P. How,et al.  Increasing autonomy of UAVs , 2009, IEEE Robotics & Automation Magazine.

[154]  J. W. Burrows.  Fuel-optimal aircraft trajectories with fixed arrival times , 1981 .

[155]  Luca Consolini,et al.  Path following for the PVTOL aircraft , 2010, Autom..

[156]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[157]  Jay Gundlach,et al.  Designing Unmanned Aircraft Systems: A Comprehensive Approach , 2011 .

[158]  Jacques Periaux,et al.  Genetic Algorithms in Engineering and Computer Science , 1996 .