A low-cost solution for unmanned aerial vehicle navigation in a global positioning system–denied environment

The ability of an autonomous unmanned aerial vehicle to navigate and fly precisely determines its utility and performance. The current navigation systems are highly dependent on the global positioning system and are prone to error because of global positioning system signal outages. However, advancements in onboard processing have enabled inertial navigation algorithms to perform well during short global positioning system outages. In this article, we propose an intelligent optical flow–based algorithm combined with Kalman filters to provide the navigation capability during global positioning system outages and global positioning system–denied environments. Traditional optical flow measurement uses block matching for motion vector calculation that makes the measurement task computationally expensive and slow. We propose the application of an artificial bee colony–based block matching technique for faster optical flow measurements. To effectively fuse optical flow data with inertial sensors output, we employ a modified form of extended Kalman filter. The modifications make the filter less noisy by utilizing the redundancy of sensors. We have achieved an accuracy of ~95% for all non-global positioning system navigation during our simulation studies. Our real-world experiments are in agreement with the simulation studies when effects of wind are taken into consideration.

[1]  Zairi Ismael Rizman,et al.  COMPARISON BETWEEN BINARY PARTICLES SWARM OPTIMIZATION (BPSO) AND BINARY ARTIFICIAL BEE COLONY (BABC) FOR NONLINEAR AUTOREGRESSIVE MODEL STRUCTURE SELECTION OF CHAOTIC DATA , 2018 .

[2]  Kristi Morgansen,et al.  Monocular distance estimation from optic flow during active landing maneuvers , 2014, Bioinspiration & biomimetics.

[3]  Hyun Myung,et al.  Calibration of the drift error in GPS using optical flow and fixed reference station , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[4]  Timothy W. McLain,et al.  Relative Navigation Approach for Vision-Based Aerial GPS-Denied Navigation , 2013, Journal of Intelligent & Robotic Systems.

[5]  Peng Wang,et al.  An ultrasonic positioning algorithm based on maximum correntropy criterion extended Kalman filter weighted centroid , 2018, Signal Image Video Process..

[6]  Karim Salahshoor,et al.  Centralized and decentralized process and sensor fault monitoring using data fusion based on adaptive extended Kalman filter algorithm , 2008 .

[7]  Jae-Bok Song,et al.  Monocular Vision-Based SLAM in Indoor Environment Using Corner, Lamp, and Door Features From Upward-Looking Camera , 2011, IEEE Transactions on Industrial Electronics.

[8]  James B. Rawlings,et al.  Critical Evaluation of Extended Kalman Filtering and Moving-Horizon Estimation , 2005 .

[9]  Benjamin Grocholsky,et al.  Outdoor Downward-Facing Optical Flow Odometry with Commodity Sensors , 2009, FSR.

[10]  R. Lozano,et al.  GPS/INS/optic flow data fusion for position and Velocity estimation , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[11]  Sven Lange,et al.  A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments , 2009, 2009 International Conference on Advanced Robotics.

[12]  Jay H. Lee,et al.  Extended Kalman Filter Based Nonlinear Model Predictive Control , 1993, 1993 American Control Conference.

[13]  Robert E. Mahony,et al.  Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow , 2012, IEEE Transactions on Robotics.

[14]  Omur Aydogmus,et al.  A comparison of artificial neural network and extended Kalman filter based sensorless speed estimation , 2015 .

[15]  Gabriel A. Terejanu,et al.  Extended Kalman Filter Tutorial , 2009 .

[16]  Federico Tombari,et al.  Performance Evaluation of Full Search Equivalent Pattern Matching Algorithms , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Y. Elhalwagy,et al.  Integrated MEMS-Based IMU/GPS navigation system for motion dynamical vehicles , 2008 .

[18]  Sergio Montenegro,et al.  An Autonomous UAV with an Optical Flow Sensor for Positioning and Navigation , 2013 .

[19]  Javaan Chahl,et al.  Axially displaced optical flow sensors for feasuring and controlling the landing height of a UAV , 2013 .

[20]  Matthew Rhudy,et al.  Wide-field optical flow aided inertial navigation for unmanned aerial vehicles , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[22]  Pinar Civicioglu,et al.  A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms , 2013, Artificial Intelligence Review.

[23]  Emanuele Frontoni,et al.  A Vision-Based Guidance System for UAV Navigation and Safe Landing using Natural Landmarks , 2010, J. Intell. Robotic Syst..

[24]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[25]  Jinling Wang,et al.  Evaluating the Performances of Adaptive Kalman Filter Methods in GPS/INS Integration , 2010 .

[26]  Jin-Woo Lee,et al.  Simulation and Flight Test of Autonomous Aircraft Estimation, Planning, and Control Algorithms , 2007 .

[27]  Jianhua Lu,et al.  A simple and efficient search algorithm for block-matching motion estimation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[28]  R. Rajkumar,et al.  A Comparison of Artificial Bee Colony algorithm and Genetic Algorithm to Minimize the Makespan for Job Shop Scheduling , 2014 .

[29]  D. Simon Kalman filtering with state constraints: a survey of linear and nonlinear algorithms , 2010 .

[30]  Matthew Garratt,et al.  Adding Optical Flow into the GPS/INS Integration for UAV navigation , 2009 .

[31]  Hassen Fourati,et al.  Fast Complementary Filter for Attitude Estimation Using Low-Cost MARG Sensors , 2016, IEEE Sensors Journal.

[32]  Paul Newman,et al.  Outdoor SLAM using visual appearance and laser ranging , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[33]  Marc Pollefeys,et al.  An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[34]  William D. Nothwang,et al.  Computing Optic Flow with ArduEye Vision Sensor , 2013 .

[35]  Yu Gu,et al.  A survey of optical flow techniques for UAV navigation applications , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[36]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[38]  Sungshin Kim,et al.  An accurate localization for mobile robot using extended Kalman filter and sensor fusion , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[39]  Konrad Reif,et al.  Stochastic stability of the discrete-time extended Kalman filter , 1999, IEEE Trans. Autom. Control..

[40]  J. M. Lewis,et al.  Dynamic Data Assimilation: A Least Squares Approach , 2006 .

[41]  Anton J. Haug The Analytical Linearization Class of Kalman Filters: The Extended Kalman Filter , 2012 .

[42]  Paul Y. Oh,et al.  Optic-Flow-Based Collision Avoidance , 2008, IEEE Robotics & Automation Magazine.

[43]  G Balamurugan,et al.  Survey on UAV navigation in GPS denied environments , 2016, 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES).

[44]  Marcello R. Napolitano,et al.  A Survey of Optical Flow Techniques for Robotics Navigation Applications , 2014, J. Intell. Robotic Syst..

[45]  Jang Gyu Lee,et al.  Adaptive Two-Stage Extended Kalman Filter for a Fault-Tolerant INS-GPS Loosely Coupled System , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[46]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[47]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[48]  Marc Pollefeys,et al.  PIXHAWK: A system for autonomous flight using onboard computer vision , 2011, 2011 IEEE International Conference on Robotics and Automation.

[49]  Jinling Wang,et al.  Integrated GPS/INS navigation system with dual-rate Kalman Filter , 2012, GPS Solutions.

[50]  J K Stolaroff,et al.  The Need for a Life Cycle Assessment of Drone-Based Commercial Package Delivery , 2014 .

[51]  Hyochoong Bang,et al.  Visual Target Tracking and Relative Navigation for Unmanned Aerial Vehicles in a GPS-Denied Environment , 2014 .

[52]  Aníbal Ollero,et al.  Vision-Based Odometry and SLAM for Medium and High Altitude Flying UAVs , 2009, J. Intell. Robotic Syst..