Relative navigation approach for vision-based aerial GPS-denied navigation

GPS-denied aerial flight is a popular research topic. The problem is challenging and requires knowledge of complex elements from many distinct disciplines. Additionally, aerial vehicles can present challenging constraints such as stringent payload limitations and fast vehicle dynamics. In this paper we propose a new architecture to simplify some of the challenges that constrain GPS-denied aerial flight. At the core, the approach combines visual graph-SLAM with a multiplicative extended Kalman filter. More importantly, for the front end we depart from the common practice of estimating global states and instead keep the position and yaw states of the MEKF relative to the current node in the map. This relative navigation approach provides simple application of sensor measurement updates, intuitive definition of map edges and covariances, and the flexibility of using a globally consistent map when desired. We verify the approach with hardware flight-test results.

[1]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[4]  Robert C. Leishman,et al.  A Vision-Based Relative Navigation Approach for Autonomous Multirotor Aircraft , 2013 .

[5]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[6]  Jonathan P. How,et al.  Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Timothy W. McLain,et al.  Relative navigation and control of a hexacopter , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.

[10]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Abraham Bachrach,et al.  Autonomous flight in unstructured and unknown indoor environments , 2009 .

[13]  Randal W. Beard,et al.  Efficient estimation for autonomous multi-rotor helicopters operating in unknown, indoor environments , 2012 .

[14]  Timothy W. McLain,et al.  Quadrotors and Accelerometers: State Estimation with an Improved Dynamic Model , 2014, IEEE Control Systems.

[15]  Glenn P. Tournier,et al.  Estimation and Control of a Quadrotor Vehicle Using Monocular Vision and Moire Patterns , 2006 .

[16]  Timothy W. McLain,et al.  Differential flatness based control of a rotorcraft for aggressive maneuvers , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[18]  Vincent Lepetit,et al.  View-based Maps , 2010, Int. J. Robotics Res..

[19]  Timothy W. McLain,et al.  Robust Motion Estimation with RGB-D Cameras , 2013 .

[20]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[21]  Rogelio Lozano,et al.  Combining Stereo Vision and Inertial Navigation System for a Quad-Rotor UAV , 2011, J. Intell. Robotic Syst..

[22]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[23]  Timothy W. McLain,et al.  Analysis of an Improved IMU-Based Observer for Multirotor Helicopters , 2014, J. Intell. Robotic Syst..

[24]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[25]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Timothy W. McLain,et al.  Multiplicative Extended Kalman Filter for Relative Rotorcraft Navigation , 2015, J. Aerosp. Inf. Syst..

[27]  Albert S. Huang,et al.  Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera , 2011, ISRR.

[28]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[29]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Benjamin Kuipers,et al.  A Robust, Qualitative Method for Robot Spatial Learning , 1988, AAAI.

[31]  Roland Siegwart,et al.  Delay and Dropout Tolerant State Estimation for MAVs , 2010, ISER.

[32]  Darius Burschka,et al.  Toward a Fully Autonomous UAV: Research Platform for Indoor and Outdoor Urban Search and Rescue , 2012, IEEE Robotics & Automation Magazine.

[33]  J. Kuipers Quaternions and Rotation Sequences , 1998 .

[34]  Denys Bohdanov,et al.  Vision-based Quadrotor Micro-UAV Position and Yaw Estimation and Control , 2012 .

[35]  Ian D. Reid,et al.  Planes, trains and automobiles — autonomy for the modern robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[36]  Roland Siegwart,et al.  Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[37]  Camillo J. Taylor,et al.  Control of a Quadrotor Helicopter Using Dual Camera Visual Feedback , 2005, Int. J. Robotics Res..

[38]  Marc Pollefeys,et al.  PIXHAWK: A system for autonomous flight using onboard computer vision , 2011, 2011 IEEE International Conference on Robotics and Automation.