Fast online learning and detection of natural landmarks for autonomous aerial robots

We present a method for efficiently detecting natural landmarks that can handle scenes with highly repetitive patterns and targets progressively changing its appearance. At the core of our approach lies a Random Ferns classifier, that models the posterior probabilities of different views of the target using multiple and independent Ferns, each containing features at particular positions of the target. A Shannon entropy measure is used to pick the most informative locations of these features. This minimizes the number of Ferns while maximizing its discriminative power, allowing thus, for robust detections at low computational costs. In addition, after offline initialization, the new incoming detections are used to update the posterior probabilities on the fly, and adapt to changing appearances that can occur due to the presence of shadows or occluding objects. All these virtues, make the proposed detector appropriate for UAV navigation. Besides the synthetic experiments that will demonstrate the theoretical benefits of our formulation, we will show applications for detecting landing areas in regions with highly repetitive patterns, and specific objects under the presence of cast shadows or sudden camera motions.

[1]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[2]  Francesc Moreno-Noguer,et al.  Fusion of Color and Shape for Object Tracking under Varying Illumination , 2003, IbPRIA.

[3]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[4]  Andreas Zell,et al.  An Onboard Monocular Vision System for Autonomous Takeoff, Hovering and Landing of a Micro Aerial Vehicle , 2013, J. Intell. Robotic Syst..

[5]  Francesc Moreno-Noguer,et al.  Integration of deformable contours and a multiple hypotheses Fisher color model for robust tracking in varying illuminant environments , 2007, Image Vis. Comput..

[6]  Vijay Kumar,et al.  The GRASP Multiple Micro-UAV Testbed , 2010, IEEE Robotics & Automation Magazine.

[7]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[8]  Vincent Lepetit,et al.  Combining Geometric and Appearance Priors for Robust Homography Estimation , 2010, ECCV.

[9]  Vijay Kumar,et al.  Cooperative Grasping and Transport Using Multiple Quadrotors , 2010, DARS.

[10]  Yang Fan,et al.  A Vision-Based Algorithm for Landing Unmanned Aerial Vehicles , 2008, 2008 International Conference on Computer Science and Software Engineering.

[11]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  David Hyunchul Shim,et al.  A vision-based target tracking control system of a quadrotor by using a tablet computer , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[13]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[14]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  P. Campoy,et al.  Visual Model Feature Tracking For UAV Control , 2007, 2007 IEEE International Symposium on Intelligent Signal Processing.

[16]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Rogelio Lozano,et al.  A vision and GPS-based real-time trajectory planning for MAV in unknown urban environments , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[19]  P. Fua,et al.  Pose estimation for category specific multiview object localization , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Roberto Cipolla,et al.  Semantic texton forests for image categorization and segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Vincent Lepetit,et al.  Pose Priors for Simultaneously Solving Alignment and Correspondence , 2008, ECCV.

[22]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Agathoniki Trigoni,et al.  Probabilistic target detection by camera-equipped UAVs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[24]  Emanuele Frontoni,et al.  A Vision-Based Guidance System for UAV Navigation and Safe Landing using Natural Landmarks , 2010, J. Intell. Robotic Syst..

[25]  Francesc Moreno-Noguer,et al.  Online human-assisted learning using Random Ferns , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  Andreas Zell,et al.  A cross-platform comparison of visual marker based approaches for autonomous flight of quadrocopters , 2013 .

[28]  Jose Luis Sanchez-Lopez,et al.  An Approach Toward Visual Autonomous Ship Board Landing of a VTOL UAV , 2013, Journal of Intelligent & Robotic Systems.

[29]  Francesc Moreno-Noguer,et al.  Efficient rotation invariant object detection using boosted Random Ferns , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Francesc Moreno-Noguer,et al.  Bootstrapping Boosted Random Ferns for discriminative and efficient object classification , 2012, Pattern Recognit..

[31]  Vincent Lepetit,et al.  Dominant orientation templates for real-time detection of texture-less objects , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.