Real-time landing place assessment in man-made environments

We propose a novel approach to the real-time landing site detection and assessment in unconstrained man-made environments using passive sensors. Because this task must be performed in a few seconds or less, existing methods are often limited to simple local intensity and edge variation cues. By contrast, we show how to efficiently take into account the potential sites’ global shape, which is a critical cue in man-made scenes. Our method relies on a new segmentation algorithm and shape regularity measure to look for polygonal regions in video sequences. In this way, we enforce both temporal consistency and geometric regularity, resulting in very reliable and consistent detections. We demonstrate our approach for the detection of landable sites such as rural fields, building rooftops and runways from color and infrared monocular sequences significantly outperforming the state-of-the-art.

[1]  Riad I. Hammoud,et al.  Augmented Vision Perception in Infrared: Algorithms and Applied Systems , 2009 .

[2]  Max Donath,et al.  American Control Conference , 1993 .

[3]  A. Wolf,et al.  Passive imaging based hazard avoidance for spacecraft safe landing , 2001 .

[4]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[6]  Navid Serrano,et al.  Integrated Sensing for Entry, Descent, and Landing of a Robotic Spacecraft , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[7]  Luc Vincent,et al.  Local Grayscale Granulometries Based on Opening Trees , 1996, ISMM.

[8]  Andrew E. Johnson,et al.  Analysis of flash lidar field test data for safe lunar landing , 2010, 2010 IEEE Aerospace Conference.

[9]  Gary Whitten,et al.  Machine Vision Techniques for Planetary Terminal Descent Hazard Avoidance and Landmark Tracking , 1991, 1991 American Control Conference.

[10]  Andrew E. Johnson,et al.  Lidar-Based Hazard Avoidance for Safe Landing on Mars , 2002 .

[11]  A. Vizireanu,et al.  The skeleton structure—An improved compression algorithm with perfect reconstruction , 2001, Journal of Digital Imaging.

[12]  Zia-ur Rahman,et al.  Robust edge-detection algorithm for runway edge detection , 2008, Electronic Imaging.

[13]  Henk J. A. M. Heijmans,et al.  Theoretical Aspects of Gray-Level Morphology , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. McDermott,et al.  Rule-Based Interpretation of Aerial Imagery , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Homer Pien,et al.  Autonomous Hazard Detection and avoidance for Mars exploration , 1991 .

[16]  M. Couprie,et al.  Topological Grayscale Watershed Transformation , 1997 .

[17]  William A. Hoff,et al.  Planetary terminal descent hazard avoidance using optical flow , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[18]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[19]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[20]  Gilles Bertrand,et al.  Topological gray-scale watershed transformation , 1997, Optics & Photonics.

[21]  Pascal Fua,et al.  Automatic Extraction of Generic House Roofs from High Resolution Aerial Imagery , 1996, ECCV.

[22]  John I. Goutsias,et al.  Mathematical Morphology and its Applications to Image and Signal Processing , 2000, Computational Imaging and Vision.

[23]  S. Shankar Sastry,et al.  Multiple view motion estimation and control for landing an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  O DudaRichard,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972 .

[25]  Homer Pien,et al.  Autonomous hazard detection and avoidance , 1992 .

[26]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[27]  Ramakant Nevatia,et al.  Detecting runways in complex airport scenes , 1990, Comput. Vis. Graph. Image Process..

[28]  Nick Barnes,et al.  The regular polygon detector , 2010, Pattern Recognit..

[29]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[30]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[31]  Rida M. Hamza,et al.  Runway Positioning and Moving Object Detection Prior to Landing , 2009 .

[32]  Sebastian Scherer,et al.  First results in autonomous landing and obstacle avoidance by a full-scale helicopter , 2012, 2012 IEEE International Conference on Robotics and Automation.

[33]  S. Shankar Sastry,et al.  Autonomous Vision-based Landing and Terrain Mapping Using an MPC-controlled Unmanned Rotorcraft , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[34]  Cláudio Rosito Jung,et al.  Rectangle detection based on a windowed Hough transform , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[35]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[36]  Yili Fu,et al.  Airfield Runway Detection from Synthetic Aperture Radar Image , 2008, 2008 Congress on Image and Signal Processing.

[37]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Peter Meer,et al.  Synergism in low level vision , 2002, Object recognition supported by user interaction for service robots.

[39]  Xiaojin Gong,et al.  A Survey of Techniques for Detection and Tracking of Airport Runways , 2006 .

[40]  Michel Couprie,et al.  Building the Component Tree in Quasi-Linear Time , 2006, IEEE Transactions on Image Processing.

[41]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[42]  Philippe Salembier,et al.  Antiextensive connected operators for image and sequence processing , 1998, IEEE Trans. Image Process..

[43]  Edward J. Coyle,et al.  Stack filters , 1986, IEEE Trans. Acoust. Speech Signal Process..

[44]  Marc D. Takahashi,et al.  Evaluation of Safe Landing Area Determination Algorithms for Autonomous Rotorcraft Using Site Benchmarking , 2011 .

[45]  Horst Bischof,et al.  3D Segmentation by Maximally Stable Volumes (MSVs) , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[46]  Larry H. Matthies,et al.  Stereo vision and shadow analysis for landing hazard detection , 2008, 2008 IEEE International Conference on Robotics and Automation.

[47]  V. Fernão Pires,et al.  Autonomous Landing of an Unmanned Aerial Vehicle , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[48]  K. Ramesh Babu,et al.  Linear Feature Extraction and Description , 1979, IJCAI.

[49]  Y Wang,et al.  Real time method for airport runway detection in aerial images (EI CONFERENCE) , 2008 .

[50]  H. Seraji,et al.  A novel tiered sensor fusion approach for terrain characterization and safe landing assessment , 2006, 2006 IEEE Aerospace Conference.

[51]  Mark B. Tischler,et al.  Precision Autonomous Landing Adaptive Control Experiment (PALACE) , 2006 .

[52]  Kenneth E. Barner,et al.  C-stack filters , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[53]  Radu Mihnea Udrea,et al.  Iterative generalization of morphological skeleton , 2007, J. Electronic Imaging.

[54]  Roland Brockers,et al.  Autonomous landing and ingress of micro-air-vehicles in urban environments based on monocular vision , 2011, Defense + Commercial Sensing.

[55]  Daniel L. Fitzgerald,et al.  Landing site selection for UAV forced landings using machine vision , 2007 .

[56]  Simon Lacroix,et al.  Autonomous Detection of Safe Landing Areas for an UAV from Monocular Images , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[57]  Augusto Caramagno,et al.  Design and Performance Assessment of Hazard Avoidance Techniques For Vision Based Landing , 2006 .

[58]  Yang Cheng,et al.  Passive imaging based multi-cue hazard detection for spacecraft safe landing , 2006, 2006 IEEE Aerospace Conference.

[59]  Ronald Jones,et al.  Connected Filtering and Segmentation Using Component Trees , 1999, Comput. Vis. Image Underst..

[60]  Pascal Fua,et al.  An optimization framework for feature extraction , 1991, Machine Vision and Applications.

[61]  H. Seraji,et al.  A fuzzy rule-based safety index for landing site risk assessment , 2002, Proceedings of the 5th Biannual World Automation Congress.

[62]  Zhongke Shi,et al.  Vision-based Runway Recognition for UAV Autonomous Landing , 2007 .