Real-time Accurate Runway Detection based on Airborne Multi-sensors Fusion

Existing methods of runway detection are more focused on image processing for remote sensing images based on computer vision techniques. However, these algorithms are too complicated and time-consuming to meet the demand for real-time airborne application. This paper proposes a novel runway detection method based on airborne multi-sensors data fusion which works in a coarse-to-fine hierarchical architecture. At the coarse layer, a vision projection model from world coordinate system to image coordinate system is built by fusing airborne navigation data and forward-looking sensing images, then a runway region of interest (ROI) is extracted from a whole image by the model. Furthermore, EDLines which is a real-time line segments detector is applied to extract straight line segments from ROI at the fine layer, and fragmented line segments generated by EDLines are linked into two long runway lines. Finally, some unique runway features (e.g. vanishing point and runway direction) are used to recognise airport runway. The proposed method is tested on an image dataset provided by a flight simulation system. The experimental results show that the method has advantages in terms of speed, recognition rate and false alarm rate.

[1]  Liming Zhang,et al.  Airport Target Detection in Remote Sensing Images: A New Method Based on Two-Way Saliency , 2015, IEEE Geoscience and Remote Sensing Letters.

[2]  Liu Liu,et al.  Airport detection based on Line Segment Detector , 2012, 2012 International Conference on Computer Vision in Remote Sensing.

[3]  Juyang Weng,et al.  Incremental Hierarchical Discriminant Regression , 2007, IEEE Transactions on Neural Networks.

[4]  Lei Guo,et al.  A coarse-to-fine model for airport detection from remote sensing images using target-oriented visual saliency and CRF , 2015, Neurocomputing.

[5]  Hangyu Wang,et al.  A runway recognition algorithm based on heuristic line extraction , 2011, 2011 International Conference on Image Analysis and Signal Processing.

[6]  O. V. Vygolov,et al.  Enhanced, Synthetic and Combined Vision Technologies for Civil Aviation , 2015 .

[7]  Kay Soon Low,et al.  Real time runway detection in satellite images using multi-channel PCNN , 2014, 2014 9th IEEE Conference on Industrial Electronics and Applications.

[8]  Lawrence Carin,et al.  Airport detection in large aerial optical imagery , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Rafael Grompone von Gioi,et al.  On Straight Line Segment Detection , 2008, Journal of Mathematical Imaging and Vision.

[10]  Cuneyt Akinlar,et al.  Edge Drawing: A combined real-time edge and segment detector , 2012, J. Vis. Commun. Image Represent..

[11]  Ming Zhu,et al.  Adaptive Sliding Mode Relative Motion Control for Autonomous Carrier Landing of Fixed-Wing Unmanned Aerial Vehicles , 2017, IEEE Access.

[12]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[13]  Jianwei Zhang,et al.  An improved template tracking method based on rigid extended object , 2013, Other Conferences.

[14]  S. K. Kashyap,et al.  Detection of Runway and Obstacles using Electro-optical and Infrared Sensors before Landing , 2014 .

[15]  Cuneyt Akinlar,et al.  Edpf: a Real-Time parameter-Free Edge Segment Detector with a False Detection Control , 2012, Int. J. Pattern Recognit. Artif. Intell..

[16]  João Pedro Hespanha,et al.  Local carrier-based precision approach and landing system , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[17]  Xin Li,et al.  Airborne vision-aided landing navigation system for fixed-wing UAV , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[18]  Yakup Genc,et al.  Edge Drawing: A Heuristic Approach to Robust Real-Time Edge Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Xin Wang,et al.  Airport Detection in Remote Sensing Images Based on Visual Attention , 2011, ICONIP.

[20]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Qing Liu,et al.  A Novel Airport Detection Method via Line Segment Classification and Texture Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[22]  B. S. Manjunath,et al.  Modeling and Detection of Geospatial Objects Using Texture Motifs , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[24]  Fei Dai,et al.  Line Segment Grouping and Linking: A Key Step Toward Automated Photogrammetry for Non-Contact Site Surveying , 2015, J. Intell. Robotic Syst..

[25]  Xiaojin Gong,et al.  A Survey of Techniques for Detection and Tracking of Airport Runways , 2006 .

[26]  Cuneyt Akinlar,et al.  Edlines: Real-time line segment detection by Edge Drawing (ed) , 2011, 2011 18th IEEE International Conference on Image Processing.

[27]  Yang Xiao,et al.  Efficient Airport Detection Using Line Segment Detector and Fisher Vector Representation , 2016, IEEE Geoscience and Remote Sensing Letters.

[28]  Zhang Yi,et al.  Sensor Fusion Method for Horizon Detection From an Aircraft in Low Visibility Conditions , 2014, IEEE Transactions on Instrumentation and Measurement.

[29]  Huafeng Chen,et al.  Study on hit-aim detection of airfield runway based on weighted structure templates matching , 2009, International Symposium on Multispectral Image Processing and Pattern Recognition.

[30]  Yihua Tan,et al.  Airport Detection From Large IKONOS Images Using Clustered SIFT Keypoints and Region Information , 2011, IEEE Geoscience and Remote Sensing Letters.

[31]  Dong Liu,et al.  A robust and fast line segment detector based on top-down smaller eigenvalue analysis , 2014, International Conference on Graphic and Image Processing.

[32]  Christian Claudel,et al.  A robust vision-based runway detection and tracking algorithm for automatic UAV landing , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[33]  O. Yaron,et al.  Target Detection and Verification via Airborne Hyperspectral and High-Resolution Imagery Processing and Fusion , 2010, IEEE Sensors Journal.

[34]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[35]  Ugur Halici,et al.  Texture-Based Airport Runway Detection , 2013, IEEE Geoscience and Remote Sensing Letters.

[36]  Jason J. Ford,et al.  Airborne vision‐based collision‐detection system , 2011, J. Field Robotics.

[37]  Anil K. Jain,et al.  Object Matching Using Deformable Templates , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Wei Wu,et al.  Recognition of Airport Runways in FLIR Images Based on Knowledge , 2014, IEEE Geoscience and Remote Sensing Letters.

[39]  Shao Yongshe A Radon Transform-Based Algorithm for the Detection and Matching of Airport Objects , 2006 .

[40]  Supun Samarasekera,et al.  Precise vision-aided aerial navigation , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Gangyao Kuang,et al.  Airport Detection in SAR Image Based on Perceptual Organization , 2011, 2011 International Workshop on Multi-Platform/Multi-Sensor Remote Sensing and Mapping.