Horizon line detection using supervised learning and edge cues

Abstract Traditionally, edge detection has been extensively employed as the basic step for the horizon line detection problem. However, generally such methods do not discriminate between edges belonging to horizon boundary and others due to clouds or other natural phenomenon. Additionally, most edge based methods suffer more in the presence of edge gaps. To address these issues, we propose an edge-less horizon line detection approach based on pixel classification, hence not relying on edge information. The key idea is formulating a multi-stage graph using classification maps, instead of edge maps, where each node cost reflects the likelihood of pixel belonging to the horizon boundary. The shortest path is found in the formulated multi-stage graph using dynamic programming which conforms to the detected horizon line. We demonstrate the performance of the proposed approach on two challenging data sets and provide comparisons with two edge-based methods: one relying on edge detection while the other based on edge classification. Overall, the proposed approach achieves comparable performance against carefully crafted edge based formulations. A by-product of the edge-less approach is its capability of associating a confidence level with the found solution, which can be used to confirm the presence or absence of a horizon line in a given image. The method is also capable of dealing with partial horizon line in an image. To further improve the detection performance, we propose a fusion strategy which combines both edge-based and edge-less information. Extensive evaluations, including a publicly available data set, illustrate the superiority of the proposed fusion approach.

[1]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Terrence Fong,et al.  Coupling Dynamic Programming with Machine Learning for Horizon Line Detection , 2015, Int. J. Artif. Intell. Tools.

[3]  Marco Tagliasacchi,et al.  Mountain Peak Identification in Visual Content Based on Coarse Digital Elevation Models , 2014, MAED '14.

[4]  Wen-Nung Lie,et al.  A robust dynamic programming algorithm to extract skyline in images for navigation , 2005, Pattern Recognit. Lett..

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jin-Soo Kim,et al.  Skyline Extraction using a Multistage Edge Filtering , 2011 .

[7]  Paolo Valigi,et al.  Learning Contours for Automatic Annotations of Mountains Pictures on a Smartphone , 2014, ICDSC.

[8]  Chih-Wen Su,et al.  Skyline localization for mountain images , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[9]  Ara V. Nefian,et al.  A Machine Learning Approach to Horizon Line Detection Using Local Features , 2013, ISVC.

[10]  Baokui Li,et al.  An Improved Algorithm for Horizon Detection Based on OSTU , 2015, 2015 7th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[11]  Terrence Fong,et al.  An Edge-Less Approach to Horizon Line Detection , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[12]  Hans-Peter Seidel,et al.  Automatic photo-to-terrain alignment for the annotation of mountain pictures , 2011, CVPR 2011.

[13]  R. Ruijsink,et al.  Sky Segmentation Approach to obstacle avoidance , 2011, 2011 Aerospace Conference.

[14]  Mubarak Shah,et al.  Accurate Image Localization Based on Google Maps Street View , 2010, ECCV.

[15]  Marc Pollefeys,et al.  Image Based Geo-localization in the Alps , 2016, International Journal of Computer Vision.

[16]  Samuel Kosolapov,et al.  Horizon Line Detection in Marine Images: Which Method to Choose? , 2013 .

[17]  Avideh Zakhor,et al.  User-Driven Geolocation of Untagged Desert Imagery Using Digital Elevation Models , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[18]  Raja Sengupta,et al.  Obstacle Detection for Small Autonomous Aircraft Using Sky Segmentation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  Mandyam V. Srinivasan,et al.  A Vision based system for attitude estimation of UAVS , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Gianfranco Visentin,et al.  Localization of Planetary Exploration Rovers with Orbital Imaging : a survey of approaches , 2014 .

[21]  Emma E. Regentova,et al.  Sky Segmentation by Fusing Clustering with Neural Networks , 2013, ISVC.

[22]  Claudio Andreatta,et al.  Spatial and Temporal Attractiveness Analysis Through Geo-Referenced Photo Alignment , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[23]  S. Ali Etemad,et al.  Robust Horizon Detection Using Segmentation for UAV Applications , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[24]  Peter G. Ifju,et al.  Sky/ground modeling for autonomous MAV flight , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  Michael Felsberg,et al.  Highly Accurate Attitude Estimation via Horizon Detection , 2016, J. Field Robotics.

[26]  Eric Krotkov,et al.  Outdoor Visual Position Estimation for Planetary Rovers , 2000, Auton. Robots.

[27]  Jiang Li,et al.  A Hierarchical Horizon Detection Algorithm , 2013, IEEE Geoscience and Remote Sensing Letters.

[28]  Rytis Verbickas,et al.  Sky and Ground Detection Using Convolutional Neural Networks , 2014 .

[29]  Terrence Fong,et al.  Planetary rover localization within orbital maps , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[30]  Rodney A. Walker,et al.  Attitude Estimation for a Fixed-Wing Aircraft Using Horizon Detection and Optical Flow , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[31]  Terrence Fong,et al.  An Experimental Evaluation of Different Features and Nodal Costs for Horizon Line Detection , 2014, ISVC.

[32]  Fabio Gagliardi Cozman,et al.  Automatic mountain detection and pose estimation for teleoperation of lunar rovers , 1997, Proceedings of International Conference on Robotics and Automation.

[33]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[34]  Nghia Ho,et al.  Localization on freeways using the horizon line signature , 2014 .

[35]  Vishisht Gupta,et al.  Terrain-based vehicle orientation estimation combining vision and inertial measurements , 2008 .

[36]  Yi Chen,et al.  Camera geolocation from mountain images , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[37]  Peter W. Gibbens,et al.  Efficient Terrain-Aided Visual Horizon Based Attitude Estimation and Localization , 2015, J. Intell. Robotic Syst..

[38]  Daniel Braun,et al.  Automated Silhouette Extraction for Mountain Recognition , 2015, GvD.

[39]  Gérard G. Medioni,et al.  Map-based localization using the panoramic horizon , 1995, IEEE Trans. Robotics Autom..

[40]  Yang Song,et al.  Tour the world: Building a web-scale landmark recognition engine , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Isabelle Fantoni,et al.  Robust horizon finding algorithm for real-time autonomous navigation based on monocular vision , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[42]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[43]  Evgeny Gershikov,et al.  Is color important for horizon line detection? , 2014, 2014 International Conference on Advanced Technologies for Communications (ATC 2014).

[44]  Terrence Fong,et al.  Fusion of edge-less and edge-based approaches for horizon line detection , 2015, 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA).

[45]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[46]  Lei Liu,et al.  Automatic detection of sea-sky horizon line and small targets in maritime infrared imagery , 2016 .

[47]  Yi Dong,et al.  Geo-localization using Volumetric Representations of Overhead Imagery , 2015, International Journal of Computer Vision.

[48]  Alexei A. Efros,et al.  IM2GPS: estimating geographic information from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Yehu Shen,et al.  Sky Region Detection in a Single Image for Autonomous Ground Robot Navigation , 2013 .

[50]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[51]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[52]  Lorenzo Porzi,et al.  A Deeply-Supervised Deconvolutional Network for Horizon Line Detection , 2016, ACM Multimedia.

[53]  Peter W. Gibbens,et al.  Horizon Profile Detection for Attitude Determination , 2012, J. Intell. Robotic Syst..

[54]  Lawrence O. Hall,et al.  Horizon Detection Using Machine Learning Techniques , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[55]  Zigmund Orlov,et al.  Robust layer-based boat detection and multi-target-tracking in maritime environments , 2010, 2010 International WaterSide Security Conference.

[56]  Yangquan Chen,et al.  A Data Fusion System for Attitude Estimation of Low-cost Miniature UAVs , 2012, J. Intell. Robotic Syst..

[57]  Chih-Wen Su,et al.  Automatic Peak Recognition for Mountain Images , 2013, EMC/HumanCom.

[58]  Marc Pollefeys,et al.  Large Scale Visual Geo-Localization of Images in Mountainous Terrain , 2012, ECCV.