Horizon Detection From Electro-Optical Sensors Under Maritime Environment

In recent years, target detection in maritime surveillance has become a popular subject. Horizon under maritime environment is one of the most important semantic boundaries for segmenting the image into sea and sky. With the help of horizon, seeking scope can be restricted to a definite small area, which significantly reduces the computational complexity. Meanwhile, horizon is used to automatically adjust the attitude of air vehicles as well. Although a plenty of algorithms for horizon detection have been created, they are prone to low visibility and occlusions. In this paper, a novel robust algorithm based on probability distribution and physical characteristics is proposed. At first, the probabilities are distributed to each vertically divided region by weighted textures, and the sea–sky region is located from definite probabilistic intervals. Based on a Canny edge detector, Hough transform extracts a series of candidate horizons. Finally, a novel voting method is applied. The line with the maximum value will be regarded as the true horizon. The proposed algorithm can not only precisely detect the horizon from fine images but also from blurred image, even with splashed camera. The performance of the proposed algorithm is verified by experiments on 65 videos containing more than 20 000 frames under different sceneries. The results illustrate that our algorithm can detect the horizon line with minor errors in comparison with other five state-of-the-art algorithms.

[1]  Gang Sun,et al.  Research on infrared ship detection method in sea-sky background , 2013, Other Conferences.

[2]  D. K. Lynch,et al.  Color and light in nature , 1995 .

[3]  Evgeny Gershikov,et al.  New Methods for Horizon Line Detection in Infrared and Visible Sea Images , 2013 .

[4]  Zhao-Ying Zhou,et al.  Vision-based horizon extraction for micro air vehicle flight control , 2005, IEEE Trans. Instrum. Meas..

[5]  W. Steen Absorption and Scattering of Light by Small Particles , 1999 .

[6]  Kyeong-Deok Moon,et al.  Fast horizon detection in maritime images using region-of-interest , 2018, Int. J. Distributed Sens. Networks.

[7]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  A. Price,et al.  Aircraft attitude estimation from horizon video , 2006 .

[9]  Deepu Rajan,et al.  MSCM-LiFe: Multi-scale cross modal linear feature for horizon detection in maritime images , 2016, 2016 IEEE Region 10 Conference (TENCON).

[11]  Dmitry B. Goldgof,et al.  Detection and tracking of ships in open sea with rapidly moving buoy-mounted camera system , 2012 .

[12]  Yong Xu,et al.  Review of Video and Image Defogging Algorithms and Related Studies on Image Restoration and Enhancement , 2016, IEEE Access.

[13]  Mandyam V. Srinivasan,et al.  A fast and adaptive method for estimating UAV attitude from the visual horizon , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Mandyam V. Srinivasan,et al.  UAV attitude control using the visual horizon , 2010, ICRA 2010.

[16]  Deepu Rajan,et al.  Video Processing From Electro-Optical Sensors for Object Detection and Tracking in a Maritime Environment: A Survey , 2016, IEEE Transactions on Intelligent Transportation Systems.

[17]  Deepu Rajan,et al.  MuSCoWERT: multi-scale consistence of weighted edge Radon transform for horizon detection in maritime images. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Dmitry B. Goldgof,et al.  Tracking Ships from Fast Moving Camera through Image Registration , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Jiebo Luo,et al.  A physical model-based approach to detecting sky in photographic images , 2002, IEEE Trans. Image Process..

[20]  Fei Yang,et al.  Robust sea-sky-line detection for complex sea background , 2015, 2015 IEEE International Conference on Progress in Informatics and Computing (PIC).

[21]  Jiebo Luo,et al.  Improved blue sky detection using polynomial model fit , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[22]  Jiebo Luo,et al.  A physics-motivated approach to detecting sky in photographs , 2002, Object recognition supported by user interaction for service robots.

[23]  Jiebo Luo,et al.  Hybrid approach to classifying sky regions in natural images , 2003, IS&T/SPIE Electronic Imaging.

[24]  Peter W. Gibbens,et al.  Horizon Profile Detection for Attitude Determination , 2012, J. Intell. Robotic Syst..

[25]  Chi Yoon Jeong,et al.  Horizon Detection in Maritime Images using Scene Parsing Network , 2018 .

[26]  Raja Sengupta,et al.  Obstacle Detection for Small Autonomous Aircraft Using Sky Segmentation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[27]  Samuel Kosolapov,et al.  Horizon Line Detection in Marine Images: Which Method to Choose? , 2013 .

[28]  Zhang Yi,et al.  Sensor Fusion Method for Horizon Detection From an Aircraft in Low Visibility Conditions , 2014, IEEE Transactions on Instrumentation and Measurement.

[29]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[30]  徐青山 Xu Qingshan,et al.  Sea Sky Line Detection Based on Edge Phase Encoding in Complicated Background , 2017 .

[31]  Jiang Li,et al.  A Hierarchical Horizon Detection Algorithm , 2013, IEEE Geoscience and Remote Sensing Letters.