Sky Detection in Hazy Image

Sky detection plays an essential role in various computer vision applications. Most existing sky detection approaches, being trained on ideal dataset, may lose efficacy when facing unfavorable conditions like the effects of weather and lighting conditions. In this paper, a novel algorithm for sky detection in hazy images is proposed from the perspective of probing the density of haze. We address the problem by an image segmentation and a region-level classification. To characterize the sky of hazy scenes, we unprecedentedly introduce several haze-relevant features that reflect the perceptual hazy density and the scene depth. Based on these features, the sky is separated by two imbalance SVM classifiers and a similarity measurement. Moreover, a sky dataset (named HazySky) with 500 annotated hazy images is built for model training and performance evaluation. To evaluate the performance of our method, we conducted extensive experiments both on our HazySky dataset and the SkyFinder dataset. The results demonstrate that our method performs better on the detection accuracy than previous methods, not only under hazy scenes, but also under other weather conditions.

[1]  Cosmin Ancuti,et al.  A Fast Semi-inverse Approach to Detect and Remove the Haze from a Single Image , 2010, ACCV.

[2]  Qian Wu,et al.  A new haze image database with detailed air quality information and a novel no-reference image quality assessment method for haze images , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Arnold W. M. Smeulders,et al.  Brain responses strongly correlate with Weibull image statistics when processing natural images. , 2009, Journal of vision.

[4]  Svetlana Lazebnik,et al.  Superparsing , 2010, International Journal of Computer Vision.

[5]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Bo Wang,et al.  A Sea-Sky Line Detection Method for Unmanned Surface Vehicles Based on Gradient Saliency , 2016, Sensors.

[7]  Raja Sengupta,et al.  Obstacle Detection for Small Autonomous Aircraft Using Sky Segmentation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[9]  罗海波 Luo Haibo,et al.  Haze removal using scale adaptive dark channel prior , 2016 .

[10]  Ali Borji,et al.  Segmenting Sky Pixels in Images , 2017, ArXiv.

[11]  Jiebo Luo,et al.  A physical model-based approach to detecting sky in photographic images , 2002, IEEE Trans. Image Process..

[12]  Ming-Hsuan Yang,et al.  Sky is not the limit , 2016, ACM Trans. Graph..

[13]  Chokri Ben Amar,et al.  A Parametric Algorithm for Skyline Extraction , 2016, ACIVS.

[14]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[15]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Sennay Ghebreab,et al.  From Image Statistics to Scene Gist: Evoked Neural Activity Reveals Transition from Low-Level Natural Image Structure to Scene Category , 2013, The Journal of Neuroscience.

[17]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[18]  Xiaofeng Tao,et al.  Transient attributes for high-level understanding and editing of outdoor scenes , 2014, ACM Trans. Graph..

[19]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[20]  Guodong Guo,et al.  Sky detection by effective context inference , 2016, Neurocomputing.

[21]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[22]  Yijing Li,et al.  Learning from class-imbalanced data: Review of methods and applications , 2017, Expert Syst. Appl..

[23]  Wei-Ta Chu,et al.  Camera as weather sensor: Estimating weather information from single images , 2017, J. Vis. Commun. Image Represent..

[24]  Scott Workman,et al.  Sky segmentation in the wild: An empirical study , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[25]  Cewu Lu,et al.  Two-Class Weather Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Yehu Shen,et al.  Sky Region Detection in a Single Image for Autonomous Ground Robot Navigation , 2013 .

[27]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[28]  Alexei A. Efros,et al.  Geometric context from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.