Underwater Object Segmentation Integrating Transmission and Saliency Features

Various types of knowledge and features have been explored for level set-based segmentation. On the ground, the prior knowledge and carefully-designed features perform well to identify the foreground–background contrast, which improves the performance of the segmentation method for complicated and distorted data. However, this is not the case for underwater environments, since the features available on the ground are not suitable for challenging underwater environments. Thus, underwater image segmentation currently lags behind ground-based segmentation. In this paper, novel cues and a suitable model formulation for object segmentation from underwater images are proposed. We consider the special haze effect over underwater images and extract an informative feature (transmission feature) from haze condensation. The saliency feature is also used for underwater object segmentation. Consequently, in our method, the object-background difference can be presented by these features on two levels, i.e., the edge-level transmission and region-level saliency features. These two types of features are integrated into a unified level set formulation to propose a solution that handles the challenging issues in underwater object segmentation. The experimental comparisons of our method with other methods comprehensively demonstrate the satisfactory performance of our method.

[1]  Amaury Nègre,et al.  Robust Vision-Based Underwater Target Identification and Homing Using Self-Similar Landmarks , 2007, FSR.

[2]  Yihong Gong,et al.  Active contour model based on local and global intensity information for medical image segmentation , 2016, Neurocomputing.

[3]  Aykut Erdem,et al.  Visual saliency estimation by nonlinearly integrating features using region covariances. , 2013, Journal of vision.

[4]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Lei Zhang,et al.  Active contours with selective local or global segmentation: A new formulation and level set method , 2010, Image Vis. Comput..

[6]  Haiyong Zheng,et al.  Automatic object detection and segmentation from underwater images via saliency-based region merging , 2016, OCEANS 2016 - Shanghai.

[7]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Huimin Lu,et al.  Low illumination underwater light field images reconstruction using deep convolutional neural networks , 2018, Future Gener. Comput. Syst..

[9]  Weisi Lin,et al.  Visual Saliency Detection With Free Energy Theory , 2015, IEEE Signal Processing Letters.

[10]  Jenq-Neng Hwang,et al.  A Feature Learning and Object Recognition Framework for Underwater Fish Images , 2016, IEEE Transactions on Image Processing.

[11]  Chuanjiang He,et al.  A convex variational level set model for image segmentation , 2015, Signal Process..

[12]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[13]  Demetri Terzopoulos,et al.  Topologically adaptable snakes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Huimin Lu,et al.  CONet: A Cognitive Ocean Network , 2019, IEEE Wireless Communications.

[15]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Gregory Dudek,et al.  Robust servo-control for underwater robots using banks of visual filters , 2009, 2009 IEEE International Conference on Robotics and Automation.

[17]  Donghwa Lee,et al.  Artificial landmark-based underwater localization for AUVs using weighted template matching , 2014, Intell. Serv. Robotics.

[18]  Sim Heng Ong,et al.  Integrating spatial fuzzy clustering with level set methods for automated medical image segmentation , 2011, Comput. Biol. Medicine.

[19]  Stefano Caselli,et al.  Investigation of Vision-Based Underwater Object Detection with Multiple Datasets , 2015 .

[20]  B. S. Manjunath,et al.  Graph partitioning active contours (GPAC) for image segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[22]  Christof Koch,et al.  Automated event detection in underwater video , 2003, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).

[23]  Horst Bischof,et al.  Saliency driven total variation segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Xue-Cheng Tai,et al.  A variant of the level set method and applications to image segmentation , 2006, Math. Comput..

[25]  Hayato Kondo,et al.  Navigation of autonomous underwater vehicles based on artificial underwater landmarks , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[26]  Andrew Hogue,et al.  A visually guided swimming robot , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Yongfei Wu,et al.  A Retinex modulated piecewise constant variational model for image segmentation and bias correction , 2018 .

[28]  Huimin Lu,et al.  Brain Intelligence: Go beyond Artificial Intelligence , 2017, Mobile Networks and Applications.

[29]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[30]  Huibin Wang,et al.  Monocular Vision-Based Underwater Object Detection , 2017, Sensors.

[31]  Agus Zainal Arifin,et al.  Image segmentation by histogram thresholding using hierarchical cluster analysis , 2006, Pattern Recognit. Lett..

[32]  Salem Saleh Al-amri,et al.  Image Segmentation by Using Threshold Techniques , 2010, ArXiv.

[33]  Frederic Maire,et al.  A Vision Based Target Detection System for Docking of an A utonomous Underwater Vehicle , 2009, ICRA 2009.

[34]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[35]  Huimin Lu,et al.  Motor Anomaly Detection for Unmanned Aerial Vehicles Using Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[36]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[37]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[38]  David Zhang,et al.  A Level Set Approach to Image Segmentation With Intensity Inhomogeneity , 2016, IEEE Transactions on Cybernetics.

[39]  Huimin Lu,et al.  Underwater image dehazing using joint trilateral filter , 2014, Comput. Electr. Eng..

[40]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[41]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[42]  Sea-Moon Kim,et al.  Visual servoing for underwater docking of an autonomous underwater vehicle with one camera , 2003, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).