Image superpixel segmentation based on hierarchical multi-level LI-SLIC

Abstract In computer vision, superpixel segmentation has been widely used as a very important preprocessing to reduce the number of image primitives for subsequent image processing tasks. To improve the segmentation accuracy and the robustness to noise, a hierarchical multi-level segmentation framework is developed in this paper. First, original image is initially segmented by a local information based simple liner iterative clustering (LI-SLIC) method. Then, the initial generated superpixels are further segmented hierarchically by LI-SLIC to ensure that all pixels contained within each superpixel belong to a same object. Finally, to eliminate over-segmentation and reduce the number of superpixels, adjacent superpixels belonging to a same object are merged based on the probability distribution similarity. The proposed method does not require setting the seeds or number of the superpixels to be generated in advance, which can segment image into an appropriate number of superpixels without under- or over- segmentation automatically according to its content. Experiments are conducted on two public datasets Berkeley and 3Dircadb, and the results demonstrate that our method is more effective and accurate than many existing superpixel methods and shows a great advantage in dealing with images corrupted by various noises.

[1]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Fan Zhao,et al.  Local region statistics combining multi-parameter intensity fitting module for medical image segmentation with intensity inhomogeneity and complex composition , 2016 .

[5]  Zhengqin Li,et al.  Linear Spectral Clustering Superpixel , 2017, IEEE Transactions on Image Processing.

[6]  Aditi Majumder,et al.  Seam carving based aesthetics enhancement for photos , 2015, Signal Process. Image Commun..

[7]  Javier Montero,et al.  Fuzzy image segmentation based upon hierarchical clustering , 2015, Knowl. Based Syst..

[8]  Fabrice Heitz,et al.  Unsupervised learning-based long-term superpixel tracking , 2019, Image Vis. Comput..

[9]  V. R. Bindu,et al.  An Efficient Image Segmentation Approach using Superpixels with Colorization , 2020 .

[10]  Bastian Leibe,et al.  Superpixels: An evaluation of the state-of-the-art , 2016, Comput. Vis. Image Underst..

[11]  Fabrice Heitz,et al.  Scale-adaptive supervoxel-based random forests for liver tumor segmentation in dynamic contrast-enhanced CT scans , 2017, International Journal of Computer Assisted Radiology and Surgery.

[12]  David Cárdenas-Peña,et al.  Waterpixels , 2015, IEEE Transactions on Image Processing.

[13]  Nicolas Papadakis,et al.  Robust superpixels using color and contour features along linear path , 2018, Comput. Vis. Image Underst..

[14]  Tansel Özyer,et al.  Complex networks driven salient region detection based on superpixel segmentation , 2017, Pattern Recognit..

[15]  Caiming Zhang,et al.  A Simple Algorithm of Superpixel Segmentation With Boundary Constraint , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Jacob Scharcanski,et al.  An iterative approach for obtaining multi-scale superpixels based on stochastic graph contraction operations , 2018, Expert Syst. Appl..

[17]  Weibin Liu,et al.  Visual object tracking with multi-scale superpixels and color-feature guided kernelized correlation filters , 2018, Signal Process. Image Commun..

[18]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[19]  Qiang Wang,et al.  Superpixel-feature-based multiple kernel sparse representation for hyperspectral image classification , 2020, Signal Process..

[20]  Elhoussaine Ouabida,et al.  Optical scanning holography for tumor extraction from brain magnetic resonance images , 2020 .

[21]  Sasirooba Thirumavalavan,et al.  An improved teaching–learning based robust edge detection algorithm for noisy images , 2016, Journal of advanced research.

[22]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.