Weighted superpixel segmentation

Image boundaries and regularity are two important factors in superpixel segmentation. Balancing the influence of image boundaries and regularity is key to producing superpixels. In this paper, we present a novel superpixel segmentation algorithm, called weighted superpixel segmentation (WSS), which is capable of generating superpixels with high boundary adherence and regular shape in a linear time. In WSS, superpixels are generated according to a distance metric defined by the combination of a weight function term, color distance term and plane distance term. Unlike other superpixel algorithms, the weight function is calculated for each pixel to determine the weight of the color distance term and plane distance term in the distance metric. To increase superpixel regularity, superpixel seeds are initialized in a hexagonal manner. Then, we use the distance metric to obtain the initial superpixels. Determining the seed search range is an essential factor to improve algorithm accuracy; thus, a dynamic circle search range is designed in our algorithm that can provide better superpixel results. Finally, a merging strategy is applied to obtain the final superpixels and ensure that the number of superpixels agrees with expectations. Experimental results demonstrate that WSS performs as well as or even better than the existing methods in terms of several commonly used evaluation metrics in superpixel segmentation.

[1]  Paria Mehrani,et al.  Superpixels and Supervoxels in an Energy Optimization Framework , 2010, ECCV.

[2]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Zhengqin Li,et al.  Linear Spectral Clustering Superpixel , 2017, IEEE Transactions on Image Processing.

[4]  Xiao Pan,et al.  Superpixels of RGB-D Images for Indoor Scenes Based on Weighted Geodesic Driven Metric , 2017, IEEE Trans. Vis. Comput. Graph..

[5]  Xuelong Li,et al.  Lazy Random Walks for Superpixel Segmentation , 2014, IEEE Transactions on Image Processing.

[6]  Jan Kautz,et al.  Superpixel Sampling Networks , 2018, ECCV.

[7]  Youjie Zhou,et al.  Multiscale Superpixels and Supervoxels Based on Hierarchical Edge-Weighted Centroidal Voronoi Tessellation , 2015, IEEE Transactions on Image Processing.

[8]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[9]  Richard S. Zemel,et al.  Learning and Incorporating Top-Down Cues in Image Segmentation , 2006, ECCV.

[10]  Yilong Yin,et al.  Superpixels by Bilateral Geodesic Distance , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ms. D. Sakila,et al.  SUPERPIXEL CLASSIFICATION BASED OPTIC DISC AND OPTIC CUP SEGMENTATION FOR GLAUCOMA SCREENING , 2014 .

[13]  Ling Shao,et al.  Generalized Pooling for Robust Object Tracking , 2016, IEEE Transactions on Image Processing.

[14]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Jason J. Corso,et al.  (BP)2: Beyond pairwise Belief Propagation labeling by approximating Kikuchi free energies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Bohyung Han,et al.  Generalized Background Subtraction Using Superpixels with Label Integrated Motion Estimation , 2014, ECCV.

[18]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jianbo Shi,et al.  Recognizing objects by piecing together the Segmentation Puzzle , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Wenxian Yu,et al.  Superpixel-Based Classification With an Adaptive Number of Classes for Polarimetric SAR Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Hongsheng Xi,et al.  Image Classification via Object-Aware Holistic Superpixel Selection , 2013, IEEE Transactions on Image Processing.

[22]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Caiming Zhang,et al.  A Simple Algorithm of Superpixel Segmentation With Boundary Constraint , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[25]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[26]  Jan Kautz,et al.  Learning Superpixels with Segmentation-Aware Affinity Loss , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  Qiang Qiu,et al.  Weakly Supervised Instance Segmentation Using Class Peak Response , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Jianbing Shen,et al.  Real-Time Superpixel Segmentation by DBSCAN Clustering Algorithm. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[29]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Swami Sankaranarayanan,et al.  Learning from Synthetic Data: Addressing Domain Shift for Semantic Segmentation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Ling Shao,et al.  Consistent Video Saliency Using Local Gradient Flow Optimization and Global Refinement , 2015, IEEE Transactions on Image Processing.

[32]  Huchuan Lu,et al.  Superpixel tracking , 2011, 2011 International Conference on Computer Vision.

[33]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Ling Shao,et al.  Correspondence Driven Saliency Transfer , 2016, IEEE Transactions on Image Processing.

[35]  Svetlana Lazebnik,et al.  Superparsing - Scalable Nonparametric Image Parsing with Superpixels , 2010, International Journal of Computer Vision.

[36]  Kun Yu,et al.  DenseASPP for Semantic Segmentation in Street Scenes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Luc Van Gool,et al.  SEEDS: Superpixels Extracted via Energy-Driven Sampling , 2012, ECCV.

[39]  Jitendra Malik,et al.  Recovering human body configurations: combining segmentation and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[40]  David Zhang,et al.  Automatic Image Segmentation by Dynamic Region Merging , 2010, IEEE Transactions on Image Processing.

[41]  Luc Van Gool,et al.  Superpixel meshes for fast edge-preserving surface reconstruction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Jonathan Warrell,et al.  “Lattice Cut” - Constructing superpixels using layer constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.