A novel Gaussian mixture model for superpixel segmentation

Superpixel segmentation is used to partition an image into perceptually coherence atomic regions. As a preprocessing step of computer vision applications, it can enormously reduce the number of entries of subsequent algorithms. With each superpixel associated with a Gaussian distribution, we assume that a pixel is generated by first randomly choosing one of the superpixels, and then the pixel is drawn from the corresponding Gaussian density. Unlike most applications of Gaussian mixture model in clustering, data points in our model are assumed to be non-identically distributed. Given an image, a log-likelihood function is constructed for maximizing. Based on a solution derived from the expectation-maximization method, a well designed algorithm is proposed. Our method is of linear complexity with respect to the number of pixels, and it can be implemented using parallel techniques. To the best of our knowledge, our algorithm outperforms the state-of-theart in accuracy and presents a competitive performance in computational ∗Corresponding author. Tel.:+862787558912; fax: +862787543130. Email addresses: sawpara@126.com (Zhihua Ban), jgliu@ieee.org (Jianguo Liu) Preprint submitted to Pattern Recognition December 30, 2016 ar X iv :1 61 2. 08 79 2v 1 [ cs .C V ] 2 8 D ec 2 01 6 efficiency.

[1]  Song Zhu,et al.  Fast superpixel segmentation by iterative edge refinement , 2015 .

[2]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[3]  Greg Mori,et al.  Guiding model search using segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Florent Lafarge,et al.  Image partitioning into convex polygons , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  David Cárdenas-Peña,et al.  Waterpixels , 2015, IEEE Transactions on Image Processing.

[6]  Paria Mehrani,et al.  Superpixels and Supervoxels in an Energy Optimization Framework , 2010, ECCV.

[7]  Luc Van Gool,et al.  SEEDS: Superpixels Extracted Via Energy-Driven Sampling , 2012, International Journal of Computer Vision.

[8]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Xiao Sun,et al.  A Biologically-Inspired Framework for Contour Detection Using Superpixel-Based Candidates and Hierarchical Visual Cues , 2015, Sensors.

[11]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Alexander Wong,et al.  Return of grid seams: A superpixel algorithm using discontinuous multi-functional energy seam carving , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[13]  Xiaochun Cao,et al.  Regularity Preserved Superpixels and Supervoxels , 2014, IEEE Transactions on Multimedia.

[14]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[15]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xuelong Li,et al.  Lazy Random Walks for Superpixel Segmentation , 2014, IEEE Transactions on Image Processing.

[17]  Huchuan Lu,et al.  Robust Superpixel Tracking , 2014, IEEE Transactions on Image Processing.

[18]  Christopher Rohkohl,et al.  Efficient Image Segmentation Using Pairwise Pixel Similarities , 2007, DAGM-Symposium.

[19]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Sanja Fidler,et al.  Real-time coarse-to-fine topologically preserving segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Hongbin Zha,et al.  Structure-sensitive superpixels via geodesic distance , 2011, ICCV.

[22]  Ian D. Reid,et al.  gSLICr: SLIC superpixels at over 250Hz , 2015, ArXiv.

[23]  Yong-Jin Liu,et al.  Manifold SLIC: A Fast Method to Compute Content-Sensitive Superpixels , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[25]  Zhengqin Li,et al.  Superpixel segmentation using Linear Spectral Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Jonathan Warrell,et al.  “Lattice Cut” - Constructing superpixels using layer constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[29]  Umar Mohammed,et al.  Superpixel lattices , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Xiaochun Cao,et al.  Topology Preserved Regular Superpixel , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[32]  Amirthalingam Ramanan,et al.  One-pass clustering superpixels , 2014, 7th International Conference on Information and Automation for Sustainability.

[33]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[34]  Stewart Burn,et al.  Superpixels via pseudo-Boolean optimization , 2011, 2011 International Conference on Computer Vision.

[35]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Alexander Wong,et al.  Grid Seams: A Fast Superpixel Algorithm for Real-Time Applications , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[37]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[38]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Li Li,et al.  Edge-based split-and-merge superpixel segmentation , 2015, 2015 IEEE International Conference on Information and Automation.

[40]  Ding Yuan,et al.  Cross-trees, edge and superpixel priors-based cost aggregation for stereo matching , 2015, Pattern Recognit..

[41]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[42]  Peer Neubert,et al.  Compact Watershed and Preemptive SLIC: On Improving Trade-offs of Superpixel Segmentation Algorithms , 2014, 2014 22nd International Conference on Pattern Recognition.

[43]  Jie Wang,et al.  VCells: Simple and Efficient Superpixels Using Edge-Weighted Centroidal Voronoi Tessellations , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Pengfei Shi,et al.  NSLIC: SLIC superpixels based on nonstationarity measure , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[45]  Raquel Urtasun,et al.  Efficient Joint Segmentation, Occlusion Labeling, Stereo and Flow Estimation , 2014, ECCV.