Efficient local and global contour detection based on superpixels

Abstract In this paper, two contour detection methods, inspired from gPb framework, are introduced and applied to saliency object segmentation. To improve the computational efficiency of gPb method, superpixels are introduced into the computational processes of both mPb and sPb. Specifically, for mPb, only the pixels within a given distance from the boundaries of superpixels are considered. For sPb, graph is constructed from superpixels and some selected pixels. Experiments on a public available BSDS500 image dataset show that higher efficiency could be achieved by the proposed local contour detection method, mPbSP, than mPb while with competitive results. Besides, compared with state-of-the-art methods, better results could be produced by the proposed global contour detection method, gPbSP, when a relatively small distance is considered. Moreover, experiments on PASCAL VOC2012 training segmentation dataset show that competitive results of saliency object segmentation could also be produced by the proposed methods with much less time.

[1]  Ying-Tung Hsiao,et al.  A contour based image segmentation algorithm using morphological edge detection , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ke Xiang,et al.  Attention shift-based multiple saliency object segmentation , 2016, J. Electronic Imaging.

[4]  Joseph J. Lim,et al.  Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Christopher K. I. Williams,et al.  Visual Boundary Prediction: A Deep Neural Prediction Network and Quality Dissection , 2014, AISTATS.

[7]  N. Ranganathan,et al.  Gabor filter-based edge detection , 1992, Pattern Recognit..

[8]  Alessandro Neri,et al.  A Biologically Motivated Multiresolution Approach to Contour Detection , 2007, EURASIP J. Adv. Signal Process..

[9]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jordi Pont-Tuset,et al.  Measures and Meta-Measures for the Supervised Evaluation of Image Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Xiao Sun,et al.  A Biologically-Inspired Framework for Contour Detection Using Superpixel-Based Candidates and Hierarchical Visual Cues , 2015, Sensors.

[15]  Laurent Najman,et al.  Geodesic Saliency of Watershed Contours and Hierarchical Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Nong Sang,et al.  Contrast-dependent surround suppression models for contour detection , 2016, Pattern Recognit..

[17]  Jitendra Malik,et al.  From contours to regions: An empirical evaluation , 2009, CVPR.

[18]  Ming-Hsuan Yang,et al.  Decomposed Learning for Joint Segmentation and Categorization , 2013, British Machine Vision Conference.

[19]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[21]  Jianbo Shi,et al.  DeepEdge: A multi-scale bifurcated deep network for top-down contour detection , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Zejian Yuan,et al.  Probabilistic salient object contour detection based on superpixels , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Kurt Keutzer,et al.  Efficient, high-quality image contour detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Xiao Huang,et al.  Iteratively parsing contour fragments for object detection , 2016, Neurocomputing.

[25]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[26]  C. Lawrence Zitnick,et al.  Structured Forests for Fast Edge Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Xiaofeng Ren,et al.  Discriminatively Trained Sparse Code Gradients for Contour Detection , 2012, NIPS.

[28]  Pietro Perona,et al.  Reconstructive Sparse Code Transfer for Contour Detection and Semantic Labeling , 2014, ACCV.

[29]  Andrew W. Fitzgibbon,et al.  Learning Class-Specific Edges for Object Detection and Segmentation , 2006, ICVGIP.

[30]  Martial Hebert,et al.  Discriminative Sparse Image Models for Class-Specific Edge Detection and Image Interpretation , 2008, ECCV.

[31]  Cristian Sminchisescu,et al.  Efficient Closed-Form Solution to Generalized Boundary Detection , 2012, ECCV.

[32]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[33]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[36]  Conrad Sanderson,et al.  Armadillo: a template-based C++ library for linear algebra , 2016, J. Open Source Softw..

[37]  Jianbo Shi,et al.  Contour cut: Identifying salient contours in images by solving a Hermitian eigenvalue problem , 2011, CVPR 2011.

[38]  Laurent D. Cohen,et al.  Constrained image segmentation from hierarchical boundaries , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Andrew Zisserman,et al.  A Boundary-Fragment-Model for Object Detection , 2006, ECCV.

[40]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Shai Avidan,et al.  Semi global boundary detection , 2016, Comput. Vis. Image Underst..

[42]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[43]  Yi-Hsuan Tsai,et al.  Decomposed Learning for Joint Object Segmentation and Categorization , 2013 .

[44]  Luc Van Gool,et al.  SEEDS: Superpixels Extracted via Energy-Driven Sampling , 2012, ECCV.

[45]  Camillo J. Taylor,et al.  Towards Fast and Accurate Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Xiaofeng Ren,et al.  Multi-scale Improves Boundary Detection in Natural Images , 2008, ECCV.

[47]  Edward H. Adelson,et al.  Crisp Boundary Detection Using Pointwise Mutual Information , 2014, ECCV.