Multiple instance subspace learning via partial random projection tree for local reflection symmetry in natural images

Local reflection symmetry detection in nature images is a quite important but challenging task in computer vision. The main obstacle is both the scales and the orientations of symmetric structure are unknown. The multiple instance learning (MIL) framework sheds lights onto this task owing to its capability to well accommodate the unknown scales and orientations of the symmetric structures. However, to differentiate symmetry vs non-symmetry remains to face extreme confusions caused by clutters scenes and ambiguous object structures. In this paper, we propose a novel multiple instance learning framework for local reflection symmetry detection, named multiple instance subspace learning (MISL), which instead learns a group of models respectively on well partitioned subspaces. To obtain such subspaces, we propose an efficient dividing strategy under MIL setting, named partial random projection tree (PRPT), by taking advantage of the fact that each sample (bag) is represented by the proposed symmetry features computed at specific scale and orientation combinations (instances). Encouraging experimental results on two datasets demonstrate that the proposed local reflection symmetry detection method outperforms current state-of-the-arts. HighlightsWe perform clustering on samples represented by multiple instances.We learn a group of MIL classifiers on subspaces.We report state-of-the-arts results on the symmetry detection benchmark.

[1]  Lei Yang,et al.  Per-pixel translational symmetry detection, optimization, and segmentation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Wenyu Liu,et al.  Skeleton Pruning by Contour Partitioning with Discrete Curve Evolution , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[4]  Zeyun Yu,et al.  A segmentation-free approach for skeletonization of gray-scale images via anisotropic vector diffusion , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  John Stillwell,et al.  Symmetry , 2000, Am. Math. Mon..

[6]  Sven J. Dickinson,et al.  Detecting Curved Symmetric Parts Using a Deformable Disc Model , 2013, 2013 IEEE International Conference on Computer Vision.

[7]  Longin Jan Latecki,et al.  Contour Grouping Based on Local Symmetry , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Jon Louis Bentley,et al.  Multidimensional divide-and-conquer , 1980, CACM.

[10]  Gabriella Sanniti di Baja,et al.  Skeletonization algorithm running on path-based distance maps , 1996, Image Vis. Comput..

[11]  Gabriella Sanniti di Baja,et al.  A One-Pass Two-Operation Process to Detect the Skeletal Pixels on the 4-Distance Transform , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Tony Lindeberg Edge Detection and Ridge Detection with Automatic Scale Selection , 2004, International Journal of Computer Vision.

[13]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[14]  Luc Van Gool,et al.  Computational Symmetry in Computer Vision and Computer Graphics , 2010, Found. Trends Comput. Graph. Vis..

[15]  Gabriella Sanniti di Baja,et al.  On Medial Representations , 2008, CIARP.

[16]  Mark S. Nixon,et al.  On automated model-based extraction and analysis of gait , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[17]  Iasonas Kokkinos,et al.  Learning-Based Symmetry Detection in Natural Images , 2012, ECCV.

[18]  Weiant Wathen-Dunn,et al.  Models for the perception of speech and visual form : proceedings of a symposium , 1967 .

[19]  R. Brubaker Models for the perception of speech and visual form: Weiant Wathen-Dunn, ed.: Cambridge, Mass., The M.I.T. Press, I–X, 470 pages , 1968 .

[20]  Luo Si,et al.  M3IC: Maximum Margin Multiple Instance Clustering , 2009, IJCAI.

[21]  Paul A. Viola,et al.  Multiple Instance Boosting for Object Detection , 2005, NIPS.

[22]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Zhuowen Tu,et al.  Active skeleton for non-rigid object detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Alexei A. Efros,et al.  Ensemble of exemplar-SVMs for object detection and beyond , 2011, 2011 International Conference on Computer Vision.

[25]  Sanjoy Dasgupta,et al.  Learning the structure of manifolds using random projections , 2007, NIPS.

[26]  Song Wang,et al.  Globally Optimal Grouping for Symmetric Closed Boundaries by Combining Boundary and Region Information , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Sven Loncaric,et al.  Spiral CT based assessment of laryngotrachealstenoses with 3D image processing using a Skeletonisation algorithm , 2002, IEEE Trans. Medical Imaging.

[29]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Sanjoy Dasgupta,et al.  Random projection trees and low dimensional manifolds , 2008, STOC.

[31]  Ki-Sang Hong,et al.  A pseudo-distance map for the segmentation-free skeletonization of gray-scale images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[32]  Alan L. Yuille,et al.  FORMS: A flexible object recognition and modelling system , 1996, International Journal of Computer Vision.

[33]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[34]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Max Mignotte,et al.  Local Symmetry Detection in Natural Images Using a Particle Filtering Approach , 2014, IEEE Transactions on Image Processing.

[36]  Joan Serrat,et al.  Evaluation of Methods for Ridge and Valley Detection , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Sven J. Dickinson,et al.  Multiscale Symmetric Part Detection and Grouping , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[38]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[39]  Xiaofeng Ren,et al.  Multi-scale Improves Boundary Detection in Natural Images , 2008, ECCV.

[40]  Hongyuan Wang,et al.  Skeleton growing and pruning with bending potential ratio , 2011, Pattern Recognit..

[41]  M. Fatih Demirci,et al.  Object Recognition as Many-to-Many Feature Matching , 2006, International Journal of Computer Vision.

[42]  Kin-Man Lam,et al.  Extraction of the Euclidean skeleton based on a connectivity criterion , 2003, Pattern Recognit..

[43]  Jie Gao,et al.  MAP: Medial axis based geometric routing in sensor networks , 2005, MobiCom '05.

[44]  Yanxi Liu,et al.  Curved Glide-Reflection Symmetry Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Joseph J. Lim,et al.  Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  E. Sorantin,et al.  Spiral-CT-based assessment of tracheal stenoses using 3-D-skeletonization , 2002, IEEE Transactions on Medical Imaging.

[47]  Punam K. Saha,et al.  A survey on skeletonization algorithms and their applications , 2016, Pattern Recognit. Lett..

[48]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[49]  Tony Lindeberg,et al.  Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention , 1993, International Journal of Computer Vision.

[50]  Iasonas Kokkinos,et al.  Bottom-Up & Top-down Object Detection using Primal Sketch Features and Graphical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[51]  Alan Liu,et al.  MuItiscale medial analysis of medical images , 1994, Image Vis. Comput..

[52]  Zhi-Hua Zhou,et al.  Multi-instance clustering with applications to multi-instance prediction , 2009, Applied Intelligence.

[53]  Zhuowen Tu,et al.  Unsupervised object class discovery via saliency-guided multiple class learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.