A Framework for Symmetric Part Detection in Cluttered Scenes

The role of symmetry in computer vision has waxed and waned in importance during the evolution of the field from its earliest days. At first figuring prominently in support of bottom-up indexing, it fell out of favour as shape gave way to appearance and recognition gave way to detection. With a strong prior in the form of a target object, the role of the weaker priors offered by perceptual grouping was greatly diminished. However, as the field returns to the problem of recognition from a large database, the bottom-up recovery of the parts that make up the objects in a cluttered scene is critical for their recognition. The medial axis community has long exploited the ubiquitous regularity of symmetry as a basis for the decomposition of a closed contour into medial parts. However, today’s recognition systems are faced with cluttered scenes and the assumption that a closed contour exists, i.e., that figure-ground segmentation has been solved, rendering much of the medial axis community’s work inapplicable. In this article, we review a computational framework, previously reported in [1–3], that bridges the representation power of the medial axis and the need to recover and group an object’s parts in a cluttered scene. Our framework is rooted in the idea that a maximally-inscribed disc, the building block of a medial axis, can be modelled as a compact superpixel in the image. We evaluate the method on images of cluttered scenes.

[1]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[2]  James L. Crowley,et al.  A Representation for Shape Based on Peaks and Ridges in the Difference of Low-Pass Transform , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[4]  I. Biederman Human image understanding: Recent research and a theory , 1985, Computer Vision Graphics and Image Processing.

[5]  Alex Pentland,et al.  Perceptual Organization and the Representation of Natural Form , 1986, Artif. Intell..

[6]  Michael Brady,et al.  Generating and Generalizing Models of Visual Objects , 1987, Artif. Intell..

[7]  Jean Ponce,et al.  On characterizing ribbons and finding skewed symmetries , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[8]  M. Leyton Symmetry, Causality, Mind , 1999 .

[9]  James L. McClelland,et al.  B-Spline Contour Representation and Symmetry Detection , 1993 .

[10]  Tat-Jen Cham,et al.  Skewed Symmetry Detection Through Local Skewed Symmetries , 1994, BMVC.

[11]  Tat-Jen Cham,et al.  Geometric Saliency of Curve Correspondances and Grouping of Symmetric Comntours , 1996, ECCV.

[12]  Antti Ylä-Jääski,et al.  Grouping Symmetrical Structures for Object Segmentation and Description , 1996, Comput. Vis. Image Underst..

[13]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Alan L. Yuille,et al.  Segmenting by seeking the symmetry axis , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[15]  Ali Shokoufandeh,et al.  View-based object recognition using saliency maps , 1999, Image Vis. Comput..

[16]  Kaleem Siddiqi,et al.  Matching Hierarchical Structures Using Association Graphs , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  C. Tyler Human Symmetry Perception and Its Computational Analysis , 2002 .

[19]  Shimon Ullman,et al.  Class-Specific, Top-Down Segmentation , 2002, ECCV.

[20]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[21]  Lars Bretzner,et al.  Real-Time Scale Selection in Hybrid Multi-scale Representations , 2003, Scale-Space.

[22]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[23]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[24]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jitendra Malik,et al.  Cue Integration for Figure/Ground Labeling , 2005, NIPS.

[26]  David A. McAllester,et al.  A Min-Cover Approach for Finding Salient Curves , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[27]  M. Fatih Demirci,et al.  The representation and matching of categorical shape , 2006, Comput. Vis. Image Underst..

[28]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[29]  Kaleem Siddiqi,et al.  Medial Representations: Mathematics, Algorithms and Applications , 2008 .

[30]  Song Wang,et al.  Globally Optimal Grouping for Symmetric Closed Boundaries by Combining Boundary and Region Information , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Yanxi Liu,et al.  Curved glide-reflection symmetry detection , 2009, CVPR.

[32]  Sven J. Dickinson,et al.  Object Categorization: The Evolution of Object Categorization and the Challenge of Image Abstraction , 2009 .

[33]  M. Fatih Demirci,et al.  Skeletal Shape Abstraction from Examples , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Sven J. Dickinson,et al.  Multiscale Symmetric Part Detection and Grouping , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[35]  Dhiraj Joshi,et al.  Object Categorization: Computer and Human Vision Perspectives , 2008 .

[36]  Sven J. Dickinson,et al.  Bone graphs: Medial shape parsing and abstraction , 2011, Comput. Vis. Image Underst..

[37]  Sven J. Dickinson,et al.  Object categorization using bone graphs , 2011, Comput. Vis. Image Underst..

[38]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[39]  Sven J. Dickinson,et al.  Optimal Image and Video Closure by Superpixel Grouping , 2012, International Journal of Computer Vision.

[40]  Cristian Sminchisescu,et al.  CPMC: Automatic Object Segmentation Using Constrained Parametric Min-Cuts , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Iasonas Kokkinos,et al.  Learning-Based Symmetry Detection in Natural Images , 2012, ECCV.

[42]  Benjamin B. Kimia,et al.  Bottom-Up Perceptual Organization of Images into Object Part Hypotheses , 2012, ECCV.

[43]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[44]  Sven J. Dickinson,et al.  The Role of Mid-Level Shape Priors in Perceptual Grouping and Image Abstraction , 2013, Shape Perception in Human and Computer Vision.

[45]  Sven J. Dickinson,et al.  Detecting Curved Symmetric Parts Using a Deformable Disc Model , 2013, 2013 IEEE International Conference on Computer Vision.

[46]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Sanja Fidler,et al.  Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation , 2014, ArXiv.

[48]  Sven J. Dickinson,et al.  Multi-cue Mid-level Grouping , 2014, ACCV.

[49]  W. Walthen-Dunn A Transformation for Extracting New De scriptors of Shape ' , in , 2017 .