A Graph Matching Approach to Symmetry Detection and Analysis

Spectral relaxation was shown to provide an efficient approach for solving a gamut of computational problems, ranging from data mining to image registration. In this chapter we show that in the context of graph matching, spectral relaxation can be applied to the detection and analysis of symmetries in n-dimensions. First, we cast symmetry detection of a set of points in ℝ n as the self-alignment of the set to itself. Thus, by representing an object by a set of points S ∈ ℝ n , symmetry is manifested by multiple self-alignments. Secondly, we formulate the alignment problem as a quadratic binary optimization problem, solved efficiently via spectral relaxation. Thus, each eigenvalue corresponds to a potential self-alignment, and eigenvalues with multiplicity greater than one correspond to symmetric self-alignments. The corresponding eigenvectors reveal the point alignment and pave the way for further analysis of the recovered symmetry. We apply our approach to image analysis, by using local features to represent each image as a set of points. Last, we improve the scheme’s robustness by inducing geometrical constraints on the spectral analysis results. Our approach is verified by extensive experiments and was applied to two and three dimensional synthetic and real life images.

[1]  Jiri Matas,et al.  Efficient Symmetry Detection Using Local Affine Frames , 2007, SCIA.

[2]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[4]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  H. C. Longuet-Higgins,et al.  An algorithm for associating the features of two images , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[8]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[9]  Leszek Wojnar,et al.  Image Analysis , 1998 .

[10]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[12]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Nahum Kiryati,et al.  Detecting Symmetry in Grey Level Images: The Global Optimization Approach , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[14]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[15]  Hai Tao,et al.  Object tracking with dynamic feature graph , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[16]  Bernard Chazelle,et al.  A Reflective Symmetry Descriptor , 2002, ECCV.

[17]  W. Miller Symmetry groups and their applications , 1972 .

[18]  Bayya Yegnanarayana,et al.  Finding axes of symmetry from potential fields , 2004, IEEE Transactions on Image Processing.

[19]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[20]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[21]  Dinggang Shen,et al.  Robust detection of skewed symmetries by combining local and semi-local affine invariants , 2001, Pattern Recognit..

[22]  H. Coxeter,et al.  Introduction to Geometry , 1964, The Mathematical Gazette.

[23]  Yanxi Liu,et al.  Rotation symmetry group detection via frequency analysis of frieze-expansions , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Mads Nielsen,et al.  Computer Vision — ECCV 2002 , 2002, Lecture Notes in Computer Science.

[25]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[27]  Kok Cheong Wong,et al.  Detection and localisation of reflectional and rotational symmetry under weak perspective projection , 1999, Pattern Recognit..

[28]  Si-Duo Chen,et al.  Extraction of local mirror-symmetric feature by odd-even decomposition , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[29]  Alexei A. Efros,et al.  Discovering Texture Regularity as a Higher-Order Correspondence Problem , 2006, ECCV.

[30]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  P Wenderoth,et al.  Detection of Bilateral Symmetry in Complex Biological Images , 2000, Perception.

[32]  François X. Sillion,et al.  Accurate detection of symmetries in 3D shapes , 2006, TOGS.

[33]  Luca Lucchese,et al.  Frequency domain classification of cyclic and dihedral symmetries of finite 2-D patterns , 2004, Pattern Recognit..

[34]  Larry S. Davis,et al.  Detecting rotational symmetries , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[35]  Yehoshua Y. Zeevi,et al.  The farthest point strategy for progressive image sampling , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 2 - Conference B: Computer Vision & Image Processing. (Cat. No.94CH3440-5).

[36]  Richard Szeliski,et al.  Video and Image Bayesian Demosaicing with a Two Color Image Prior , 2006, ECCV.

[37]  Andrew Zisserman,et al.  A Visual Vocabulary for Flower Classification , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[38]  Yoel Shkolnisky,et al.  A signal processing approach to symmetry detection , 2006, IEEE Transactions on Image Processing.

[39]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[40]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[41]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[42]  Axel Pinz,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[43]  Faouzi Ghorbel,et al.  Shape analysis and symmetry detection in gray-level objects using the analytical Fourier-Mellin representation , 2004, Signal Process..

[44]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Yanxi Liu,et al.  Performance evaluation of state-of-the-art discrete symmetry detection algorithms , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Whoi-Yul Kim,et al.  Robust Rotation Angle Estimator , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .