Spectral Symmetry Analysis

We present a spectral approach for detecting and analyzing rotational and reflectional symmetries in n-dimensions. Our main contribution is the derivation of a symmetry detection and analysis scheme for sets of points IRn and its extension to image analysis by way of local features. Each object is represented by a set of points S ∈ IRn, where the symmetry is manifested by the multiple self-alignments of S . The alignment problem is formulated as a quadratic binary optimization problem, with an efficient solution via spectral relaxation. For symmetric objects, this results in a multiplicity of eigenvalues whose corresponding eigenvectors allow the detection and analysis of both types of symmetry. We improve the scheme's robustness by incorporating geometrical constraints into the spectral analysis. Our approach is experimentally verified by applying it to 2D and 3D synthetic objects as well as real images.

[1]  Faouzi Ghorbel,et al.  Shape analysis and symmetry detection in gray-level objects using the analytical Fourier-Mellin representation , 2004, Signal Process..

[2]  Bayya Yegnanarayana,et al.  Finding axes of symmetry from potential fields , 2004, IEEE Transactions on Image Processing.

[3]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Jiri Matas,et al.  Efficient Symmetry Detection Using Local Affine Frames , 2007, SCIA.

[5]  Yanxi Liu,et al.  Performance evaluation of state-of-the-art discrete symmetry detection algorithms , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[7]  H. C. Longuet-Higgins,et al.  An algorithm for associating the features of two images , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[8]  Dinggang Shen,et al.  Robust detection of skewed symmetries by combining local and semi-local affine invariants , 2001, Pattern Recognit..

[9]  François X. Sillion,et al.  Accurate detection of symmetries in 3D shapes , 2006, TOGS.

[10]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[11]  Alexei A. Efros,et al.  Discovering Texture Regularity as a Higher-Order Correspondence Problem , 2006, ECCV.

[12]  P. Lockhart,et al.  Introduction to Geometry , 1940, The Mathematical Gazette.

[13]  Yehoshua Y. Zeevi,et al.  The farthest point strategy for progressive image sampling , 1997, IEEE Trans. Image Process..

[14]  Luca Lucchese,et al.  Frequency domain classification of cyclic and dihedral symmetries of finite 2-D patterns , 2004, Pattern Recognit..

[15]  Si-Duo Chen,et al.  Extraction of local mirror-symmetric feature by odd-even decomposition , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[16]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[19]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[20]  Bernard Chazelle,et al.  A Reflective Symmetry Descriptor , 2002, ECCV.

[21]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[22]  Whoi-Yul Kim,et al.  Robust Rotation Angle Estimator , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Yoel Shkolnisky,et al.  A signal processing approach to symmetry detection , 2006, IEEE Transactions on Image Processing.

[24]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[25]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[28]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[29]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[30]  Larry S. Davis,et al.  Detecting rotational symmetries , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[31]  Kok Cheong Wong,et al.  Detection and localisation of reflectional and rotational symmetry under weak perspective projection , 1999, Pattern Recognit..

[32]  W. Miller.  Symmetry groups and their applications , 1972 .

[33]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[34]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[35]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[36]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[38]  Andrew Zisserman,et al.  A Visual Vocabulary for Flower Classification , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[39]  Yanxi Liu,et al.  Rotation symmetry group detection via frequency analysis of frieze-expansions , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  ZhangJ.,et al.  Local Features and Kernels for Classification of Texture and Object Categories , 2007 .

[41]  Nahum Kiryati,et al.  Detecting Symmetry in Grey Level Images: The Global Optimization Approach , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[42]  Hai Tao,et al.  Object tracking with dynamic feature graph , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.