A Symmetry Preserving Singular Value Decomposition

A reduced order representation of a large data set is often realized through a principal component analysis based upon a singular value decomposition (SVD) of the data. The left singular vectors of a truncated SVD provide the reduced basis. In several applications such as facial analysis and protein dynamics, structural symmetry is inherent in the data. Typically, reflective or rotational symmetry is expected to be present in these applications. In protein dynamics, determining this symmetry allows one to provide SVD major modes of motion that best describe the symmetric movements of the protein. In face detection, symmetry in the SVD allows for more efficient compression algorithms. Here we present a method to compute the plane of reflective symmetry or the axis of rotational symmetry of a large set of points. Moreover, we develop a symmetry preserving singular value decomposition (SPSVD) that best approximates the given set while respecting the symmetry. Interesting subproblems arise in the presence of noisy data or in situations where most, but not all, of the structure is symmetric. An important part of the determination of the axis of rotational symmetry or the plane of reflective symmetry is an iterative reweighting scheme. This scheme is rapidly convergent in practice and seems to be very effective in ignoring outliers (points that do not respect the symmetry).

[1]  Alston S. Householder,et al.  Unitary Triangularization of a Nonsymmetric Matrix , 1958, JACM.

[2]  Kiyoshi Kato,et al.  Three-Dimensional Symmetry Identification Part III : Experimental Results , 1992 .

[3]  S. SIAMJ.,et al.  SYMMETRY AND THE KARHUNEN–LOÈVE ANALYSIS , 2007 .

[4]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[5]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Danny C. Sorensen,et al.  Simulating nanoscale functional motions of biomolecules , 2006 .

[7]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[8]  Lydia E. Kavraki,et al.  Singular Value Decomposition of Protein Conformational Motions: Application to HIV-1 Protease , 2000 .

[9]  P. Eades Symmetry Finding Algorithms , 1988 .

[10]  Bernard Chazelle,et al.  A Reflective Symmetry Descriptor for 3D Models , 2003, Algorithmica.

[11]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  N. S. Barnett,et al.  Private communication , 1969 .

[13]  D. O'Mara,et al.  Measuring bilateral symmetry in digital images , 1996, Proceedings of Digital Processing Applications (TENCON '96).

[14]  Matthew Brand,et al.  Incremental Singular Value Decomposition of Uncertain Data with Missing Values , 2002, ECCV.

[15]  J. Tukey,et al.  The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data , 1974 .

[16]  J. Bunch,et al.  Rank-one modification of the symmetric eigenproblem , 1978 .

[17]  Roberto Marcondes Cesar Junior,et al.  Approximate reflectional symmetries of fuzzy objects with an application in model-based object recognition , 2004, Fuzzy Sets Syst..

[18]  Isabelle Bloch,et al.  Brain symmetry plane computation in MR images using inertia axes and optimization , 2002, Object recognition supported by user interaction for service robots.

[19]  Seiji Ishikawa,et al.  Symmetry Identification of a 3-D Object Represented by Octree , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Lubert Stryer,et al.  Protein structure and function , 2005, Experientia.

[21]  Emeka Nkenke,et al.  The Symmetry of Faces , 2002, VMV.

[22]  S. Altmann Rotations, Quaternions, and Double Groups , 1986 .

[23]  Lowell H. Hall,et al.  Group theory and symmetry in chemistry , 1969 .

[24]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[25]  Kiyoshi Kato,et al.  Three-Dimensional Symmetry Identification Part I : Theory , 1992 .

[26]  H. Bülthoff,et al.  Face recognition under varying poses: The role of texture and shape , 1996, Vision Research.

[27]  J. Stillwell,et al.  Symmetry , 2000, Am. Math. Mon..

[28]  Christopher Grover Baker Block Incremental Algorithm for Computing Dominant Singular Subspaces , 2004 .

[29]  Changming Sun,et al.  3D Symmetry Detection Using The Extended Gaussian Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Mikhail J. Atallah,et al.  On Symmetry Detection , 1985, IEEE Transactions on Computers.

[31]  Nadine Aubry,et al.  Preserving Symmetries in the Proper Orthogonal Decomposition , 1993, SIAM J. Sci. Comput..

[32]  H. Goldstein,et al.  Classical Mechanics , 1951, Mathematical Gazette.

[33]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[34]  Chao Yang,et al.  ARPACK users' guide - solution of large-scale eigenvalue problems with implicitly restarted Arnoldi methods , 1998, Software, environments, tools.

[35]  J. W. Humberston Classical mechanics , 1980, Nature.

[36]  Dusanka Janezic,et al.  Harmonic analysis of large systems. III. Comparison with molecular dynamics , 1995, J. Comput. Chem..

[37]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[38]  Tamara G. Kolda,et al.  Optimization by Direct Search: New Perspectives on Some Classical and Modern Methods , 2003, SIAM Rev..

[39]  V. Smirnov,et al.  Linear algebra and group theory , 1961 .

[40]  Giovanni Marola,et al.  On the Detection of the Axes of Symmetry of Symmetric and Almost Symmetric Planar Images , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  H. Berendsen,et al.  Essential dynamics of proteins , 1993, Proteins.

[42]  Kiyoshi Kato,et al.  Three-Dimensional Symmetry Identification Part II : General Algorithm and its Application to Medical Images , 1992 .

[43]  K. Schulten,et al.  Principal Component Analysis and Long Time Protein Dynamics , 1996 .

[44]  T. Mckeown Mechanics , 1970, The Mathematics of Fluid Flow Through Porous Media.

[45]  H. O. Foulkes Abstract Algebra , 1967, Nature.

[46]  Shmuel Peleg,et al.  Continuous symmetry measures , 1992 .

[47]  Dieter Armbruster,et al.  Timely Communication: Symmetry and the Karhunen-Loève Analysis , 1997, SIAM J. Sci. Comput..

[48]  Lydia E. Kavraki,et al.  On Flexible Docking Using Expansive Search , 2005 .

[49]  Joe Rosen Symmetry in science : an introduction to the general theory , 1995 .