Optimizing the Coupling Between Two Isometric Projections of Matrices

In this paper, we analyze the coupling between the isometric projections of two square matrices. These two matrices of dimensions $m\times m$ and $n\times n$ are restricted to a lower $k$-dimensional subspace under isometry constraints. We maximize the coupling between these isometric projections expressed as the trace of the product of the projected matrices. First we connect this problem to notions such as the generalized numerical range, the field of values, and the similarity matrix. We show that these concepts are particular cases of our problem for special choices of $m$, $n$, and $k$. The formulation used here applies to both real and complex matrices. We characterize the objective function, its critical points, and its optimal value for Hermitian and normal matrices, and, finally, give upper and lower bounds for the general case. An iterative algorithm based on the singular value decomposition is proposed to solve the optimization problem.

[1]  Franz Rendl,et al.  Applications of parametric programming and eigenvalue maximization to the quadratic assignment problem , 1992, Math. Program..

[2]  Terry Caelli,et al.  An eigenspace projection clustering method for inexact graph matching , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  R. Brockett Dynamical systems that sort lists, diagonalize matrices, and solve linear programming problems , 1991 .

[4]  Chi-Kwong Li,et al.  C-numerical ranges and C-numerical radii , 1994 .

[5]  Chi-Kwong Li,et al.  Multiplicative Preservers of C-Numerical Ranges and Radii , 2004 .

[6]  Paul Van Dooren,et al.  A MEASURE OF SIMILARITY BETWEEN GRAPH VERTICES . WITH APPLICATIONS TO SYNONYM EXTRACTION AND WEB SEARCHING , 2002 .

[7]  R. Westwick,et al.  A theorem on numerical range , 1975 .

[8]  Moshe Goldberg,et al.  Elementary inclusion relations for generalized numerical ranges , 1977 .

[9]  Nam-Kiu Tsing,et al.  The C-numerical range of matrices is star-shaped , 1996 .

[10]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[11]  S. Glaser,et al.  Unitary control in quantum ensembles: maximizing signal intensity in coherent spectroscopy , 1998, Science.

[12]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[13]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[14]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[15]  Chi-Kwong Li,et al.  A Lower Bound on the C-Numerical Radius of Nilpotent Matrices Appearing in Coherent Spectroscopy , 2005, SIAM J. Matrix Anal. Appl..

[16]  Franz Rendl,et al.  Semidefinite Programming Relaxations for the Quadratic Assignment Problem , 1998, J. Comb. Optim..

[17]  John B. Moore,et al.  Gradient Flows Computing the C-numerical Range with Applications in NMR Spectroscopy , 2002, J. Glob. Optim..

[18]  R. Brockett,et al.  Dynamical systems that sort lists, diagonalize matrices and solve linear programming problems , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[19]  Chi-Kwong Li,et al.  Norms that are invariant under unitary similarities and the C-numerical radii , 1989 .

[20]  Henry Wolkowicz,et al.  On Lagrangian Relaxation of Quadratic Matrix Constraints , 2000, SIAM J. Matrix Anal. Appl..

[21]  U. Helmke,et al.  Optimization and Dynamical Systems , 1994, Proceedings of the IEEE.