Newton Algorithms for Riemannian Distance Related Problems on Connected Locally Symmetric Manifolds

The squared distance function is one of the standard functions on which an optimization algorithm is commonly run, whether it is used directly or chained with other functions. Illustrative examples include center of mass computation, implementation of k-means algorithm and robot positioning. This function can have a simple expression (as in the Euclidean case), or it might not even have a closed form expression. Nonetheless, when used in an optimization problem formulated on non-Euclidean manifolds, the appropriate (intrinsic) version must be used and depending on the algorithm, its gradient and/or Hessian must be computed. For many commonly used manifolds a way to compute the intrinsic distance is available as well as its gradient, the Hessian however is usually a much more involved process, rendering Newton methods unusable on many standard manifolds. This article presents a way of computing the Hessian on connected locally-symmetric spaces on which standard Riemannian operations are known (exponential map, logarithm map and curvature). Although not a requirement for the result, describing the manifold as naturally reductive homogeneous spaces, a special class of manifolds, provides a way of computing these functions. The main example focused in this article is centroid computation of a finite constellation of points on connected locally symmetric manifolds since it is directly formulated as an intrinsic squared distance optimization problem. Simulation results shown here confirm the quadratic convergence rate of a Newton algorithm on commonly used manifolds such as the sphere, special orthogonal group, special Euclidean group, symmetric positive definite matrices, Grassmann manifold and projective space.

[1]  Andreas Arvanitoyeorgos,et al.  An Introduction to Lie Groups and the Geometry of Homogeneous Spaces , 2003 .

[2]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[3]  John M. Lee Riemannian Manifolds: An Introduction to Curvature , 1997 .

[4]  P. Absil,et al.  Riemannian Geometry of Grassmann Manifolds with a View on Algorithmic Computation , 2004 .

[5]  W. Boothby An introduction to differentiable manifolds and Riemannian geometry , 1975 .

[6]  P. Thomas Fletcher,et al.  Principal geodesic analysis for the study of nonlinear statistics of shape , 2004, IEEE Transactions on Medical Imaging.

[7]  K. Huper,et al.  Newton-like methods for numerical optimization on manifolds , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[8]  José M. F. Moura,et al.  Affine-permutation symmetry: invariance and shape space , 2003, IEEE Workshop on Statistical Signal Processing, 2003.

[9]  D. Gabay Minimizing a differentiable function over a differential manifold , 1982 .

[10]  H. Karcher Riemannian center of mass and mollifier smoothing , 1977 .

[11]  Calin Belta,et al.  An SVD-based projection method for interpolation on SE(3) , 2002, IEEE Trans. Robotics Autom..

[12]  David Groisser Newton's method, zeroes of vector fields, and the Riemannian center of mass , 2004, Adv. Appl. Math..

[13]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[14]  João M. F. Xavier,et al.  Newton Method for Riemannian Centroid Computation in Naturally Reductive Homogeneous Spaces , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[15]  Jonathan H. Manton,et al.  Optimization algorithms exploiting unitary constraints , 2002, IEEE Trans. Signal Process..

[16]  Feng Ye Semi-Riemannian Geometry , 2011 .

[17]  Maher Moakher,et al.  To appear in: SIAM J. MATRIX ANAL. APPL. MEANS AND AVERAGING IN THE GROUP OF ROTATIONS∗ , 2002 .

[18]  J. Xavier,et al.  HESSIAN OF THE RIEMANNIAN SQUARED DISTANCE FUNCTION ON CONNECTED LOCALLY SYMMETRIC SPACES WITH APPLICATIONS , 2006 .

[19]  Ilka Agricola,et al.  Connections on Naturally Reductive Spaces, Their Dirac Operator and Homogeneous Models in String Theory , 2002, math/0202094.

[20]  Jonathan H. Manton,et al.  A centroid (Karcher mean) approach to the joint approximate diagonalisation problem: The real symmetric case , 2006, Digit. Signal Process..

[21]  Jonathan H. Manton,et al.  A globally convergent numerical algorithm for computing the centre of mass on compact Lie groups , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[22]  B. Afsari Riemannian Lp center of mass: existence, uniqueness, and convexity , 2011 .

[23]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[24]  K. Hüper,et al.  On the Computation of the Karcher Mean on Spheres and Special Orthogonal Groups , 2007 .

[25]  John B. Moore,et al.  Essential Matrix Estimation via Newton-type Methods , 2004 .

[26]  J. Eschenburg Comparison Theorems in Riemannian Geometry , 1994 .

[27]  Harald Haas,et al.  Asilomar Conference on Signals, Systems, and Computers , 2006 .

[28]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.