On the Computability of Continuous Maximum Entropy Distributions: Adjoint Orbits of Lie Groups

Given a point $A$ in the convex hull of a given adjoint orbit $\mathcal{O}(F)$ of a compact Lie group $G$, we give a polynomial time algorithm to compute the probability density supported on $\mathcal{O}(F)$ whose expectation is $A$ and that minimizes the Kullback-Leibler divergence to the $G$-invariant measure on $\mathcal{O}(F)$. This significantly extends the recent work of the authors (STOC 2020) who presented such a result for the manifold of rank $k$-projections which is a specific adjoint orbit of the unitary group $\mathrm{U}(n)$. Our result relies on the ellipsoid method-based framework proposed in prior work; however, to apply it to the general setting of compact Lie groups, we need tools from Lie theory. For instance, properties of the adjoint representation are used to find the defining equalities of the minimal affine space containing the convex hull of $\mathcal{O}(F)$, and to establish a bound on the optimal dual solution. Also, the Harish-Chandra integral formula is used to obtain an evaluation oracle for the dual objective function. While the Harish-Chandra integral formula allows us to write certain integrals over the adjoint orbit of a Lie group as a sum of a small number of determinants, it is only defined for elements of a chosen Cartan subalgebra of the Lie algebra $\mathfrak{g}$ of $G.$ We show how it can be applied to our setting with the help of Kostant's convexity theorem. Further, the convex hull of an adjoint orbit is a type of orbitope, and the orbitopes studied in this paper are known to be spectrahedral. Thus our main result can be viewed as extending the maximum entropy framework to a class of spectrahedra.

[1]  Colin S. McSwiggen The Harish-Chandra integral , 2018 .

[2]  Grigoriy Blekherman,et al.  Convex geometry of orbits. , 2003, math/0312268.

[3]  B. Hall Lie Groups, Lie Algebras, and Representations: An Elementary Introduction , 2004 .

[4]  Avi Wigderson,et al.  Efficient Algorithms for Tensor Scaling, Quantum Marginals, and Moment Polytopes , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[5]  A. Baker Matrix Groups: An Introduction to Lie Group Theory , 2003 .

[6]  Harish-Chandra Differential Operators on a Semisimple Lie Algebra , 1957 .

[7]  Nisheeth K. Vishnoi,et al.  On the computability of continuous maximum entropy distributions with applications , 2020, STOC.

[8]  Peter Bürgisser,et al.  Towards a Theory of Non-Commutative Optimization: Geodesic 1st and 2nd Order Methods for Moment Maps and Polytopes , 2019, 2019 IEEE 60th Annual Symposium on Foundations of Computer Science (FOCS).

[9]  Avi Wigderson,et al.  A Deterministic Polynomial Time Algorithm for Non-commutative Rational Identity Testing , 2015, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[10]  B. Kostant On convexity, the Weyl group and the Iwasawa decomposition , 1973 .

[11]  Nikhil Srivastava,et al.  Finite free convolutions of polynomials , 2015, Probability Theory and Related Fields.

[12]  Mohit Singh,et al.  Entropy, optimization and counting , 2013, STOC.

[13]  Claus Scheiderer,et al.  Spectrahedral representation of polar orbitopes , 2021, manuscripta mathematica.

[14]  C. Itzykson The planar approximation , 1980 .

[15]  M Vergne Convex polytopes and quantization of symplectic manifolds. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Matthias Christandl,et al.  Eigenvalue Distributions of Reduced Density Matrices , 2012, 1204.0741.

[17]  On the Kostant convexity theorem , 1992 .

[18]  Peter Bürgisser,et al.  Interior-point methods for unconstrained geometric programming and scaling problems , 2020, ArXiv.

[19]  R. Gilmore Lie Groups, Physics, and Geometry: An Introduction for Physicists, Engineers and Chemists , 2008 .

[20]  C. Itzykson,et al.  The planar approximation. II , 1980 .

[21]  Leonardo Biliotti,et al.  Coadjoint orbitopes , 2011, 1110.6039.

[22]  J. Duistermaat,et al.  On the variation in the cohomology of the symplectic form of the reduced phase space , 1982 .

[23]  Polar orbitopes , 2012, 1206.5717.

[24]  Avi Wigderson,et al.  Algorithmic and optimization aspects of Brascamp-Lieb inequalities, via Operator Scaling , 2016, Geometric and Functional Analysis.

[25]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[26]  Pablo A. Parrilo,et al.  Semidefinite Descriptions of the Convex Hull of Rotation Matrices , 2014, SIAM J. Optim..

[27]  A. W. Knapp Lie groups beyond an introduction , 1988 .

[28]  Tim Kobert Spectrahedral and semidefinite representability of orbitopes , 2019 .

[29]  M. Audin Torus Actions on Symplectic Manifolds , 1991 .