ar 2 01 8 John ’ s Walk

We present an affine-invariant random walk for drawing uniform random samples from a convex body K Ă Rn for which the maximum volume inscribed ellipsoid, known as John’s ellipsoid, may be computed. We consider a polytope P “ x P Rn ˇ̌ Ax ď 1 ( where A P R as a special case. Our algorithm makes steps using uniform sampling from the John’s ellipsoid of the symmetrization of K at the current point. We show that from a warm start, the random walk mixes in r Opnq steps where the log factors depend only on constants determined by the warm start and error parameters (and not on the dimension or number of constraints defining the body). This sampling algorithm thus offers improvement over the affine-invariant Dikin Walk for polytopes [KN12, Nar16] (which mixes in r Opmnq steps from a warm start) for applications in which m " n. Furthermore, we describe an r Opmn ` nq algorithm for finding a suitably approximate John’s ellipsoid for a symmetric polytope based on Vaidya’s algorithm [Vai96, Ans97], and show the mixing time is retained using these approximate ellipsoids.

[1]  P. Gruber Minimal ellipsoids and their duals , 1988 .

[2]  K. Ball Ellipsoids of maximal volume in convex bodies , 1990, math/9201217.

[3]  Miklós Simonovits,et al.  Random Walks in a Convex Body and an Improved Volume Algorithm , 1993, Random Struct. Algorithms.

[4]  Pravin M. Vaidya,et al.  A new algorithm for minimizing convex functions over convex sets , 1996, Math. Program..

[5]  M. Simonovits,et al.  Random walks and an O * ( n 5 ) volume algorithm for convex bodies , 1997 .

[6]  Kurt M. Anstreicher On Vaidya's Volumetric Cutting Plane Method for Convex Programming , 1997, Math. Oper. Res..

[7]  K. Ball An Elementary Introduction to Modern Convex Geometry , 1997 .

[8]  Stephen P. Boyd,et al.  Determinant Maximization with Linear Matrix Inequality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[9]  László Lovász,et al.  Hit-and-run mixes fast , 1999, Math. Program..

[10]  Kurt M. Anstreicher,et al.  Improved Complexity for Maximum Volume Inscribed Ellipsoids , 2002, SIAM J. Optim..

[11]  S. Vempala,et al.  Hit-and-Run from a Corner , 2006 .

[12]  S. Vempala,et al.  The geometry of logconcave functions and sampling algorithms , 2007 .

[13]  James Demmel,et al.  Fast linear algebra is stable , 2006, Numerische Mathematik.

[14]  Hariharan Narayanan,et al.  Randomized Interior Point methods for Sampling and Optimization , 2009, ArXiv.

[15]  Hariharan Narayanan,et al.  Random Walks on Polytopes and an Affine Interior Point Method for Linear Programming , 2012, Math. Oper. Res..

[16]  A. Davie,et al.  Improved bound for complexity of matrix multiplication , 2013, Proceedings of the Royal Society of Edinburgh: Section A Mathematics.

[17]  François Le Gall,et al.  Powers of tensors and fast matrix multiplication , 2014, ISSAC.

[18]  F. John Extremum Problems with Inequalities as Subsidiary Conditions , 2014 .

[19]  Yin Tat Lee,et al.  A Faster Cutting Plane Method and its Implications for Combinatorial and Convex Optimization , 2015, 2015 IEEE 56th Annual Symposium on Foundations of Computer Science.

[20]  Y. Lee Faster algorithms for convex and combinatorial optimization , 2016 .

[21]  Sébastien Bubeck,et al.  Sampling from a Log-Concave Distribution with Projected Langevin Monte Carlo , 2015, Discrete & Computational Geometry.

[22]  Martin J. Wainwright,et al.  Fast MCMC Sampling Algorithms on Polytopes , 2017, J. Mach. Learn. Res..