Distributions of angles in random packing on spheres

This paper studies the asymptotic behaviors of the pairwise angles among n randomly and uniformly distributed unit vectors in [Formula: see text] as the number of points n → ∞, while the dimension p is either fixed or growing with n. For both settings, we derive the limiting empirical distribution of the random angles and the limiting distributions of the extreme angles. The results reveal interesting differences in the two settings and provide a precise characterization of the folklore that "all high-dimensional random vectors are almost always nearly orthogonal to each other". Applications to statistics and machine learning and connections with some open problems in physics and mathematics are also discussed.

[1]  J. Hammersley.  The Distribution of Distance in a Hypersphere , 1950 .

[2]  R. Lord.  The Distribution of Distance in a Hypersphere , 1954 .

[3]  V. Alagar.  The distribution of the distance between random points , 1976, Journal of Applied Probability.

[4]  S. Lang.  Complex Analysis , 1977 .

[5]  L. Ahlfors.  Complex Analysis , 1979 .

[6]  R. Muirhead.  Aspects of Multivariate Statistical Theory , 1982, Wiley Series in Probability and Statistics.

[7]  D. Freedman,et al.  Asymptotics of Graphical Projection Pursuit , 1984 .

[8]  S. Resnick.  Extreme Values, Regular Variation, and Point Processes , 1987 .

[9]  S. Kotz,et al.  Symmetric Multivariate and Related Distributions , 1989 .

[10]  L. Gordon,et al.  Two moments su ce for Poisson approx-imations: the Chen-Stein method , 1989 .

[11]  E. Saff,et al.  Asymptotics for minimal discrete energy on the sphere , 1995 .

[12]  T. Mattfeldt.  Stochastic Geometry and Its Applications , 1996 .

[13]  S. Smale.  Mathematical problems for the next century , 1998 .

[14]  M. Ledoux.  The concentration of measure phenomenon , 2001 .

[15]  M. Williams.  On a probability distribution function arising in stochastic neutron transport theory , 2001 .

[16]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[17]  J. Dall,et al.  Random geometric graphs. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  S. Tu,et al.  Random distance distribution for spherical objects: general theory and applications to physics , 2002, math-ph/0201046.

[19]  Mehrdad Shahshahani,et al.  Distributing Points on the Sphere, I , 2003, Exp. Math..

[20]  Tiefeng Jiang,et al.  The asymptotic distributions of the largest entries of sample correlation matrices , 2004, math/0406184.

[21]  R. García-Pelayo.  Distribution of distance in the spheroid , 2005 .

[22]  J. S. Marron,et al.  Geometric representation of high dimension, low sample size data , 2005 .

[23]  Jianqing Fan,et al.  Sure independence screening for ultrahigh dimensional feature space , 2006, math/0612857.

[24]  Deli Li,et al.  Some strong limit theorems for the largest entries of sample correlation matrices , 2006, math/0603334.

[25]  Wang Zhou.  Asymptotic distribution of the largest off-diagonal entry of correlation matrices , 2007 .

[26]  Jeffrey S. Morris,et al.  Sure independence screening for ultrahigh dimensional feature space Discussion , 2008 .

[27]  Q. Shao,et al.  THE ASYMPTOTIC DISTRIBUTION AND BERRY-ESSEEN BOUND OF A NEW TEST FOR INDEPENDENCE IN HIGH DIMENSION WITH AN APPLICATION TO STOCHASTIC OPTIMIZATION , 2008, 0901.2468.

[28]  P. Bickel,et al.  SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR , 2008, 0801.1095.

[29]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[30]  W. Kendall,et al.  New Perspectives in Stochastic Geometry , 2010 .

[31]  Weidong Liu,et al.  Necessary and sufficient conditions for the asymptotic distribution of the largest entry of a sample correlation matrix , 2010 .

[32]  G. Lugosi,et al.  High-dimensional random geometric graphs and their clique number , 2011 .

[33]  T. Cai,et al.  Limiting laws of coherence of random matrices with applications to testing covariance structure and construction of compressed sensing matrices , 2011, 1102.2925.

[34]  M. Shub,et al.  Minimizing the discrete logarithmic energy on the sphere: The role of random polynomials , 2011 .

[35]  A. Tsybakov,et al.  High-dimensional instrumental variables regression and confidence sets -- v2/2012 , 2018, 1812.11330.

[36]  Andrew Rosalsky,et al.  On Jiang's asymptotic distribution of the largest entry of a sample correlation matrix , 2010, J. Multivar. Anal..

[37]  Jianqing Fan,et al.  Variance estimation using refitted cross‐validation in ultrahigh dimensional regression , 2010, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[38]  Tiefeng Jiang,et al.  Circular law and arc law for truncation of random unitary matrix , 2012 .

[39]  T. Tony Cai,et al.  Phase transition in limiting distributions of coherence of high-dimensional random matrices , 2011, J. Multivar. Anal..

[40]  J. Marron,et al.  Surprising Asymptotic Conical Structure in Critical Sample Eigen-Directions , 2013, 1303.6171.

[41]  G. Lugosi,et al.  Detecting Positive Correlations in a Multivariate Sample , 2012, 1202.5536.