Products of Many Large Random Matrices and Gradients in Deep Neural Networks

[1]  Dang-Zheng Liu,et al.  Lyapunov Exponent, Universality and Phase Transition for Products of Random Matrices , 2018, Communications in Mathematical Physics.

[2]  Z. Burda,et al.  From integrable to chaotic systems: Universal local statistics of Lyapunov exponents , 2018, EPL (Europhysics Letters).

[3]  Gregorio R. Moreno Flores,et al.  Random polymers on the complete graph , 2017, Bernoulli.

[4]  Surya Ganguli,et al.  The Emergence of Spectral Universality in Deep Networks , 2018, AISTATS.

[5]  Boris Hanin,et al.  Which Neural Net Architectures Give Rise To Exploding and Vanishing Gradients? , 2018, NeurIPS.

[6]  Jeffrey Pennington,et al.  Nonlinear random matrix theory for deep learning , 2019, NIPS.

[7]  Surya Ganguli,et al.  Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice , 2017, NIPS.

[8]  Percy Deift,et al.  Some Open Problems in Random Matrix Theory and the Theory of Integrable Systems. II , 2007, 1703.04931.

[9]  Jaehoon Lee,et al.  3d N=2$$ \mathcal{N}=2 $$ minimal SCFTs from wrapped M5-branes , 2016, 1610.09259.

[10]  Roland Speicher,et al.  Free Probability and Random Matrices , 2014, 1404.3393.

[11]  Jordan S. Cotler,et al.  Black holes and random matrices , 2016, 1611.04650.

[12]  J. R. Ipsen,et al.  RECENT EXACT AND ASYMPTOTIC RESULTS FOR PRODUCTS OF INDEPENDENT RANDOM MATRICES , 2015, 1502.01667.

[13]  P. Forrester.  Asymptotics of finite system Lyapunov exponents for some random matrix ensembles , 2015, 1501.05702.

[14]  J. R. Ipsen.  Lyapunov exponents for products of rectangular real, complex and quaternionic Ginibre matrices , 2014, 1412.3003.

[15]  Y. Qi,et al.  Spectral Radii of Large Non-Hermitian Random Matrices , 2014, 1411.1833.

[16]  F. Gotze,et al.  Asymptotic spectra of matrix-valued functions of independent random matrices and free probability , 2014, 1408.1732.

[17]  Z. Burda,et al.  Universal distribution of Lyapunov exponents for products of Ginibre matrices , 2014, 1406.0803.

[18]  V. Kargin.  On the Largest Lyapunov Exponent for Products of Gaussian Matrices , 2013, 1306.6576.

[19]  Peter J. Forrester,et al.  Lyapunov Exponents for Products of Complex Gaussian Random Matrices , 2012, 1206.2001.

[20]  G. Tucci.  Asymptotic Products of Independent Gaussian Random Matrices with Correlated Entries , 2011 .

[21]  A. Soshnikov,et al.  Products of Independent non-Hermitian Random Matrices , 2010, 1012.4497.

[22]  Alexander Tikhomirov,et al.  On the Asymptotic Spectrum of Products of Independent Random Matrices. , 2010, 1012.2710.

[23]  M. Pollicott.  Maximal Lyapunov exponents for random matrix products , 2010 .

[24]  A. Guionnet,et al.  An Introduction to Random Matrices , 2009 .

[25]  Ofer Zeitouni,et al.  An Introduction to Random Matrices: Frontmatter , 2009 .

[26]  V. Kargin.  Lyapunov Exponents of Free Operators , 2007, 0712.1378.

[27]  Antonia Maria Tulino,et al.  Random Matrix Theory and Wireless Communications , 2004, Found. Trends Commun. Inf. Theory.

[28]  A. Crisanti,et al.  Products of random matrices in statistical physics , 1993 .

[29]  Charles M. Newman,et al.  The triangle law for Lyapunov exponents of large random matrices , 1992 .

[30]  E. Haeusler.  On the Rate of Convergence in the Central Limit Theorem for Martingales with Discrete and Continuous Time , 1988 .

[31]  Charles M. Newman,et al.  The distribution of Lyapunov exponents: Exact results for random matrices , 1986 .

[32]  H. Furstenberg,et al.  Products of Random Matrices , 1960 .