Ryo Karakida

发表

Statistical Mechanical Analysis of Online Learning with Weight Normalization in Single Layer Perceptron

S. Amari, M. Okada, Yuki Yoshida, 2017 .

Universal statistics of Fisher information in deep neural networks: mean field approach

Shun-ichi Amari, Shotaro Akaho, Ryo Karakida, 2018, AISTATS.

Statistical mechanical analysis of learning dynamics of two-layer perceptron with multiple output units

Masato Okada, Yuki Yoshida, Ryo Karakida, 2019, Journal of Physics A: Mathematical and Theoretical.

Understanding Gradient Regularization in Deep Learning: Efficient Finite-Difference Computation and Implicit Bias

Ryo Karakida, Kazuki Osawa, Tomoumi Takase, 2022, ArXiv.

Attention in a family of Boltzmann machines emerging from modern Hopfield networks

Ryo Karakida, Toshihiro Ota, 2022, 2212.04692.

Deep Learning in Random Neural Fields: Numerical Experiments via Neural Tangent Kernel

S. Amari, Ryo Karakida, Sho Sonoda, 2022, Neural Networks.

Self-paced Data Augmentation for Training Neural Networks pdf

Ryo Karakida, Tomoumi Takase, Hideki Asoh, 2020, Neurocomputing.

Dynamics of Learning in MLP: Natural Gradient and Singularity Revisited

Masato Okada, Shun-ichi Amari, Ryo Karakida, 2018, Neural Computation.

Dynamical analysis of contrastive divergence learning: Restricted Boltzmann machines with Gaussian visible units

Masato Okada, Shun-ichi Amari, Ryo Karakida, 2016, Neural Networks.

Learning curves for continual learning in neural networks: Self-knowledge transfer and forgetting

S. Akaho, Ryo Karakida, 2021, ICLR.

Learning Curves for Sequential Training of Neural Networks: Self-Knowledge Transfer and Forgetting pdf

Shotaro Akaho, Ryo Karakida, S. Akaho, 2021, ArXiv.

The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks

Shun-ichi Amari, Shotaro Akaho, Ryo Karakida, 2019, NeurIPS.

Information geometry connecting Wasserstein distance and Kullback–Leibler divergence via the entropy-relaxed transportation problem

Shun-ichi Amari, Ryo Karakida, Masafumi Oizumi, 2017, Information Geometry.

Understanding approximate Fisher information for fast convergence of natural gradient descent in wide neural networks

Ryo Karakida, Kazuki Osawa, 2020, NeurIPS.

Concept Formation and Dynamics of Repeated Inference in Deep Generative Models pdf

Masato Okada, Ryo Karakida, Yoshihiro Nagano, 2017, ArXiv.

Statistical Neurodynamics of Deep Networks: Geometry of Signal Spaces pdf

Shun-ichi Amari, Ryo Karakida, Masafumi Oizumi, 2018, Nonlinear Theory and Its Applications, IEICE.

Fisher Information and Natural Gradient Learning of Random Deep Networks

Shun-ichi Amari, Ryo Karakida, Masafumi Oizumi, 2018, AISTATS.

Attention in a family of Boltzmann machines emerging from modern Hopfield networks

Ryo Karakida, Toshihiro Ota, 2022, ArXiv.

Pathological Spectra of the Fisher Information Metric and Its Variants in Deep Neural Networks

Shun-ichi Amari, Shotaro Akaho, Ryo Karakida, 2019, Neural Computation.

The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry

Ryo Karakida, Tomohiro Hayase, 2020, AISTATS.

MLP-Mixer as a Wide and Sparse MLP

Ryo Karakida, Tomohiro Hayase, 2023, ArXiv.

Understanding Gradient Regularization in Deep Learning: Efficient Finite-Difference Computation and Implicit Bias

Ryo Karakida, Kazuki Osawa, Tomoumi Takase, 2022, ICML.

Information Geometry for Regularized Optimal Transport and Barycenters of Patterns

Shun-ichi Amari, Ryo Karakida, Masafumi Oizumi, 2019, Neural Computation.

Input Response of Neural Network Model with Lognormally Distributed Synaptic Weights

Masato Okada, Ryo Karakida, Yoshihiro Nagano, 2016 .

Inter-Layer Correlation in a Feed-Forward Network with Intra-Layer Common Noise

M. Okada, Ryo Karakida, K. Nagata, 2013 .

Collective dynamics of repeated inference in variational autoencoder rapidly find cluster structure

Ryo Karakida, Yoshihiro Nagano, Masato Okada, 2020, Scientific Reports.

Maximum likelihood learning of RBMs with Gaussian visible units on the Stiefel manifold

Masato Okada, Shun-ichi Amari, Ryo Karakida, 2016, ESANN.