Equilibrium Propagation: Bridging the Gap between Energy-Based Models and Backpropagation
暂无分享,去创建一个
[1] Yann LeCun,et al. The mnist database of handwritten digits , 2005 .
[2] Ilya Sutskever,et al. On the Convergence Properties of Contrastive Divergence , 2010, AISTATS.
[3] Javier R. Movellan,et al. Contrastive Hebbian Learning in the Continuous Hopfield Model , 1991 .
[4] Yoshua Bengio,et al. Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.
[5] Yoshua Bengio,et al. STDP as presynaptic activity times rate of change of postsynaptic activity , 2015, 1509.05936.
[6] Pineda,et al. Generalization of back-propagation to recurrent neural networks. , 1987, Physical review letters.
[7] D. Feldman. The Spike-Timing Dependence of Plasticity , 2012, Neuron.
[8] Randall C. O'Reilly,et al. Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.
[9] Yoshua Bengio,et al. Towards Biologically Plausible Deep Learning , 2015, ArXiv.
[10] Nathan Intrator,et al. Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions , 1992, Neural Networks.
[11] Yoshua Bengio,et al. An objective function for STDP , 2015, ArXiv.
[12] Guillaume Charpiat,et al. Training recurrent networks online without backtracking , 2015, ArXiv.
[13] Wulfram Gerstner,et al. A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.
[14] Xiaohui Xie,et al. Equivalence of Backpropagation and Contrastive Hebbian Learning in a Layered Network , 2003, Neural Computation.
[15] Geoffrey E. Hinton. Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.
[16] Geoffrey E. Hinton,et al. Deep Boltzmann Machines , 2009, AISTATS.
[17] Xiaohui Xie,et al. Spike-based Learning Rules and Stabilization of Persistent Neural Activity , 1999, NIPS.
[18] W. Gerstner,et al. Spike-Timing-Dependent Plasticity: A Comprehensive Overview , 2012, Front. Syn. Neurosci..
[19] Torsten Lehmann,et al. Nonlinear backpropagation: doing backpropagation without derivatives of the activation function , 1997, IEEE Trans. Neural Networks.
[20] Daniel Cownden,et al. Random feedback weights support learning in deep neural networks , 2014, ArXiv.
[21] Karl J. Friston,et al. Active Inference: A Process Theory , 2017, Neural Computation.
[22] Tijmen Tieleman,et al. Training restricted Boltzmann machines using approximations to the likelihood gradient , 2008, ICML '08.
[23] Luís B. Almeida,et al. A learning rule for asynchronous perceptrons with feedback in a combinatorial environment , 1990 .
[24] Yoshua Bengio,et al. Early Inference in Energy-Based Models Approximates Back-Propagation , 2015, ArXiv.
[25] Sanjeev Arora,et al. Why are deep nets reversible: A simple theory, with implications for training , 2015, ArXiv.
[26] Wulfram Gerstner,et al. Towards deep learning with spiking neurons in energy based models with contrastive Hebbian plasticity , 2016, ArXiv.
[27] J J Hopfield,et al. Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.
[28] Pascal Vincent,et al. Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..
[29] Nitish Srivastava,et al. Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..
[30] E. Bienenstock,et al. Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.
[31] József Fiser,et al. Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.
[32] Yoshua Bengio,et al. Feedforward Initialization for Fast Inference of Deep Generative Networks is biologically plausible , 2016, ArXiv.
[33] G. Bi,et al. Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.
[34] J. Pfister,et al. A triplet spike-timing–dependent plasticity model generalizes the Bienenstock–Cooper–Munro rule to higher-order spatiotemporal correlations , 2011, Proceedings of the National Academy of Sciences.
[35] Karl J. Friston,et al. Free-energy and the brain , 2007, Synthese.
[36] Y. Dan,et al. Spike-timing-dependent synaptic modification induced by natural spike trains , 2002, Nature.
[37] Yann Ollivier,et al. Unbiased Online Recurrent Optimization , 2017, ICLR.