Unsupervised learning models of primary cortical receptive fields and receptive field plasticity

The efficient coding hypothesis holds that neural receptive fields are adapted to the statistics of the environment, but is agnostic to the timescale of this adaptation, which occurs on both evolutionary and developmental timescales. In this work we focus on that component of adaptation which occurs during an organism's lifetime, and show that a number of unsupervised feature learning algorithms can account for features of normal receptive field properties across multiple primary sensory cortices. Furthermore, we show that the same algorithms account for altered receptive field properties in response to experimentally altered environmental statistics. Based on these modeling results we propose these models as phenomenological models of receptive field plasticity during an organism's lifetime. Finally, due to the success of the same models in multiple sensory areas, we suggest that these algorithms may provide a constructive realization of the theory, first proposed by Mountcastle [1], that a qualitatively similar learning algorithm acts throughout primary sensory cortices.

[1]  M. Merzenich,et al.  Representation of slowly and rapidly adapting cutaneous mechanoreceptors of the hand in Brodmann's areas 3 and 1 of Macaca mulatta. , 1972, Brain research.

[2]  V. Mountcastle,et al.  An organizing principle for cerebral function : the unit module and the distributed system , 1978 .

[3]  M. Sur Receptive fields of neurons in areas 3b and 1 of somatosensory cortex in monkeys , 1980, Brain Research.

[4]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[5]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[6]  M. Sur,et al.  Experimentally induced visual projections into auditory thalamus and cortex. , 1988, Science.

[7]  D. Frost,et al.  Visual responses of neurons in somatosensory cortex of hamsters with experimentally induced retinal projections to somatosensory thalamus. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[8]  M. Merzenich,et al.  Reorganization of somatosensory area 3b representations in adult owl monkeys after digital syndactyly. , 1991, Journal of neurophysiology.

[9]  A W Roe,et al.  Visual projections routed to the auditory pathway in ferrets: receptive fields of visual neurons in primary auditory cortex , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  R. Patterson,et al.  Complex Sounds and Auditory Images , 1992 .

[11]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[12]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[13]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[14]  Malcolm Slaney,et al.  An Efficient Implementation of the Patterson-Holdsworth Auditory Filter Bank , 1997 .

[15]  J. DiCarlo,et al.  Structure of Receptive Fields in Area 3b of Primary Somatosensory Cortex in the Alert Monkey , 1998, The Journal of Neuroscience.

[16]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[17]  D. Frost,et al.  Surgically created neural pathways mediate visual pattern discrimination. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Alessandra Angelucci,et al.  Induction of visual orientation modules in auditory cortex , 2000, Nature.

[19]  M. Sur,et al.  Visual behaviour mediated by retinal projections directed to the auditory pathway , 2000, Nature.

[20]  Lee M. Miller,et al.  Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. , 2002, Journal of neurophysiology.

[21]  M. A. Repucci,et al.  Spatial Structure and Symmetry of Simple-Cell Receptive Fields in Macaque Primary Visual Cortex , 2002 .

[22]  Konrad P. Körding,et al.  Sparse Spectrotemporal Coding of Sounds , 2003, EURASIP J. Adv. Signal Process..

[23]  Nicole C. Rust,et al.  Do We Know What the Early Visual System Does? , 2005, The Journal of Neuroscience.

[24]  R. Wong,et al.  A Comparison of Experience-Dependent Plasticity in the Visual and Somatosensory Systems , 2005, Neuron.

[25]  K. O’Connor,et al.  Adaptive stimulus optimization for auditory cortical neurons. , 2005, Journal of neurophysiology.

[26]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[27]  Michael S. Lewicki,et al.  Efficient auditory coding , 2006, Nature.

[28]  Jérôme Ribot,et al.  Orientation-restricted continuous visual exposure induces marked reorganization of orientation maps in early life , 2006, NeuroImage.

[29]  Martin Rehn,et al.  A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields , 2007, Journal of Computational Neuroscience.

[30]  P. Dayan,et al.  An unsupervised learning model of neural plasticity: Orientation selectivity in goggle-reared kittens , 2007, Vision Research.

[31]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[32]  E. Chang,et al.  Critical Period Window for Spectral Tuning Defined in the Primary Auditory Cortex (A1) in the Rat , 2007, The Journal of Neuroscience.

[33]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[34]  D. Feldman Synaptic mechanisms for plasticity in neocortex. , 2009, Annual review of neuroscience.

[35]  Aapo Hyvärinen,et al.  Natural Image Statistics - A Probabilistic Approach to Early Computational Vision , 2009, Computational Imaging and Vision.

[36]  M. Graziano,et al.  Diversity of grip in Macaca mulatta , 2009, Experimental Brain Research.

[37]  Jörg Lücke,et al.  The Maximal Causes of Natural Scenes are Edge Filters , 2010, NIPS.

[38]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.