Mechanisms of pattern decorrelation by recurrent neuronal circuits

Decorrelation is a fundamental computation that optimizes the format of neuronal activity patterns. Channel decorrelation by adaptive mechanisms results in efficient coding, whereas pattern decorrelation facilitates the readout and storage of information. Mechanisms achieving pattern decorrelation, however, remain unclear. We developed a theoretical framework that relates high-dimensional pattern decorrelation to neuronal and circuit properties in a mathematically stringent fashion. For a generic class of random neuronal networks, we proved that pattern decorrelation emerges from neuronal nonlinearities and is amplified by recurrent connectivity. This mechanism does not require adaptation of the network, is enhanced by sparse connectivity, depends on the baseline membrane potential and is robust. Connectivity measurements and computational modeling suggest that this mechanism is involved in pattern decorrelation in the zebrafish olfactory bulb. These results reveal a generic relationship between the structure and function of neuronal circuits that is probably relevant for pattern processing in various brain areas.

[1]  T. Bonhoeffer,et al.  Tuning and Topography in an Odor Map on the Rat Olfactory Bulb , 2001, The Journal of Neuroscience.

[2]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[3]  Praveen Sethupathy,et al.  Non-topographical contrast enhancement in the olfactory bulb , 2006, BMC Neuroscience.

[4]  Vladimir Itskov,et al.  Pattern capacity of a perceptron for sparse discrimination. , 2008, Physical review letters.

[5]  E. Yaksi,et al.  Reconstruction of firing rate changes across neuronal populations by temporally deconvolved Ca2+ imaging , 2006, Nature Methods.

[6]  Gilles Laurent,et al.  Transformation of Olfactory Representations in the Drosophila Antennal Lobe , 2004, Science.

[7]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[8]  T. Sejnowski,et al.  Independent component analysis at the neural cocktail party , 2001, Trends in Neurosciences.

[9]  H. Sebastian Seung,et al.  Permitted and Forbidden Sets in Symmetric Threshold-Linear Networks , 2003, Neural Computation.

[10]  Jeffry S. Isaacson,et al.  Mechanisms governing dendritic γ-aminobutyric acid (GABA) release in the rat olfactory bulb , 2001 .

[11]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[12]  Alan Gelperin,et al.  Sparse Odor Coding in Awake Behaving Mice , 2006, The Journal of Neuroscience.

[13]  R. French.  Catastrophic Forgetting in Connectionist Networks , 2006 .

[14]  S. Nakanishi,et al.  Refinement of odor molecule tuning by dendrodendritic synaptic inhibition in the olfactory bulb. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[15]  R. Hummel.  Histogram modification techniques , 1975 .

[16]  M. Hasselmo,et al.  Associative memory function in piriform (olfactory) cortex: computational modeling and neuropharmacology. , 1990, Cold Spring Harbor symposia on quantitative biology.

[17]  D J Parker,et al.  The nervous system might 'orthogonalize' to discriminate. , 2008, Journal of theoretical biology.

[18]  Gordon M Shepherd,et al.  Viral tracing identifies distributed columnar organization in the olfactory bulb , 2006, Proceedings of the National Academy of Sciences.

[19]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[20]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[21]  R. Friedrich,et al.  Combinatorial and Chemotopic Odorant Coding in the Zebrafish Olfactory Bulb Visualized by Optical Imaging , 1997, Neuron.

[22]  Vikrant Kapoor,et al.  Activity-dependent gating of lateral inhibition in the mouse olfactory bulb , 2008, Nature Neuroscience.

[23]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[24]  Rainer W Friedrich,et al.  Topological Reorganization of Odor Representations in the Olfactory Bulb , 2007, PLoS biology.

[25]  Joseph J. Atick,et al.  Convergent Algorithm for Sensory Receptive Field Development , 1993, Neural Computation.

[26]  Michael S. Lewicki,et al.  Efficient coding of natural sounds , 2002, Nature Neuroscience.

[27]  T. Raghavan,et al.  Nonnegative Matrices and Applications , 1997 .

[28]  Lucas C. Parra,et al.  1 Separation of non-stationary natural signals , 2001 .

[29]  Glenn C. Turner,et al.  Oscillations and Sparsening of Odor Representations in the Mushroom Body , 2002, Science.

[30]  J. Lisman.  Relating Hippocampal Circuitry Viewpoint to Function : Recall of Memory Sequences by Reciprocal Dentate – CA 3 Interactions , 1999 .

[31]  J. Isaacson,et al.  Mechanisms governing dendritic gamma-aminobutyric acid (GABA) release in the rat olfactory bulb. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[32]  K. Svoboda,et al.  Dendrodendritic Synaptic Signals in Olfactory Bulb Granule Cells: Local Spine Boost and Global Low-Threshold Spike , 2005, The Journal of Neuroscience.

[33]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[34]  Markus Meister,et al.  Precision and diversity in an odor map on the olfactory bulb , 2009, Nature Neuroscience.

[35]  G. Laurent,et al.  Dynamic optimization of odor representations by slow temporal patterning of mitral cell activity. , 2001, Science.

[36]  Meir Feder,et al.  Multi-channel signal separation by decorrelation , 1993, IEEE Trans. Speech Audio Process..

[37]  Jun Li,et al.  Early Development of Functional Spatial Maps in the Zebrafish Olfactory Bulb , 2005, The Journal of Neuroscience.

[38]  Gilles Laurent,et al.  A Simple Connectivity Scheme for Sparse Coding in an Olfactory System , 2007, The Journal of Neuroscience.

[39]  H. K. Hartline,et al.  INHIBITORY INTERACTION OF RECEPTOR UNITS IN THE EYE OF LIMULUS , 1957, The Journal of general physiology.

[40]  Antoniu L. Fantana,et al.  Rat Olfactory Bulb Mitral Cells Receive Sparse Glomerular Inputs , 2008, Neuron.

[41]  Hannah Monyer,et al.  Connexin36 Mediates Spike Synchrony in Olfactory Bulb Glomeruli , 2005, Neuron.

[42]  Gilles Laurent,et al.  Dynamics of olfactory bulb input and output activity during odor stimulation in zebrafish. , 2004, Journal of neurophysiology.

[43]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[44]  Richard F. Baum.  The correlation function of Gaussian noise passed through nonlinear devices , 1969, IEEE Trans. Inf. Theory.

[45]  E. Rolls,et al.  A computational theory of hippocampal function, and empirical tests of the theory , 2006, Progress in Neurobiology.

[46]  Vikrant Kapoor,et al.  Glomerulus-Specific, Long-Latency Activity in the Olfactory Bulb Granule Cell Network , 2006, The Journal of Neuroscience.

[47]  Bert Sakmann,et al.  Reciprocal intraglomerular excitation and intra‐ and interglomerular lateral inhibition between mouse olfactory bulb mitral cells , 2002, The Journal of physiology.

[48]  Shun-ichi Amari,et al.  Recurrent Neural Networks For Blind Separation of Sources , 1995 .

[49]  G. Laurent,et al.  Multiplexing using synchrony in the zebrafish olfactory bulb , 2004, Nature Neuroscience.