At the Edge of Chaos: How Cerebellar Granular Layer Network Dynamics Can Provide the Basis for Temporal Filters

Models of the cerebellar microcircuit often assume that input signals from the mossy-fibers are expanded and recoded to provide a foundation from which the Purkinje cells can synthesize output filters to implement specific input-signal transformations. Details of this process are however unclear. While previous work has shown that recurrent granule cell inhibition could in principle generate a wide variety of random outputs suitable for coding signal onsets, the more general application for temporally varying signals has yet to be demonstrated. Here we show for the first time that using a mechanism very similar to reservoir computing enables random neuronal networks in the granule cell layer to provide the necessary signal separation and extension from which Purkinje cells could construct basis filters of various time-constants. The main requirement for this is that the network operates in a state of criticality close to the edge of random chaotic behavior. We further show that the lack of recurrent excitation in the granular layer as commonly required in traditional reservoir networks can be circumvented by considering other inherent granular layer features such as inverted input signals or mGluR2 inhibition of Golgi cells. Other properties that facilitate filter construction are direct mossy fiber excitation of Golgi cells, variability of synaptic weights or input signals and output-feedback via the nucleocortical pathway. Our findings are well supported by previous experimental and theoretical work and will help to bridge the gap between system-level models and detailed models of the granular layer network.

[1]  Peter Bühlmann Regression shrinkage and selection via the Lasso: a retrospective (Robert Tibshirani): Comments on the presentation , 2011 .

[2]  Thierry Nieus,et al.  Tonic activation of GABAB receptors reduces release probability at inhibitory connections in the cerebellar glomerulus. , 2009, Journal of neurophysiology.

[3]  J R Bloedel,et al.  Organizational features of the cat and monkey cerebellar nucleocortical projection , 1978, The Journal of comparative neurology.

[4]  Peter Ford Dominey Complex sensory-motor sequence learning based on recurrent state representation and reinforcement learning , 1995, Biological Cybernetics.

[5]  Zhenyu Gao,et al.  Distributed synergistic plasticity and cerebellar learning , 2012, Nature Reviews Neuroscience.

[6]  A. Fuchs,et al.  Role of primate flocculus during rapid behavioral modification of vestibuloocular reflex. II. Mossy fiber firing patterns during horizontal head rotation and eye movement. , 1978, Journal of neurophysiology.

[7]  Mantas Lukosevicius,et al.  A Practical Guide to Applying Echo State Networks , 2012, Neural Networks: Tricks of the Trade.

[8]  C. Ekerot,et al.  Parallel fiber receptive fields: a key to understanding cerebellar operation and learning , 2008, The Cerebellum.

[9]  G Cheron,et al.  Discharge properties of brain stem neurons projecting to the flocculus in the alert cat. I. Medical vestibular nucleus. , 1996, Journal of neurophysiology.

[10]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[11]  N. Donegan,et al.  A model of Pavlovian eyelid conditioning based on the synaptic organization of the cerebellum. , 1997, Learning & memory.

[12]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[13]  R Angus Silver,et al.  The Contribution of Single Synapses to Sensory Representation in Vivo , 2008, Science.

[14]  Tadashi Yamazaki,et al.  A Possible Mechanism for Controlling Timing Representation in the Cerebellar Cortex , 2010, ISNN.

[15]  Grgoire Montavon,et al.  Neural Networks: Tricks of the Trade , 2012, Lecture Notes in Computer Science.

[16]  G. Bishop,et al.  Morphological and electrophysiological characteristics of projection neurons in the nucleus interpositus of the cat cerebellum , 1978, The Journal of comparative neurology.

[17]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[18]  Kenji Doya,et al.  A Spiking Neural Network Model of Model-Free Reinforcement Learning with High-Dimensional Sensory Input and Perceptual Ambiguity , 2015, PloS one.

[19]  Henrik Jörntell,et al.  Reciprocal Bidirectional Plasticity of Parallel Fiber Receptive Fields in Cerebellar Purkinje Cells and Their Afferent Interneurons , 2002, Neuron.

[20]  J. Albus A Theory of Cerebellar Function , 1971 .

[21]  James V. Stone,et al.  Decorrelation control by the cerebellum achieves oculomotor plant compensation in simulated vestibulo-ocular reflex , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[22]  G. Holt A critical reexamination of some assumptions and implications of cable theory in neurobiology , 1998 .

[23]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[24]  E. D’Angelo,et al.  Regulation of output spike patterns by phasic inhibition in cerebellar granule cells , 2014, Front. Cell. Neurosci..

[25]  John Ignatius Griffin,et al.  Statistics; methods and applications , 1963 .

[26]  M. Häusser,et al.  High-fidelity transmission of sensory information by single cerebellar mossy fibre boutons , 2007, Nature.

[27]  Tadashi Yamazaki,et al.  A Computational Mechanism for Unified Gain and Timing Control in the Cerebellum , 2012, PloS one.

[28]  Egidio D'Angelo,et al.  Granule Cell Ascending Axon Excitatory Synapses onto Golgi Cells Implement a Potent Feedback Circuit in the Cerebellar Granular Layer , 2013, The Journal of Neuroscience.

[29]  John Porrill,et al.  An adaptive filter model of cerebellar zone C3 as a basis for safe limb control? , 2013, The Journal of physiology.

[30]  M. Mauk,et al.  Simulations of Cerebellar Motor Learning: Computational Analysis of Plasticity at the Mossy Fiber to Deep Nucleus Synapse , 1999, The Journal of Neuroscience.

[31]  John Porrill,et al.  Model cerebellar granule cells can faithfully transmit modulated firing rate signals , 2014, Front. Cell. Neurosci..

[32]  Erkki Oja,et al.  Artificial Neural Networks: Biological Inspirations - ICANN 2005, 15th International Conference, Warsaw, Poland, September 11-15, 2005, Proceedings, Part I , 2005, ICANN.

[33]  W. Maass,et al.  What makes a dynamical system computationally powerful ? , 2022 .

[34]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[35]  Terrence J. Sejnowski,et al.  What Makes a Dynamical System Computationally Powerful , 2007 .

[36]  N. Mizuno,et al.  Metabotropic glutamate receptors mGluR2 and mGluR5 are expressed in two non-overlapping populations of Golgi cells in the rat cerebellum , 1996, Neuroscience.

[37]  Tadashi Yamazaki,et al.  Building the Cerebellum in a Computer , 2005, ICANN.

[38]  Shigeru Tanaka,et al.  A spiking network model for passage-of-time representation in the cerebellum , 2007, The European journal of neuroscience.

[39]  Henrik Jörntell,et al.  Properties of Somatosensory Synaptic Integration in Cerebellar Granule Cells In Vivo , 2006, The Journal of Neuroscience.

[40]  D. Robinson,et al.  Integrating with neurons. , 1989, Annual review of neuroscience.

[41]  B. Barbour,et al.  Properties of Unitary Granule Cell→Purkinje Cell Synapses in Adult Rat Cerebellar Slices , 2002, The Journal of Neuroscience.

[42]  F. Rossi,et al.  Handbook of the Cerebellum and Cerebellar Disorders , 2013, Springer Netherlands.

[43]  Véra Kůrková,et al.  Artificial Neural Networks - ICANN 2008 , 18th International Conference, Prague, Czech Republic, September 3-6, 2008, Proceedings, Part I , 2008, ICANN.

[44]  Y. Zhang,et al.  Properties of superior vestibular nucleus neurons projecting to the cerebellar flocculus in the squirrel monkey. , 1993, Journal of neurophysiology.

[45]  C. Koch,et al.  Modeling direction selectivity of simple cells in striate visual cortex within the framework of the canonical microcircuit , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  Henrik Jörntell,et al.  Sensory transmission in cerebellar granule cells relies on similarly coded mossy fiber inputs , 2009, Proceedings of the National Academy of Sciences.

[47]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[48]  John Porrill,et al.  Adaptive Filter Models , 2013 .

[49]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[50]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[51]  Jochen J. Steil,et al.  Regularization and stability in reservoir networks with output feedback , 2012, Neurocomputing.

[52]  Chris I. De Zeeuw,et al.  Variable timing of synaptic transmission in cerebellar unipolar brush cells , 2014 .

[53]  Javier F. Medina,et al.  Computer simulation of cerebellar information processing , 2000, Nature Neuroscience.

[54]  C. Koch,et al.  A brief history of time (constants). , 1996, Cerebral cortex.

[55]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[56]  Dai Watanabe,et al.  mGluR2 Postsynaptically Senses Granule Cell Inputs at Golgi Cell Synapses , 2003, Neuron.

[57]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[58]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[59]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[60]  L. Roncali,et al.  Glutamic acid decarboxylase immunoreactive large neuron types in the granular layer of the human cerebellar cortex , 2004, Anatomy and Embryology.

[61]  J. Simpson,et al.  Phase relations of Purkinje cells in the rabbit flocculus during compensatory eye movements. , 1995, Journal of neurophysiology.

[62]  Chris I. De Zeeuw,et al.  Climbing Fiber Input Shapes Reciprocity of Purkinje Cell Firing , 2013, Neuron.

[63]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[64]  James T. Kwok,et al.  Advances in Neural Networks - ISNN 2010, 7th International Symposium on Neural Networks, ISNN 2010, Shanghai, China, June 6-9, 2010, Proceedings, Part I , 2010, ISNN.

[65]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .

[66]  M. Chacron,et al.  Neural Variability, Detection Thresholds, and Information Transmission in the Vestibular System , 2007, Journal of Neuroscience.

[67]  Benjamin Schrauwen,et al.  Stable Output Feedback in Reservoir Computing Using Ridge Regression , 2008, ICANN.

[68]  伊藤 正男 The cerebellum : brain for an implicit self , 2012 .

[69]  Shigeru Tanaka,et al.  Computational Models of Timing Mechanisms in the Cerebellar Granular Layer , 2009, The Cerebellum.

[70]  G. Hesslow,et al.  Memory trace and timing mechanism localized to cerebellar Purkinje cells , 2014, Proceedings of the National Academy of Sciences.

[71]  John Porrill,et al.  Sensory Prediction or Motor Control? Application of Marr–Albus Type Models of Cerebellar Function to Classical Conditioning , 2010, Front. Comput. Neurosci..

[72]  Tahl Holtzman,et al.  Multiple extra‐synaptic spillover mechanisms regulate prolonged activity in cerebellar Golgi cell–granule cell loops , 2011, The Journal of physiology.

[73]  Dean V. Buonomano,et al.  Neural Network Model of the Cerebellum: Temporal Discrimination and the Timing of Motor Responses , 1999, Neural Computation.

[74]  Benjamin Schrauwen,et al.  Connectivity, Dynamics, and Memory in Reservoir Computing with Binary and Analog Neurons , 2010, Neural Computation.

[75]  Peter Stone,et al.  Using a million cell simulation of the cerebellum: Network scaling and task generality , 2013, Neural Networks.

[76]  Henrik Jörntell,et al.  Synaptic Integration in Cerebellar Granule Cells , 2008, The Cerebellum.

[77]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[78]  John Porrill,et al.  Silent Synapses, LTP, and the Indirect Parallel-Fibre Pathway: Computational Consequences of Optimal Cerebellar Noise-Processing , 2008, PLoS Comput. Biol..

[79]  Thierry Nieus,et al.  A Realistic Large-Scale Model of the Cerebellum Granular Layer Predicts Circuit Spatio-Temporal Filtering Properties , 2009, Front. Cell. Neurosci..

[80]  N. Barmack,et al.  Functions of Interneurons in Mouse Cerebellum , 2008, The Journal of Neuroscience.

[81]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[82]  Abigail L. Person,et al.  Cerebellar Loops: A Review of the Nucleocortical Pathway , 2013, The Cerebellum.

[83]  Tadashi Yamazaki,et al.  Neural Modeling of an Internal Clock , 2005, Neural Computation.

[84]  Javier F. Medina,et al.  Timing Mechanisms in the Cerebellum: Testing Predictions of a Large-Scale Computer Simulation , 2000, The Journal of Neuroscience.

[85]  Egidio D'Angelo,et al.  Action potential processing in a detailed Purkinje cell model reveals a critical role for axonal compartmentalization , 2015, Front. Cell. Neurosci..

[86]  Tadashi Yamazaki,et al.  The cerebellum as a liquid state machine , 2007, Neural Networks.

[87]  Peter E. Latham,et al.  Randomly Connected Networks Have Short Temporal Memory , 2013, Neural Computation.

[88]  H. Axelrad,et al.  Extending the cerebellar Lugaro cell class , 2002, Neuroscience.

[89]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[90]  J.J. Steil,et al.  Backpropagation-decorrelation: online recurrent learning with O(N) complexity , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[91]  P. Dean,et al.  The cerebellar microcircuit as an adaptive filter: experimental and computational evidence , 2010, Nature Reviews Neuroscience.

[92]  Tadashi Yamazaki,et al.  Stimulus-Dependent State Transition between Synchronized Oscillation and Randomly Repetitive Burst in a Model Cerebellar Granular Layer , 2011, PLoS Comput. Biol..

[93]  Enrico Mugnaini,et al.  The unipolar brush cell: A remarkable neuron finally receiving deserved attention , 2011, Brain Research Reviews.

[94]  William Wisden,et al.  Synaptic inhibition of Purkinje cells mediates consolidation of vestibulo-cerebellar motor learning , 2009, Nature Neuroscience.

[95]  C. D. De Zeeuw,et al.  Variable timing of synaptic transmission in cerebellar unipolar brush cells , 2014, Proceedings of the National Academy of Sciences.

[96]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..