Control of the Correlation of Spontaneous Neuron Activity in Biological and Noise-activated CMOS Artificial Neural Microcircuits

There are several indications that brain is organized not on a basis of individual unreliable neurons, but on a micro-circuital scale providing Lego blocks employed to create complex architectures. At such an intermediate scale, the firing activity in the microcircuits is governed by collective effects emerging by the background noise soliciting spontaneous firing, the degree of mutual connections between the neurons, and the topology of the connections. We compare spontaneous firing activity of small populations of neurons adhering to an engineered scaffold with simulations of biologically plausible CMOS artificial neuron populations whose spontaneous activity is ignited by tailored background noise. We provide a full set of flexible and low-power consuming silicon blocks including neurons, excitatory and inhibitory synapses, and both white and pink noise generators for spontaneous firing activation. We achieve a comparable degree of correlation of the firing activity of the biological neurons by controlling the kind and the number of connection among the silicon neurons. The correlation between groups of neurons, organized as a ring of four distinct populations connected by the equivalent of interneurons, is triggered more effectively by adding multiple synapses to the connections than increasing the number of independent point-to-point connections. The comparison between the biological and the artificial systems suggests that a considerable number of synapses is active also in biological populations adhering to engineered scaffolds.

[1]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[2]  Wolfgang Maass,et al.  Dynamics of information and emergent computation in generic neural microcircuit models , 2005, Neural Networks.

[3]  Michio Niwano,et al.  Live-Cell, Label-Free Identification of GABAergic and Non-GABAergic Neurons in Primary Cortical Cultures Using Micropatterned Surface , 2016, PloS one.

[4]  Enrico Prati,et al.  Atomic scale nanoelectronics for quantum neuromorphic devices: comparing different materials , 2016, ArXiv.

[5]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[6]  Ioan Opris,et al.  Prefrontal cortical minicolumn: from executive control to disrupted cognitive processing. , 2014, Brain : a journal of neurology.

[7]  Alexander S. Ecker,et al.  Is there signal in the noise? , 2014, Nature Neuroscience.

[8]  I. Brouk,et al.  1/f noise in CMOS transistors for analog applications , 2000, 21st IEEE Convention of the Electrical and Electronic Engineers in Israel. Proceedings (Cat. No.00EX377).

[9]  Stefan Habenschuss,et al.  Solving Constraint Satisfaction Problems with Networks of Spiking Neurons , 2016, Front. Neurosci..

[10]  Andrew S. Cassidy,et al.  Design of silicon brains in the nano-CMOS era: Spiking neurons, learning synapses and neural architecture optimization , 2013, Neural Networks.

[11]  Alessandro Calderoni,et al.  Microwave irradiation effects on random telegraph signal in a MOSFET , 2007 .

[12]  Gerard J. Rinkus,et al.  A Cortical Sparse Distributed Coding Model Linking Mini- and Macrocolumn-Scale Functionality , 2010, Front. Neuroanat..

[13]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[14]  Tetsuya Asai,et al.  Impact of Noise on Spike Transmission through Serially Connected Electrical FitzHugh-Nagumo Circuits with Subthreshold and Suprathreshold Interconductances , 2012 .

[15]  Shigeo Sato,et al.  Size-dependent regulation of synchronized activity in living neuronal networks. , 2016, Physical review. E.

[16]  Takahiro Shinada,et al.  Band transport across a chain of dopant sites in silicon over micron distances and high temperatures , 2016, Scientific Reports.

[17]  Bernabé Linares-Barranco,et al.  A Neuromorphic Cortical-Layer Microchip for Spike-Based Event Processing Vision Systems , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[18]  Stefan Habenschuss,et al.  Stochastic Computations in Cortical Microcircuit Models , 2013, PLoS Comput. Biol..

[19]  Brent Doiron,et al.  Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses , 2015, PLoS Comput. Biol..

[20]  A. Destexhe Kinetic Models of Synaptic Transmission , 1997 .

[21]  Henry Kennedy,et al.  Brain structure and dynamics across scales: in search of rules , 2016, Current Opinion in Neurobiology.

[22]  Bruce C. Wheeler,et al.  Designing Neural Networks in Culture , 2010, Proceedings of the IEEE.

[23]  Kelvin E. Jones,et al.  Neuronal variability: noise or part of the signal? , 2005, Nature Reviews Neuroscience.

[24]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[25]  R. Matsumura,et al.  Unidirectional signal propagation in primary neurons micropatterned at a single-cell resolution. , 2016, Applied physics letters.

[26]  Wolfgang Maass,et al.  Cerebral Cortex Advance Access published February 15, 2006 A Statistical Analysis of Information- Processing Properties of Lamina-Specific , 2022 .

[27]  Geoffrey E. Hinton,et al.  OPTIMAL PERCEPTUAL INFERENCE , 1983 .

[28]  Barrie Gilbert,et al.  Translinear circuits: An historical overview , 1996 .

[29]  Wolfgang Maass,et al.  Noise as a Resource for Computation and Learning in Networks of Spiking Neurons , 2014, Proceedings of the IEEE.

[30]  Chiara Bartolozzi,et al.  Neuromorphic Electronic Circuits for Building Autonomous Cognitive Systems , 2014, Proceedings of the IEEE.

[31]  I. Fried,et al.  Coupling between Neuronal Firing Rate, Gamma LFP, and BOLD fMRI Is Related to Interneuronal Correlations , 2007, Current Biology.

[32]  Osonde Osoba,et al.  Noise-enhanced convolutional neural networks , 2016, Neural Networks.

[33]  Tobias C. Potjans,et al.  The Cell-Type Specific Cortical Microcircuit: Relating Structure and Activity in a Full-Scale Spiking Network Model , 2012, Cerebral cortex.

[34]  E. G. Jones,et al.  Microcolumns in the cerebral cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Henrik Jörntell,et al.  Cross-correlations between pairs of neurons in cerebellar cortex in vivo , 2013, Neural Networks.

[36]  Fleur Zeldenrust,et al.  Modulation of spike and burst rate in a minimal neuronal circuit with feed-forward inhibition , 2013, Neural Networks.

[37]  Richard H. A. H. Jacobs,et al.  The time course of binocular rivalry reveals a fundamental role of noise. , 2006, Journal of vision.

[38]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[39]  Arif Babul,et al.  Neuron dynamics in the presence of 1/f noise. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Henry Markram,et al.  Innate Neural Assemblies for Lego Memory , 2011, Front. Neural Circuits.

[41]  Arash Ahmadi,et al.  An analog implementation of biologically plausible neurons using CCII building blocks , 2012, Neural Networks.

[42]  Maxwell H. Turner,et al.  Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code , 2016, Neuron.

[43]  S. Kaech,et al.  Culturing hippocampal neurons , 2006, Nature Protocols.

[44]  Wolfgang Maass,et al.  To Spike or Not to Spike: That Is the Question , 2015, Proc. IEEE.

[45]  Robert M. Burton,et al.  Event-dependent control of noise enhances learning in neural networks , 1992, Neural Networks.

[46]  R. Fisher The Advanced Theory of Statistics , 1943, Nature.

[47]  Peter Grigg,et al.  Effects of Colored Noise on Stochastic Resonance in Sensory Neurons , 1999 .

[48]  Y. Nemirovsky,et al.  1/f noise in CMOS transistors for analog applications , 2001 .

[49]  Janos Vörös,et al.  “Brains on a chip”: Towards engineered neural networks , 2016 .

[50]  Apostolos P. Georgopoulos,et al.  Modeling of directional operations in the motor cortex: A noisy network of spiking neurons is trained to generate a neural-vector trajectory , 1996, Neural Networks.

[51]  M. Raichle The Brain's Dark Energy , 2006, Science.

[52]  Michael G Metzen,et al.  Neural correlations enable invariant coding and perception of natural stimuli in weakly electric fish , 2016, eLife.

[53]  Bruce C. Wheeler,et al.  An in vitro method to manipulate the direction and functional strength between neural populations , 2015, Front. Neural Circuits.

[54]  Alexander J. Sadovsky,et al.  Mouse Visual Neocortex Supports Multiple Stereotyped Patterns of Microcircuit Activity , 2014, The Journal of Neuroscience.

[55]  Tetsuya Yagi,et al.  Real-time object tracking based on scale-invariant features employing bio-inspired hardware , 2016, Neural Networks.

[56]  Najdan Vukovic,et al.  Robust sequential learning of feedforward neural networks in the presence of heavy-tailed noise , 2015, Neural Networks.

[57]  F. J. Livesey,et al.  Directed differentiation of human pluripotent stem cells to cerebral cortex neurons and neural networks , 2012, Nature Protocols.

[58]  Rahul Sarpeshkar,et al.  Refractory Neuron Circuits , 1992 .

[59]  Wolfgang Maass,et al.  Motif distribution, dynamical properties, and computational performance of two data-based cortical microcircuit templates , 2009, Journal of Physiology-Paris.

[60]  Meng Li,et al.  Brain Computation Is Organized via Power-of-Two-Based Permutation Logic , 2016, Front. Syst. Neurosci..

[61]  Jaume Casademunt,et al.  Noise focusing and the emergence of coherent activity in neuronal cultures , 2013, Nature Physics.

[62]  Giacomo Indiveri,et al.  An event-based architecture for solving constraint satisfaction problems , 2015, Nature Communications.

[63]  H. Stanley,et al.  Description of microcolumnar ensembles in association cortex and their disruption in Alzheimer and Lewy body dementias. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[64]  Tetsuya Asai,et al.  Noise-assisted transmission of spikes in Maeda–Makino artificial neuron arrays , 2017, Int. J. Parallel Emergent Distributed Syst..

[65]  David Kappel,et al.  Network Plasticity as Bayesian Inference , 2015, PLoS Comput. Biol..

[66]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.