A computational paradigm for dynamic logic-gates in neuronal activity

In 1943 McCulloch and Pitts suggested that the brain is composed of reliable logic-gates similar to the logic at the core of today's computers. This framework had a limited impact on neuroscience, since neurons exhibit far richer dynamics. Here we propose a new experimentally corroborated paradigm in which the truth tables of the brain's logic-gates are time dependent, i.e., dynamic logic-gates (DLGs). The truth tables of the DLGs depend on the history of their activity and the stimulation frequencies of their input neurons. Our experimental results are based on a procedure where conditioned stimulations were enforced on circuits of neurons embedded within a large-scale network of cortical cells in-vitro. We demonstrate that the underlying biological mechanism is the unavoidable increase of neuronal response latencies to ongoing stimulations, which imposes a non-uniform gradual stretching of network delays. The limited experimental results are confirmed and extended by simulations and theoretical arguments based on identical neurons with a fixed increase of the neuronal response latency per evoked spike. We anticipate our results to lead to better understanding of the suitability of this computational paradigm to account for the brain's functionalities and will require the development of new systematic mathematical methods beyond the methods developed for traditional Boolean algebra.

[1]  P. Maini,et al.  The Turing Model Comes of Molecular Age , 2006, Science.

[2]  J. Schiller,et al.  Dynamics of Excitability over Extended Timescales in Cultured Cortical Neurons , 2010, The Journal of Neuroscience.

[3]  Steve M. Potter,et al.  Long-Term Activity-Dependent Plasticity of Action Potential Propagation Delay and Amplitude in Cortical Networks , 2008, PloS one.

[4]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[5]  Steve M. Potter,et al.  An extremely rich repertoire of bursting patterns during the development of cortical cultures , 2006, BMC Neuroscience.

[6]  Frank C. Hoppensteadt,et al.  Polychronous Wavefront Computations , 2009, Int. J. Bifurc. Chaos.

[7]  Yuzuru Takamura,et al.  Investigating neuronal activity with planar microelectrode arrays: achievements and new perspectives. , 2005, Journal of bioscience and bioengineering.

[8]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[9]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[12]  Daniel Lehmann,et al.  Modeling Compositionality by Dynamic Binding of Synfire Chains , 2004, Journal of Computational Neuroscience.

[13]  E Kopelowitz,et al.  Sensitivity of global network dynamics to local parameters versus motif structure in a cortexlike neuronal model. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Claude E. Shannon,et al.  A symbolic analysis of relay and switching circuits , 1938, Transactions of the American Institute of Electrical Engineers.

[15]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[16]  Shimon Marom,et al.  Development, learning and memory in large random networks of cortical neurons: lessons beyond anatomy , 2002, Quarterly Reviews of Biophysics.

[17]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[18]  Wulfram Gerstner,et al.  Theory and Simulation in Neuroscience , 2012, Science.

[19]  Boris S. Gutkin,et al.  Spike frequency adaptation , 2014, Scholarpedia.

[20]  The Logician and the Engineer: How George Boole and Claude Shannon Created the Information Age , 2012 .

[21]  J. von Neumann,et al.  Probabilistic Logic and the Synthesis of Reliable Organisms from Unreliable Components , 1956 .

[22]  A. Krogh.  What are artificial neural networks? , 2008, Nature Biotechnology.

[23]  Shankar P. Bhattacharyya,et al.  Robustness And Fragility , 2009 .

[24]  Ido Kanter,et al.  Sudden synchrony leaps accompanied by frequency multiplications in neuronal activity , 2013, Front. Neural Circuits.

[25]  R. de Col,et al.  Conduction velocity is regulated by sodium channel inactivation in unmyelinated axons innervating the rat cranial meninges , 2008, The Journal of physiology.

[26]  Madalena Chaves,et al.  Robustness and fragility of Boolean models for genetic regulatory networks. , 2005, Journal of theoretical biology.

[27]  Shimon Marom,et al.  Frequency tuning of input-output relation in a rat cortical neuron in-vitro , 2001, Neuroscience Letters.

[28]  J. Neumann.  Probabilistic Logic and the Synthesis of Reliable Organisms from Unreliable Components , 1956 .

[29]  Gary Aston-Jones,et al.  Brain aminergic axons exhibit marked variability in conduction velocity , 1980, Brain Research.

[30]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[31]  Evidence of a physiological role for use‐dependent inactivation of NaV1.8 sodium channels , 2008, The Journal of physiology.

[32]  Ron Meir,et al.  Conductance-Based Neuron Models and the Slow Dynamics of Excitability , 2012, Front. Comput. Neurosci..

[33]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[34]  Ido Kanter,et al.  Synthetic reverberating activity patterns embedded in networks of cortical neurons , 2012, 1201.0339.

[35]  Henry Markram,et al.  Spike frequency adaptation and neocortical rhythms. , 2002, Journal of neurophysiology.

[36]  A. Turing,et al.  On Computable Numbers, with an Application to the Entscheidungsproblem. A Correction , 1938 .

[37]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[38]  Ido Kanter,et al.  Synchronization with mismatched synaptic delays: A unique role of elastic neuronal latency , 2012, 1209.2562.

[39]  W. Kinzel,et al.  Nonlocal mechanism for cluster synchronization in neural circuits , 2011, 1103.3634.

[40]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[41]  Andrew Hodges.  Beyond Turing's Machines , 2012, Science.

[42]  I. Parnas,et al.  Mechanisms involved in differential conduction of potentials at high frequency in a branching axon. , 1979, The Journal of physiology.

[43]  Y Yarom,et al.  Modulation of spike frequency by regions of special axonal geometry and by synaptic inputs. , 1976, Journal of neurophysiology.

[44]  G. Goranović,et al.  Theory and simulation. , 1996, Current opinion in structural biology.

[45]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[46]  F. Kawasaki,et al.  Fast synaptic fatigue in shibire mutants reveals a rapid requirement for dynamin in synaptic vesicle membrane trafficking , 2000, Nature Neuroscience.

[47]  Ido Kanter,et al.  An experimental evidence-based computational paradigm for new logic-gates in neuronal activity , 2013 .

[48]  Tim P Vogels,et al.  Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons , 2005, The Journal of Neuroscience.

[49]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[50]  Joël Tabak,et al.  Spike-Frequency Adaptation , 2014, Encyclopedia of Computational Neuroscience.

[51]  S. Duan,et al.  Acute and gradual increases in BDNF concentration elicit distinct signaling and functions in neurons , 2010, Nature Neuroscience.

[52]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[53]  Irwin D. Kuntz,et al.  Theory and simulation , 1994 .

[54]  Jehoshua Bruck,et al.  Neural network computation with DNA strand displacement cascades , 2011, Nature.

[55]  Aleksander W. Ballo,et al.  Complex Intrinsic Membrane Properties and Dopamine Shape Spiking Activity in a Motor Axon , 2009, The Journal of Neuroscience.

[56]  A. Thomson,et al.  Fluctuations in pyramid-pyramid excitatory postsynaptic potentials modified by presynaptic firing pattern and postsynaptic membrane potential using paired intracellular recordings in rat neocortex , 1993, Neuroscience.

[57]  J. Eccles,et al.  The excitatory synaptic action of climbing fibres on the Purkinje cells of the cerebellum , 1966, The Journal of physiology.

[58]  Dezhe Z. Jin,et al.  Support for a synaptic chain model of neuronal sequence generation , 2010, Nature.

[59]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[60]  Wim L. C. Rutten,et al.  Long-term characterization of firing dynamics of spontaneous bursts in cultured neural networks , 2004, IEEE Transactions on Biomedical Engineering.

[61]  Marco Zorzi,et al.  Emergence of a 'visual number sense' in hierarchical generative models , 2012, Nature Neuroscience.

[62]  Ido Kanter,et al.  Synchronization by elastic neuronal latencies. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.