Liquid state machines and cultured cortical networks: The separation property

In vitro neural networks of cortical neurons interfaced to a computer via multichannel microelectrode arrays (MEA) provide a unique paradigm to create a hybrid neural computer. Unfortunately, only rudimentary information about these in vitro network's computational properties or the extent of their abilities are known. To study those properties, a liquid state machine (LSM) approach was employed in which the liquid (typically an artificial neural network) was replaced with a living cortical network and the input and readout functions were replaced by the MEA-computer interface. A key requirement of the LSM architecture is that inputs into the liquid state must result in separable outputs based on the liquid's response (separation property). In this paper, high and low frequency multi-site stimulation patterns were applied to the living cortical networks. Two template-based classifiers, one based on Euclidean distance and a second based on a cross-correlation were then applied to measure the separation of the input-output relationship. The result was over a 95% (99.8% when nonstationarity is compensated) input reconstruction accuracy for the high and low frequency patterns, confirming the existence of the separation property in these biological networks.

[1]  Henry Markram,et al.  A Model for Real-Time Computation in Generic Neural Microcircuits , 2002, NIPS.

[2]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[3]  Henry Markram,et al.  Temporal integration in recurrent microcircuits , 2003 .

[4]  Jean-Pascal Pfister,et al.  Optimality Model of Unsupervised Spike-Timing-Dependent Plasticity: Synaptic Memory and Weight Distribution , 2007, Neural Computation.

[5]  H. Robinson,et al.  Simultaneous induction of pathway-specific potentiation and depression in networks of cortical neurons. , 1999, Biophysical journal.

[6]  J. Bullier,et al.  Axons, but not cell bodies, are activated by electrical stimulation in cortical gray matter I. Evidence from chronaxie measurements , 1998, Experimental Brain Research.

[7]  Henry Markram,et al.  On the Computational Power of Recurrent Circuits of Spiking Neurons , 2002, Electron. Colloquium Comput. Complex..

[8]  T.B. DeMarse,et al.  MeaBench: A toolset for multi-electrode data acquisition and on-line analysis , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[9]  Wim L. C. Rutten,et al.  Long-term characterization of firing dynamics of spontaneous bursts in cultured neural networks , 2004, IEEE Transactions on Biomedical Engineering.

[10]  A Kawana,et al.  Segmentation of the response of a neuronal network into clusters with similar activity. , 1998, Bio Systems.

[11]  Vincent Torre,et al.  Toward the neurocomputer: image Processing and pattern recognition with neuronal cultures , 2005, IEEE Transactions on Biomedical Engineering.

[12]  Kazuyuki Aihara,et al.  Self-Organizing Dual Coding Based on Spike-Time-Dependent Plasticity , 2004, Neural Computation.

[13]  Jürg Streit,et al.  Mechanisms controlling bursting activity induced by disinhibition in spinal cord networks , 2002, The European journal of neuroscience.

[14]  Yasuhiko Jimbo,et al.  The dynamics of a neuronal culture of dissociated cortical neurons of neonatal rats , 2000, Biological Cybernetics.

[15]  Gal Chechik,et al.  Spike-Timing-Dependent Plasticity and Relevant Mutual Information Maximization , 2003, Neural Computation.

[16]  Irwin W. Sandberg,et al.  Uniform approximation of multidimensional myopic maps , 1997 .

[17]  H. Robinson,et al.  Spontaneous periodic synchronized bursting during formation of mature patterns of connections in cortical cultures , 1996, Neuroscience Letters.

[18]  H. Robinson,et al.  Strengthening of synchronized activity by tetanic stimulation in cortical cultures: application of planar electrode arrays , 1998, IEEE Transactions on Biomedical Engineering.

[19]  Yasuhiko Jimbo,et al.  Activity-dependent enhancement in the reliability of correlated spike timings in cultured cortical neurons , 1999, Biological Cybernetics.

[20]  Steve M. Potter,et al.  Plasticity of recurring spatiotemporal activity patterns in cortical networks , 2007, Physical biology.

[21]  Sander M. Bohte,et al.  Reducing the Variability of Neural Responses: A Computational Theory of Spike-Timing-Dependent Plasticity , 2007, Neural Computation.

[22]  T.B. DeMarse,et al.  Adaptive flight control with living neuronal networks on microelectrode arrays , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[23]  R. Segev,et al.  Hidden neuronal correlations in cultured networks. , 2004, Physical review letters.

[24]  Steve M. Potter,et al.  Effective parameters for stimulation of dissociated cultures using multi-electrode arrays , 2004, Journal of Neuroscience Methods.

[25]  Mark C. W. van Rossum,et al.  A Novel Spike Distance , 2001, Neural Computation.

[26]  Steve M. Potter,et al.  Precisely timed spatiotemporal patterns of neural activity in dissociated cortical cultures , 2007, Neuroscience.

[27]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[28]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[29]  G Shahaf,et al.  Learning in Networks of Cortical Neurons , 2001, The Journal of Neuroscience.

[30]  Daniel A. Wagenaar,et al.  The Neurally Controlled Animat: Biological Brains Acting with Simulated Bodies , 2001, Auton. Robots.

[31]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[32]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[33]  Jürg Streit,et al.  Patterns of spontaneous activity in unstructured and minimally structured spinal networks in culture , 2005, Experimental Brain Research.

[34]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .

[35]  Steve M. Potter,et al.  A new approach to neural cell culture for long-term studies , 2001, Journal of Neuroscience Methods.

[36]  B. Knight,et al.  Response variability and timing precision of neuronal spike trains in vivo. , 1997, Journal of neurophysiology.

[37]  Henry Markram,et al.  On the computational power of circuits of spiking neurons , 2004, J. Comput. Syst. Sci..

[38]  Steve M. Potter,et al.  Controlling Bursting in Cortical Cultures with Closed-Loop Multi-Electrode Stimulation , 2005, The Journal of Neuroscience.

[39]  H. Robinson,et al.  Modification of parallel activity elicited by propagating bursts in developing networks of rat cortical neurones , 1998, The European journal of neuroscience.

[40]  Steve M. Potter,et al.  Persistent dynamic attractors in activity patterns of cultured neuronal networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Shimon Marom,et al.  Development, learning and memory in large random networks of cortical neurons: lessons beyond anatomy , 2002, Quarterly Reviews of Biophysics.