MEART: The Semi-Living Artist

Here, we and others describe an unusual neurorobotic project, a merging of art and science called MEART, the semi-living artist. We built a pneumatically actuated robotic arm to create drawings, as controlled by a living network of neurons from rat cortex grown on a multi-electrode array (MEA). Such embodied cultured networks formed a real-time closed-loop system which could now behave and receive electrical stimulation as feedback on its behavior. We used MEART and simulated embodiments, or animats, to study the network mechanisms that produce adaptive, goal-directed behavior. This approach to neural interfacing will help instruct the design of other hybrid neural-robotic systems we call hybrots. The interfacing technologies and algorithms developed have potential applications in responsive deep brain stimulation systems and for motor prosthetics using sensory components. In a broader context, MEART educates the public about neuroscience, neural interfaces, and robotics. It has paved the way for critical discussions on the future of bio-art and of biotechnology.

[1]  A. Clark.  Being There: Putting Brain, Body, and World Together Again , 1996 .

[2]  Steve M. Potter,et al.  Effective parameters for stimulation of dissociated cultures using multi-electrode arrays , 2004, Journal of Neuroscience Methods.

[3]  Steve M. Potter,et al.  Precisely timed spatiotemporal patterns of neural activity in dissociated cortical cultures , 2007, Neuroscience.

[4]  Jean-Arcady Meyer,et al.  From SAB90 to SAB94: four years of animat research , 1994 .

[5]  Leslie Marsh.  Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence , 2009 .

[6]  S. Martinoiaa,et al.  Towards an embodied in vitro electrophysiology: the NeuroBIT project , 2004 .

[7]  H. Robinson,et al.  Simultaneous induction of pathway-specific potentiation and depression in networks of cortical neurons. , 1999, Biophysical journal.

[8]  S. Nelson,et al.  Hebb and homeostasis in neuronal plasticity , 2000, Current Opinion in Neurobiology.

[9]  Steve M. Potter,et al.  Multi-site two-photon imaging of neurons on multi-electrode arrays , 2001 .

[10]  Kevin Warwick.  Natural-born cyborgs: Minds, technologies and the future of human intelligence , 2003 .

[11]  Daniel A. Wagenaar,et al.  Closing the Loop: Stimulation Feedback Systems for Embodied MEA Cultures , 2006 .

[12]  Neil C. Manson,et al.  Brains, vats, and neurally-controlled animats , 2004 .

[13]  Steve M. Potter,et al.  Persistent dynamic attractors in activity patterns of cultured neuronal networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Michela Chiappalone,et al.  Computational analysis in vitro: dynamics and plasticity of a neuro-robotic system , 2005, Journal of neural engineering.

[15]  Ferdinando A. Mussa-Ivaldi,et al.  Connecting Brains to Robots: An Artificial Body for Studying the Computational Properties of Neural Tissues , 2000, Artificial Life.

[16]  Yan Wu,et al.  Multisite two-photon imaging of neurons on multielectrode arrays , 2001, SPIE BiOS.

[17]  Steve M. Potter,et al.  Region-specific network plasticity in simulated and living cortical networks: comparison of the center of activity trajectory (CAT) with other statistics , 2007, Journal of neural engineering.

[18]  L. Munari.  How the body shapes the way we think — a new view of intelligence , 2009 .

[19]  Don M. Long.  Toward replacement parts of the brain, implantable biomimetic electronics as neural prostheses , 2006 .

[20]  T. Kellam,et al.  Artificial Minds , 1996, Inf. Process. Manag..

[21]  A. Georgopoulos.  Population activity in the control of movement. , 1994, International review of neurobiology.

[22]  E. Fetz,et al.  Long-term motor cortex plasticity induced by an electronic neural implant , 2006, Nature.

[23]  Steve M. Potter,et al.  c 5 D ) Animat in a Petri Dish : Cultured Neural Networks for Studying Neural Computation , 2022 .

[24]  Steve M. Potter,et al.  A versatile all-channel stimulator for electrode arrays, with real-time control , 2004, Journal of neural engineering.

[25]  P. S. Wolters,et al.  Longterm stability and developmental changes in spontaneous network burst firing patterns in dissociated rat cerebral cortex cell cultures on multielectrode arrays , 2004, Neuroscience Letters.

[26]  S.M. Potter,et al.  Adaptive Goal-Directed Behavior in Embodied Cultured Networks: Living Neuronal Networks and a Simulated Model , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[27]  Steve M. Potter,et al.  Removing Some 'A' from AI: Embodied Cultured Networks , 2003, Embodied Artificial Intelligence.

[28]  T.B. DeMarse,et al.  MeaBench: A toolset for multi-electrode data acquisition and on-line analysis , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[29]  Steve M. Potter,et al.  An extremely rich repertoire of bursting patterns during the development of cortical cultures , 2006, BMC Neuroscience.

[30]  Johanna Drucker.  Digital Reflections: The Dialogue of Art and Technology , 1997 .

[31]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[32]  Sergio Martinoia,et al.  Connecting Neurons to a Mobile Robot: An In Vitro Bidirectional Neural Interface , 2007, Comput. Intell. Neurosci..

[33]  Steve M. Potter,et al.  Controlling Bursting in Cortical Cultures with Closed-Loop Multi-Electrode Stimulation , 2005, The Journal of Neuroscience.

[34]  Daniel A. Wagenaar,et al.  Effects of random external background stimulation on network synaptic stability after tetanization , 2007, Neuroinformatics.

[35]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[36]  Steve M. Potter,et al.  A new approach to neural cell culture for long-term studies , 2001, Journal of Neuroscience Methods.

[37]  Steve M. Potter.  What can Artificial Intelligence get from Neuroscience , 2007 .

[38]  R. Caminiti,et al.  Shift of preferred directions of premotor cortical cells with arm movements performed across the workspace , 2004, Experimental Brain Research.

[39]  Vittorio Sanguineti,et al.  Encoding of Time-varying Stimuli in Populations of Cultured Neurons , 2006, Biological Cybernetics.

[40]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[41]  Daniel A. Wagenaar,et al.  The Neurally Controlled Animat: Biological Brains Acting with Simulated Bodies , 2001, Auton. Robots.

[42]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[43]  Suguru N. Kudoh,et al.  Interaction and intelligence in living neuronal networks interfaced with moving robot , 2005, SPIE Micro + Nano Materials, Devices, and Applications.