Remote-neocortex control of robotic search and threat identification

Robots with remote processing capabilities would be useful in hazardous or complex environments presenting weight and cost constraints. We implemented a novel robotic system that incrementally triangulates and navigates towards a speaking target. This system comprises a distributed, biologically inspired, three-layer control system. High-level decision making is performed via Internet protocol by a pulse-coded neocortical simulator situated remotely in a secure location. The robot navigated towards and contacted an animated human mouth target in 75 of 80 trials (χ 2 = 20.3, P< 0.0001). Current work involves classification and appropriate tactical response to acquired audio and visual speech information.

[1]  Masayuki Inaba,et al.  A Platform for Robotics Research Based on the Remote-Brained Robot Approach , 2000, Int. J. Robotics Res..

[2]  J. Nerbonne,et al.  Calcium-independent depolarization-activated potassium currents in superior colliculus-projecting rat visual cortical neurons. , 1995, Journal of neurophysiology.

[3]  C. Stevens,et al.  Prediction of repetitive firing behaviour from voltage clamp data on an isolated neurone soma , 1971, The Journal of physiology.

[4]  Robert E Irie,et al.  Robust Sound Localization: An Application of an Auditory Perception System for a Humanoid Robot , 1995 .

[5]  B. Connors,et al.  Electrophysiological properties of neocortical neurons in vitro. , 1982, Journal of neurophysiology.

[6]  C. Koch,et al.  Multiple channels and calcium dynamics , 1989 .

[7]  R. S. Waters,et al.  Specificity in the interaction of HVA Ca2+ channel types with Ca2+-dependent AHPs and firing behavior in neocortical pyramidal neurons. , 1998, Journal of neurophysiology.

[8]  D. Surmeier,et al.  Voltage-gated potassium currents in acutely dissociated rat cortical neurons. , 1993, Journal of neurophysiology.

[9]  H. Markram,et al.  Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. , 2000, Science.

[10]  Mete Erturk,et al.  A NEUROMORPHIC APPROACH TO THE ANALYSIS OF MONAURAL AND BINAURAL AUDITORY SIGNALS , 1999 .

[11]  W. J. Nowack.  Methods in Neuronal Modeling , 1991, Neurology.

[12]  James G. King,et al.  A novel parallel hardware and software solution for a large-scale biologically realistic cortical simulation , 2006, CAINE.

[13]  J J Hopfield,et al.  What is a moment? "Cortical" sensory integration over a brief interval. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[14]  R. L. de Valois,et al.  Relationship between spatial-frequency and orientation tuning of striate-cortex cells. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[15]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[16]  P. Schwindt,et al.  Multiple potassium conductances and their functions in neurons from cat sensorimotor cortex in vitro. , 1988, Journal of neurophysiology.

[17]  James U. Korein,et al.  Robotics , 2018, IBM Syst. J..

[18]  Henry Markram,et al.  An Algorithm for Modifying Neurotransmitter Release Probability Based on Pre- and Postsynaptic Spike Timing , 2001, Neural Computation.

[19]  Frederick C. Harris,et al.  Implementation of a Biologically Realistic Parallel Neocortical-Neural Network Simulator , 2001, PPSC.

[20]  J. Storm,et al.  Action potential repolarization and a fast after‐hyperpolarization in rat hippocampal pyramidal cells. , 1987, The Journal of physiology.

[21]  D Schild,et al.  Small conductance potassium channels cause an activity-dependent spike frequency adaptation and make the transfer function of neurons logarithmic. , 1999, Biophysical journal.

[22]  J. Nerbonne,et al.  Role of voltage-gated K+ currents in mediating the regular-spiking phenotype of callosal-projecting rat visual cortical neurons. , 1997, Journal of neurophysiology.

[23]  James B. Maciokas,et al.  Large-Scale Spike-Timing-Dependent-Plasticity Model of Bimodal ( Audio / Visual ) Processing , 2002 .

[24]  Frederick C. Harris,et al.  A large scale biologically realistic cortical simulator , 2001 .

[25]  E. Ruppin.  Evolutionary autonomous agents: A neuroscience perspective , 2002, Nature Reviews Neuroscience.

[26]  H. Markram,et al.  Potential for multiple mechanisms, phenomena and algorithms for synaptic plasticity at single synapses , 1998, Neuropharmacology.