Neuro-Inspired Spike-Based Motion: From Dynamic Vision Sensor to Robot Motor Open-Loop Control through Spike-VITE

In this paper we present a complete spike-based architecture: from a Dynamic Vision Sensor (retina) to a stereo head robotic platform. The aim of this research is to reproduce intended movements performed by humans taking into account as many features as possible from the biological point of view. This paper fills the gap between current spike silicon sensors and robotic actuators by applying a spike processing strategy to the data flows in real time. The architecture is divided into layers: the retina, visual information processing, the trajectory generator layer which uses a neuroinspired algorithm (SVITE) that can be replicated into as many times as DoF the robot has; and finally the actuation layer to supply the spikes to the robot (using PFM). All the layers do their tasks in a spike-processing mode, and they communicate each other through the neuro-inspired AER protocol. The open-loop controller is implemented on FPGA using AER interfaces developed by RTC Lab. Experimental results reveal the viability of this spike-based controller. Two main advantages are: low hardware resources (2% of a Xilinx Spartan 6) and power requirements (3.4 W) to control a robot with a high number of DoF (up to 100 for a Xilinx Spartan 6). It also evidences the suitable use of AER as a communication protocol between processing and actuation.

[1]  H. Nagasaki.  Asymmetric velocity and acceleration profiles of human arm movements , 2004, Experimental Brain Research.

[2]  Stephen Grossberg,et al.  Vector associative maps: Unsupervised real-time error-based learning and control of movement trajectories , 1991, Neural Networks.

[3]  Tobi Delbrück,et al.  A 5 Meps $100 USB2.0 Address-Event Monitor-Sequencer Interface , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[4]  Giulio Sandini,et al.  An experimental evaluation of a novel minimum-jerk cartesian controller for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  M. Domínguez-Morales,et al.  A Neuro-Inspired Spike-Based PID Motor Controller for Multi-Motor Robots with Low Cost FPGAs , 2012, Sensors.

[6]  P. N. Paraskevopoulos,et al.  Modern Control Engineering , 2001 .

[7]  N. Hatsopoulos,et al.  Sensing with the Motor Cortex , 2011, Neuron.

[8]  Massimo A. Sivilotti,et al.  Wiring considerations in analog VLSI systems, with application to field-programmable networks , 1992 .

[9]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[10]  J. Michael.  Textbook of Medical Physiology , 2005 .

[11]  E. Culurciello,et al.  A biomorphic digital image sensor , 2003, IEEE J. Solid State Circuits.

[12]  Bernabé Linares-Barranco,et al.  On algorithmic rate-coded AER generation , 2006, IEEE Transactions on Neural Networks.

[13]  J. Kalaska,et al.  Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. , 2000, Journal of neurophysiology.

[14]  A. Georgopoulos.  Neural integration of movement: role of motor cortex in reaching , 1988, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[15]  J. Griffin,et al.  Textbook of Medical Physiology 4th Ed , 1971 .

[16]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[17]  Ann M. Graybiel,et al.  Behavioural and cognitive neuroscience , 2011, Current Opinion in Neurobiology.

[18]  M. Domínguez-Morales,et al.  Simulating Building Blocks for Spikes Signals Processing , 2011, IWANN.

[19]  M. Domínguez-Morales,et al.  Spikes Monitors for FPGAs, an Experimental Comparative Study , 2013, IWANN.

[20]  Paul Cisek,et al.  Neural representations of motor plans, desired trajectories, and controlled objects , 2005, Cognitive Processing.

[21]  J.L. Contreras-Vidal,et al.  A neural network model for spino-muscular generation of launching and braking forces by opponent muscles , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[22]  M. Sekerli,et al.  An implementation of a simple neuron model in field programmable analog arrays , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Emmanuel Guigon,et al.  Generating human-like reaching movements with a humanoid robot: A computational approach , 2013, J. Comput. Sci..

[24]  Juan López Coronado,et al.  A neural model for visual-tactile-motor integration in robotic reaching and grasping tasks , 2002, Robotica.

[25]  Giulio Sandini,et al.  Force Control and Reaching Movements on the iCub Humanoid Robot , 2011, ISRR.

[26]  Patrick Camilleri,et al.  A Neuromorphic aVLSI network chip with configurable plastic synapses , 2007, 7th International Conference on Hybrid Intelligent Systems (HIS 2007).

[27]  W. Smith.  The Integrative Action of the Nervous System , 1907, Nature.

[28]  Juan López Coronado,et al.  AER Neuro-Inspired interface to Anthropomorphic Robotic Hand , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[29]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[30]  S. Grossberg,et al.  Neural representations for sensory-motor control, I: Head-centered 3-D target positions from opponent eye commands. , 1993, Acta psychologica.

[31]  Fernando Díaz del Río,et al.  Real time multiple objects tracking based on a bio-inspired processing cascade architecture , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[32]  T. Bullock.  The Reliability of Neurons , 1970, The Journal of general physiology.

[33]  Nikolaos G. Tsagarakis,et al.  iCub: the design and realization of an open humanoid platform for cognitive and neuroscience research , 2007, Adv. Robotics.

[34]  Juan López Coronado,et al.  Towards AER VITE: Building spike gate signal , 2012, 2012 19th IEEE International Conference on Electronics, Circuits, and Systems (ICECS 2012).

[35]  Jiménez Fernández,et al.  Diseño y evaluación de sistemas de control y procesamiento de señales basados en modelos neuronales pulsantes. , 2013 .

[36]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[37]  M. Hersch,et al.  A biologically-inspired controller for reaching movements , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[38]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  I. Scott MacKenzie,et al.  Speed-accuracy trade-off in planned arm movements with delayed feedback , 2006, Neural Networks.

[40]  R. Woodworth,et al.  The Integrative Action of the Nervous System , 1908 .

[41]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.