Neuromorphic Artificial Sense of Touch: Bridging Robotics and Neuroscience

The development of a neuromorphic artificial sense of touch is presented. The system allows to code tactile information by means of a sequence of spikes, mimicking the neural dynamics of SA and FA human mechanoreceptors. The developed neuromorphic fingertip was able to encode naturalistic textures with a very high rate of disambiguation, up to 97% over a 10% chance level, by means of Victor-Purpura spike metrics and kNN decoding. A neurocomputational architecture inspired to the Cuneate Nucleus was also developed in order to achieve categorization of tactile stimuli in real-time while gathering the data stream. The implemented architecture was assessed by experimenting stimuli differing in the orientation of the tactile edges. The presented results are intended to contribute towards the restoration of a quasi-natural sense of touch in limb neuroprostheses, to develop effective and computationally lean artificial touch systems for robotic applications and to contribute to the open neuroscientific debate about the human somatosensory system.

[1]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[2]  Alberto Mazzoni,et al.  Neuromorphic Artificial Touch for Categorization of Naturalistic Textures , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[3]  S. Lederman,et al.  Human Hand Function , 2006 .

[4]  Angelo Arleo,et al.  Encoding/decoding of first and second order tactile afferents in a neurorobotic application , 2011, Journal of Physiology-Paris.

[5]  Nicolas Brunel,et al.  Encoding of Naturalistic Stimuli by Local Field Potential Spectra in Networks of Excitatory and Inhibitory Neurons , 2008, PLoS Comput. Biol..

[6]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[7]  Vincent Hayward,et al.  Spatio-temporal skin strain distributions evoke low variability spike responses in cuneate neurons , 2014, Journal of The Royal Society Interface.

[8]  L L Bologna,et al.  A closed-loop neurobotic system for fine touch sensing , 2013, Journal of neural engineering.

[9]  Kenneth O. Johnson,et al.  Neural Coding Mechanisms in Tactile Pattern Recognition: The Relative Contributions of Slowly and Rapidly Adapting Mechanoreceptors to Perceived Roughness , 1997, The Journal of Neuroscience.

[10]  J. Victor,et al.  Nature and precision of temporal coding in visual cortex: a metric-space analysis. , 1996, Journal of neurophysiology.

[11]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[12]  J. Craig,et al.  Texture perception through direct and indirect touch: An analysis of perceptual space for tactile textures in two modes of exploration , 2007, Somatosensory & motor research.

[13]  P. Dario,et al.  Investigation on calibration methods for multi-axis, linear and redundant force sensors , 2007 .

[14]  D. Ginty,et al.  The Sensory Neurons of Touch , 2013, Neuron.

[15]  K. Johnson,et al.  Neural coding of tactile texture: comparison of spatial and temporal mechanisms for roughness perception , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  '. B.Vallbo.  Properties of cutaneous mechanoreceptors in the human hand-related to touch sensation , 1999 .

[17]  Christian Cipriani,et al.  Roughness Encoding for Discrimination of Surfaces in Artificial Active-Touch , 2011, IEEE Transactions on Robotics.

[18]  Nicola Vitiello,et al.  A mechatronic platform for human touch studies , 2011 .

[19]  Jürgen Schmidhuber,et al.  Learning tactile skills through curious exploration , 2012, Front. Neurorobot..

[20]  M. Hollins,et al.  Vibrotactile adaptation impairs discrimination of fine, but not coarse, textures. , 2001, Somatosensory & motor research.

[21]  Gregory J. Gerling,et al.  An engineered tactile afferent modulation platform to elicit compound sensory nerve action potentials in response to force magnitude , 2013, 2013 World Haptics Conference (WHC).

[22]  P. Dario,et al.  Design and fabrication of a hybrid silicon three-axial force sensor for biomechanical applications , 2005 .

[23]  Maria Chiara Carrozza,et al.  Roughness Encoding in Human and Biomimetic Artificial Touch: Spatiotemporal Frequency Modulation and Structural Anisotropy of Fingerprints , 2011, Sensors.

[24]  Tony J. Prescott,et al.  Neuromorphic and Brain-Based Robots: Biomimetic robots as scientific models: a view from the whisker tip , 2011 .

[25]  G. Vallortigara.  Minds of Their Own , 1998, Trends in Cognitive Sciences.

[26]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[27]  Blake Hannaford,et al.  Guest Editorial Special Issue on Biorobotics , 2008, IEEE Transactions on Robotics.

[28]  M. Hollins,et al.  Evidence for the duplex theory of tactile texture perception , 2000, Perception & psychophysics.

[29]  T. Prescott,et al.  Biomimetic vibrissal sensing for robots , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  M. Keith,et al.  A neural interface provides long-term stable natural touch perception , 2014, Science Translational Medicine.

[31]  Kenneth O. Johnson,et al.  Neural Coding Mechanisms Underlying Perceived Roughness of Finely Textured Surfaces , 2001, The Journal of Neuroscience.

[32]  P. Dario,et al.  Development and Experimental Analysis of a Soft Compliant Tactile Microsensor for Anthropomorphic Artificial Hand , 2008, IEEE/ASME Transactions on Mechatronics.

[33]  Paolo Dario,et al.  Tactile sensing: Technology and applications , 1991 .

[34]  V. Hayward,et al.  Segregation of Tactile Input Features in Neurons of the Cuneate Nucleus , 2014, Neuron.

[35]  Nigel H. Lovell,et al.  Generating tactile afferent stimulation patterns for slip and touch feedback in neural prosthetics , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  M. Hollins,et al.  The vibrations of texture , 2003, Somatosensory & motor research.

[37]  N. V. Thakor,et al.  Bio-mimetic strategies for tactile sensing , 2013, 2013 IEEE SENSORS.

[38]  Robert D. Howe,et al.  Tactile sensing and control of robotic manipulation , 1993, Adv. Robotics.

[39]  Thomas Kreuz,et al.  Measures of spike train synchrony , 2011, Scholarpedia.

[40]  M. C. Carrozza,et al.  Soft-neuromorphic artificial touch for applications in neuro-robotics , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[41]  G. Debrégeas,et al.  The Role of Fingerprints in the Coding of Tactile Information Probed with a Biomimetic Sensor , 2009, Science.