Self healable neuromorphic memtransistor elements for decentralized sensory signal processing in robotics

Sensory information processing in robot skins currently rely on a centralized approach where signal transduction (on the body) is separated from centralized computation and decision-making, requiring the transfer of large amounts of data from periphery to central processors, at the cost of wiring, latency, fault tolerance and robustness. We envision a decentralized approach where intelligence is embedded in the sensing nodes, using a unique neuromorphic methodology to extract relevant information in robotic skins. Here we specifically address pain perception and the association of nociception with tactile perception to trigger the escape reflex in a sensorized robotic arm. The proposed system comprises self-healable materials and memtransistors as enabling technologies for the implementation of neuromorphic nociceptors, spiking local associative learning and communication. Configuring memtransistors as gated-threshold and -memristive switches, the demonstrated system features in-memory edge computing with minimal hardware circuitry and wiring, and enhanced fault tolerance and robustness. Sensory information processing in robots relies on a centralized approach with issues of wiring, fault-tolerance and latency. Here, the authors report a decentralized neuromorphic approach with self-healable memristive elements enabling intelligent sensations in a prototypical robotic nervous system.

[1]  Zhenan Bao,et al.  A bioinspired flexible organic artificial afferent nerve , 2018, Science.

[2]  Giacomo Indiveri,et al.  A Scalable Multicore Architecture With Heterogeneous Memory Structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs) , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[3]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[4]  Benjamin C. K. Tee,et al.  An electrically and mechanically self-healing composite with pressure- and flexion-sensitive properties for electronic skin applications. , 2012, Nature nanotechnology.

[5]  Jin-Woo Han,et al.  Capacitive neural network with neuro-transistors , 2018, Nature Communications.

[6]  Zhengya Zhang,et al.  A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations , 2019, Nature Electronics.

[7]  Teresa J. Feo,et al.  Structural absorption by barbule microstructures of super black bird of paradise feathers , 2018, Nature Communications.

[8]  Chiara Bartolozzi,et al.  Event-driven encoding of off-the-shelf tactile sensors for compression and latency optimisation for robotic skin , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[10]  Rohit Abraham John,et al.  Field-Driven Athermal Activation of Amorphous Metal Oxide Semiconductors for Flexible Programmable Logic Circuits and Neuromorphic Electronics. , 2019, Small.

[11]  Bryan M. Wong,et al.  A Transparent, Self‐Healing, Highly Stretchable Ionic Conductor , 2016, Advanced materials.

[12]  Nitish V. Thakor,et al.  Prosthesis with neuromorphic multilayered e-dermis perceives touch and pain , 2018, Science Robotics.

[13]  C. Keplinger,et al.  A highly stretchable autonomous self-healing elastomer. , 2016, Nature chemistry.

[14]  Nitish V. Thakor,et al.  A kilohertz kilotaxel tactile sensor array for investigating spatiotemporal features in neuromorphic touch , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[15]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[16]  F. Roland,et al.  Global CO2 emissions from dry inland waters share common drivers across ecosystems , 2020, Nature Communications.

[17]  Huaqiang Wu,et al.  An artificial nociceptor based on a diffusive memristor , 2018, Nature Communications.

[18]  Yue Cao,et al.  Self-healing electronic skins for aquatic environments , 2019, Nature Electronics.

[19]  B. Katz,et al.  The role of calcium in neuromuscular facilitation , 1968, The Journal of physiology.

[20]  Gordon Cheng,et al.  Humanoid Multimodal Tactile-Sensing Modules , 2011, IEEE Transactions on Robotics.

[21]  Jürgen Sandkühler,et al.  Models and mechanisms of hyperalgesia and allodynia. , 2009, Physiological reviews.

[22]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[23]  S. Vavrus,et al.  The influence of Arctic amplification on mid-latitude summer circulation , 2018, Nature Communications.

[24]  Maja Loncar,et al.  Taming of the BEAST , 2007 .

[25]  I. Tracey Nociceptive processing in the human brain , 2005, Current Opinion in Neurobiology.

[26]  Naveen Tiwari,et al.  A rapid low temperature self-healable polymeric composite for flexible electronic devices , 2018 .

[27]  Chiara Bartolozzi,et al.  Synaptic Dynamics in Analog VLSI , 2007, Neural Computation.

[28]  Young Jae Kwon,et al.  Nociceptive Memristor , 2018, Advanced materials.

[29]  Alex Simpkins,et al.  Towards Service Robots for Everyday Environments: Recent Advances in Designing Service Robots for Complex Tasks in Everyday Environments (E. Prassler et al.; 2012) [On the Shelf] , 2013, IEEE Robotics & Automation Magazine.

[30]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[31]  Armantas Melianas,et al.  Parallel programming of an ionic floating-gate memory array for scalable neuromorphic computing , 2019, Science.

[32]  Giorgio Metta,et al.  A Flexible and Robust Large Scale Capacitive Tactile System for Robots , 2013, IEEE Sensors Journal.

[33]  Arindam Basu,et al.  Ultralow Power Dual-Gated Subthreshold Oxide Neuristors: An Enabler for Higher Order Neuronal Temporal Correlations. , 2018, ACS nano.

[34]  Gordon Cheng,et al.  Directions Toward Effective Utilization of Tactile Skin: A Review , 2013, IEEE Sensors Journal.

[35]  Maurizio Valle,et al.  Asynchronous, event-driven readout of POSFET devices for tactile sensing , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[36]  Gordon Cheng,et al.  A Comprehensive Realization of Robot Skin: Sensors, Sensing, Control, and Applications , 2019, Proceedings of the IEEE.

[37]  Nitish V. Thakor,et al.  An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[38]  Qiangfei Xia,et al.  An artificial spiking afferent nerve based on Mott memristors for neurorobotics , 2020, Nature Communications.

[39]  L. Abbott,et al.  Synaptic computation , 2004, Nature.

[40]  Zhenan Bao,et al.  Stretchable organic optoelectronic sensorimotor synapse , 2018, Science Advances.

[41]  H. Colquhoun Self-repairing polymers: materials that heal themselves. , 2012, Nature chemistry.

[42]  B Kollbe Ahn,et al.  Surface-initiated self-healing of polymers in aqueous media. , 2014, Nature materials.

[43]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[44]  Alessandro Roncone,et al.  Peripersonal Space and Margin of Safety around the Body: Learning Visuo-Tactile Associations in a Humanoid Robot with Artificial Skin , 2016, PloS one.

[45]  Helge J. Ritter,et al.  A High-Speed Tactile Sensor for Slip Detection , 2012, Towards Service Robots for Everyday Environments.

[46]  Jeffrey Weiler,et al.  Spinal stretch reflexes support efficient hand control , 2019, Nature Neuroscience.

[47]  Si Li,et al.  A neuro-inspired artificial peripheral nervous system for scalable electronic skins , 2019, Science Robotics.

[48]  Chiara Bartolozzi,et al.  Robots with a sense of touch. , 2016, Nature materials.

[49]  S. A. Khonsary Guyton and Hall: Textbook of Medical Physiology , 2017, Surgical Neurology International.

[50]  T. Jensen,et al.  Allodynia and hyperalgesia in neuropathic pain: clinical manifestations and mechanisms , 2014, The Lancet Neurology.

[51]  Snehashish Chakraverty,et al.  Hebbian Learning Rule , 2019, Concepts of Soft Computing.

[52]  Wei Yi,et al.  Biological plausibility and stochasticity in scalable VO2 active memristor neurons , 2018, Nature Communications.