Texture Discrimination using a Soft Biomimetic Finger for Prosthetic Applications

Soft robotic fingers have shown great potential for use in prostheses due to their inherent compliant, light, and dexterous nature. Recent advancements in sensor technology for soft robotic systems showcase their ability to perceive and respond to static cues. However, most of the soft fingers for use in prosthetic applications are not equipped with sensors which have the ability to perceive texture like humans can. In this work, we present a dexterous, soft, biomimetic solution which is capable of discrimination of textures. We fabricated a soft finger with two individually controllable degrees of freedom with a tactile sensor embedded at the fingertip. The output of the tac- tile sensor, as texture plates were palpated, was converted into spikes, mimicking the behavior of a biological mechanoreceptor. We explored the spatial properties of the textures captured in the form of spiking patterns by generating spatial event plots and analyzing the similarity between spike trains generated for each texture. Unique features representative of the different textures were then extracted from the spikes and input to a classifier. The textures were successfully classified with an accuracy of 94% when palpating at a rate of 42 mm/s. This work demonstrates the potential of providing amputees with a soft finger with sensing capabilities, which could potentially help discriminate between different objects and surfaces during activities of daily living (ADL) through palpation.

[1]  Yi Zhengkun,et al.  Recognizing tactile surface roughness with a biomimetic fingertip: A soft neuromorphic approach , 2017 .

[2]  Daniel M. Vogt,et al.  Soft Somatosensitive Actuators via Embedded 3D Printing , 2018, Advanced materials.

[3]  Marlı́s González-Fernández Development of upper limb prostheses: current progress and areas for growth. , 2014, Archives of physical medicine and rehabilitation.

[4]  Yi Sun,et al.  Stiffness Customization and Patterning for Property Modulation of Silicone-Based Soft Pneumatic Actuators. , 2017, Soft robotics.

[5]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[6]  G. Whitesides,et al.  Pneumatic Networks for Soft Robotics that Actuate Rapidly , 2014 .

[7]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[8]  Nitish V. Thakor,et al.  Dynamic Texture Decoding Using a Neuromorphic Multilayer Tactile Sensor , 2018, 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[9]  Paolo Dario,et al.  Biomedical applications of soft robotics , 2018, Nature Reviews Materials.

[10]  Nitish V. Thakor,et al.  An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[11]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[12]  J. Victor,et al.  Nature and precision of temporal coding in visual cortex: a metric-space analysis. , 1996, Journal of neurophysiology.

[13]  Nitish V. Thakor,et al.  Unsupervised Learning and Adaptive Classification of Neuromorphic Tactile Encoding of Textures , 2018, 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[14]  Alberto Mazzoni,et al.  Neuromorphic Artificial Touch for Categorization of Naturalistic Textures , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Nitish V. Thakor,et al.  Hybrid Tele-Manipulation System Using a Sensorized 3-D-Printed Soft Robotic Gripper and a Soft Fabric-Based Haptic Glove , 2017, IEEE Robotics and Automation Letters.

[16]  W. Marsden I and J , 2012 .

[17]  Yong-Lae Park,et al.  A soft multi-axis force sensor , 2012, 2012 IEEE Sensors.

[18]  Silvestro Micera,et al.  Biomimetic Intraneural Sensory Feedback Enhances Sensation Naturalness, Tactile Sensitivity, and Manual Dexterity in a Bidirectional Prosthesis , 2018, Neuron.

[19]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[20]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[21]  Nitish V. Thakor,et al.  Prosthesis with neuromorphic multilayered e-dermis perceives touch and pain , 2018, Science Robotics.

[22]  Robert J. Wood,et al.  Soft robotic glove for combined assistance and at-home rehabilitation , 2015, Robotics Auton. Syst..

[23]  R. Johansson,et al.  Representation of braille characters in human nerve fibres , 2006, Experimental Brain Research.

[24]  P. Rossini,et al.  Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans , 2016, eLife.

[25]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[26]  Nitish V. Thakor,et al.  Live demonstration: Prosthesis grip force modulation using neuromorphic tactile sensing , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[27]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[28]  Tony J. Prescott,et al.  Scholarpedia of Touch , 2016, Scholarpedia.

[29]  Jim Euchner Design , 2014, Catalysis from A to Z.