Object stiffness recognition using haptic feedback delivered through transcutaneous proximal nerve stimulation

OBJECTIVE Haptic feedback is crucial when we manipulate objects. Information pertaining to an object's stiffness in particular can help facilitate fine motor control. In this study, we seek to determine whether objects of different stiffness levels can be recognized using haptic feedback provided by transcutaneous electrical stimulation of peripheral nerves. APPROACH Using a stimulation electrode grid placed along the medial side of the upper arm, the median and ulnar nerve bundles were targeted to evoke haptic sensation on the palmar side of the hand. Stimulation current amplitude was modulated in real-time with the fingertip force recorded from a sensorized prosthetic hand. In order to evaluate which stimulation pattern was more critical, object stiffness was encoded either by the rate of change of the stimulus amplitude or the level of peak stimulus amplitude, as the prosthesis grasped the objects. MAIN RESULTS Both encoding methods allowed the subjects to differentiate objects of different stiffness levels with > 90% accuracy. No significant difference was observed between the two encoding methods, which indicated that both the rate of change of the stimulation amplitude and the peak stimulation amplitude could effectively provide stiffness information of the objects. SIGNIFICANCE The outcomes suggest that it is possible to elicit haptic sensations describing various object stiffness levels using transcutaneous nerve stimulation. The haptic feedback associated with object stiffness can facilitate object manipulation/interactions. It may also improve user experience during human-machine interactions, when object stiffness information is incorporated.

[1]  Filipp Schmidt,et al.  Inferring the stiffness of unfamiliar objects from optical, shape, and motion cues. , 2017, Journal of vision.

[2]  A. Wing,et al.  Active touch sensing , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[3]  M A Srinivasan,et al.  Manual discrimination of compliance using active pinch grasp: The roles of force and work cues , 1995, Perception & psychophysics.

[4]  Marcia K. O'Malley,et al.  Toward improved sensorimotor integration and learning using upper-limb prosthetic devices , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[5]  N. Durlach,et al.  Manual discrimination of force using active finger motion , 1991, Perception & psychophysics.

[6]  Yuru Zhang,et al.  More Identifiable Stiffness Feedback for Dexterous Hand Teleoperation in Unknown Environment , 2016, 2016 International Conference on Virtual Reality and Visualization (ICVRV).

[7]  Silvestro Micera,et al.  A somatotopic bidirectional hand prosthesis with transcutaneous electrical nerve stimulation based sensory feedback , 2017, Scientific Reports.

[8]  Nicoletta Risi,et al.  Supplemental vibrotactile feedback of real-time limb position enhances precision of goal-directed reaching , 2018, bioRxiv.

[9]  G. Pazour,et al.  Ror2 signaling regulates Golgi structure and transport through IFT20 for tumor invasiveness , 2017, Scientific Reports.

[10]  Dustin J Tyler,et al.  Neural interfaces for somatosensory feedback: bringing life to a prosthesis. , 2015, Current opinion in neurology.

[11]  Jacqueline S. Hebert,et al.  Applications of sensory feedback in motorized upper extremity prosthesis: a review , 2014, Expert review of medical devices.

[12]  Susan Hillier,et al.  The effectiveness of robotic-assisted gait training for paediatric gait disorders: systematic review , 2017, Journal of NeuroEngineering and Rehabilitation.

[13]  Christian Antfolk,et al.  A review of invasive and non-invasive sensory feedback in upper limb prostheses , 2017, Expert review of medical devices.

[14]  Peter H. Veltink,et al.  Stiffness Feedback for Myoelectric Forearm Prostheses Using Vibrotactile Stimulation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Daniel Tan,et al.  Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis , 2016, Journal of neural engineering.

[16]  Valay A. Shah,et al.  Supplemental vibrotactile feedback control of stabilization and reaching actions of the arm using limb state and position error encodings , 2017, Journal of NeuroEngineering and Rehabilitation.

[17]  Vivian C. Paulun,et al.  Shape, motion, and optical cues to stiffness of elastic objects. , 2017, Journal of vision.

[18]  Matthias Harders,et al.  Influence of visual and haptic delays on stiffness perception in augmented reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[19]  Gursel Alici,et al.  A Review of Non-Invasive Sensory Feedback Methods for Transradial Prosthetic Hands , 2018, IEEE Access.

[20]  Robert Riener,et al.  Control strategies for active lower extremity prosthetics and orthotics: a review , 2015, Journal of NeuroEngineering and Rehabilitation.

[21]  Valay A. Shah,et al.  Erratum to: Supplemental vibrotactile feedback control of stabilization and reaching actions of the arm using limb state and position error encodings , 2017, Journal of NeuroEngineering and Rehabilitation.

[22]  Y. Matsuoka,et al.  Repeated Training with Augmentative Vibrotactile Feedback Increases Object Manipulation Performance , 2012, PloS one.

[23]  Benoit P. Delhaye,et al.  The neural basis of perceived intensity in natural and artificial touch , 2016, Science Translational Medicine.

[24]  M. Diamond,et al.  Tactile perception and working memory in rats and humans , 2014, Proceedings of the National Academy of Sciences.

[25]  Hannes P. Saal,et al.  Touch is a team effort: interplay of submodalities in cutaneous sensibility , 2014, Trends in Neurosciences.

[26]  Andrew J Fuglevand,et al.  Object discrimination using electrotactile feedback , 2018, Journal of neural engineering.

[27]  A Curt,et al.  Preserved gait kinematics during controlled body unloading , 2017, Journal of NeuroEngineering and Rehabilitation.

[28]  C E Chapman,et al.  Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. , 1994, Canadian journal of physiology and pharmacology.

[29]  S Micera,et al.  Control of Hand Prostheses Using Peripheral Information , 2010, IEEE Reviews in Biomedical Engineering.

[30]  I. Nisky,et al.  Force feedback delay affects perception of stiffness but not action, and the effect depends on the hand used but not on the handedness. , 2018, Journal of neurophysiology.

[31]  Silvestro Micera,et al.  A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback , 2018, Science Robotics.

[32]  B L Richardson,et al.  Can passive touch be better than active touch? A comparison of active and passive tactile maze learning. , 1981, British journal of psychology.

[33]  D. G. Buma,et al.  Intermittent Stimulation Delays Adaptation to Electrocutaneous Sensory Feedback , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Takuji Narumi,et al.  Controlling perceived stiffness of pinched objects using visual feedback of hand deformation , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[35]  Xiaogang Hu,et al.  Evoked Haptic Sensation in the Hand With Concurrent Non-Invasive Nerve Stimulation , 2019, IEEE Transactions on Biomedical Engineering.

[36]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[37]  M. Srinivasan,et al.  Tactual discrimination of softness. , 1995, Journal of neurophysiology.

[38]  Blake Hannaford,et al.  Haptic characteristics of some activities of daily living , 2010, 2010 IEEE Haptics Symposium.

[39]  Frank A. Saunders,et al.  Electrocutaneous Stimulation for Sensory Communication in Rehabilitation Engineering , 1982, IEEE Transactions on Biomedical Engineering.

[40]  Francis K C Hui,et al.  The arcsine is asinine: the analysis of proportions in ecology. , 2011, Ecology.

[41]  Xiangyang Zhu,et al.  Somatotopical feedback versus non-somatotopical feedback for phantom digit sensation on amputees using electrotactile stimulation , 2015, Journal of NeuroEngineering and Rehabilitation.

[42]  Christopher J Hasson,et al.  Effects of kinematic vibrotactile feedback on learning to control a virtual prosthetic arm , 2015, Journal of NeuroEngineering and Rehabilitation.

[43]  K. Horch,et al.  Object Discrimination With an Artificial Hand Using Electrical Stimulation of Peripheral Tactile and Proprioceptive Pathways With Intrafascicular Electrodes , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Benoit P. Delhaye,et al.  Sensory adaptation to electrical stimulation of the somatosensory nerves , 2018, Journal of neural engineering.

[45]  David J. Warren,et al.  Restoration of motor control and proprioceptive and cutaneous sensation in humans with prior upper-limb amputation via multiple Utah Slanted Electrode Arrays (USEAs) implanted in residual peripheral arm nerves , 2017, Journal of NeuroEngineering and Rehabilitation.

[46]  Yong Zhu,et al.  Evoked haptic sensations in the hand via non-invasive proximal nerve stimulation , 2018, Journal of neural engineering.

[47]  Tamar R. Makin,et al.  Stability of Sensory Topographies in Adult Cortex , 2017, Trends in Cognitive Sciences.

[48]  D. Ginty,et al.  The Sensory Neurons of Touch , 2013, Neuron.

[49]  S. Vijayakumar,et al.  The role of feed-forward and feedback processes for closed-loop prosthesis control , 2011, Journal of NeuroEngineering and Rehabilitation.

[50]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[51]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.