A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback

Bionic hand provides accurate tactile and position information and leads to improved performance during sensing tasks. Current myoelectric prostheses allow transradial amputees to regain voluntary motor control of their artificial limb by exploiting residual muscle function in the forearm. However, the overreliance on visual cues resulting from a lack of sensory feedback is a common complaint. Recently, several groups have provided tactile feedback in upper limb amputees using implanted electrodes, surface nerve stimulation, or sensory substitution. These approaches have led to improved function and prosthesis embodiment. Nevertheless, the provided information remains limited to a subset of the rich sensory cues available to healthy individuals. More specifically, proprioception, the sense of limb position and movement, is predominantly absent from current systems. Here, we show that sensory substitution based on intraneural stimulation can deliver position feedback in real time and in conjunction with somatotopic tactile feedback. This approach allowed two transradial amputees to regain high and close-to-natural remapped proprioceptive acuity, with a median joint angle reproduction precision of 9.1° and a median threshold to detection of passive movements of 9.5°, which was comparable with results obtained in healthy participants. The simultaneous delivery of position information and somatotopic tactile feedback allowed both amputees to discriminate the size and compliance of four objects with high levels of performance (75.5%). These results demonstrate that tactile information delivered via somatotopic neural stimulation and position information delivered via sensory substitution can be exploited simultaneously and efficiently by transradial amputees. This study paves a way to more sophisticated bidirectional bionic limbs conveying richer, multimodal sensations.

[1]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Max Ortiz-Catalan,et al.  An osseointegrated human-machine gateway for long-term sensory feedback and motor control of artificial limbs , 2014, Science Translational Medicine.

[3]  Frank A. Saunders,et al.  Electrocutaneous Stimulation for Sensory Communication in Rehabilitation Engineering , 1982, IEEE Transactions on Biomedical Engineering.

[4]  D. McCloskey,et al.  Joint sense, muscle sense, and their combination as position sense, measured at the distal interphalangeal joint of the middle finger. , 1976, The Journal of physiology.

[5]  Silvestro Micera,et al.  Multisensory bionic limb to achieve prosthesis embodiment and reduce distorted phantom limb perceptions , 2018, Journal of Neurology, Neurosurgery, and Psychiatry.

[6]  C. Cipriani,et al.  Vibrotactile Stimulation Promotes Embodiment of an Alien Hand in Amputees With Phantom Sensations , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[8]  P. Rossini,et al.  Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans , 2016, eLife.

[9]  D. Burke,et al.  Perceptual responses to microstimulation of single afferents innervating joints, muscles and skin of the human hand. , 1990, The Journal of physiology.

[10]  Alicia J. Davis,et al.  Surveying the interest of individuals with upper limb loss in novel prosthetic control techniques , 2015, Journal of NeuroEngineering and Rehabilitation.

[11]  Dario Farina,et al.  Time-division multiplexing for myoelectric closed-loop control using electrotactile feedback , 2014, Journal of NeuroEngineering and Rehabilitation.

[12]  D. McCloskey,et al.  Detections of movements imposed on finger, elbow and shoulder joints. , 1983, The Journal of physiology.

[13]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[14]  S. Gandevia,et al.  The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. , 2012, Physiological reviews.

[15]  H. Bird,et al.  A novel device for the measurement of proprioception in the hand. , 2005, Rheumatology.

[16]  R D Sturrock,et al.  Position sense at the proximal interphalangeal joint is distorted in patients with rheumatoid arthritis of finger joints , 1992, Experimental physiology.

[17]  Gordon Waddington,et al.  Assessing proprioception: A critical review of methods , 2015, Journal of sport and health science.

[18]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[19]  Daniel Tan,et al.  Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis , 2016, Journal of neural engineering.

[20]  Christian Cipriani,et al.  Non-Invasive, Temporally Discrete Feedback of Object Contact and Release Improves Grasp Control of Closed-Loop Myoelectric Transradial Prostheses , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Dario Farina,et al.  Humans Can Integrate Augmented Reality Feedback in Their Sensorimotor Control of a Robotic Hand , 2017, IEEE Transactions on Human-Machine Systems.

[22]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[23]  Dario Farina,et al.  Closed-Loop Control of Myoelectric Prostheses With Electrotactile Feedback: Influence of Stimulation Artifact and Blanking , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  T. Stieglitz,et al.  A transverse intrafascicular multichannel electrode (TIME) to interface with the peripheral nerve. , 2010, Biosensors & bioelectronics.

[25]  A Mazzoni,et al.  Comparison of linear frequency and amplitude modulation for intraneural sensory feedback in bidirectional hand prostheses , 2018, Scientific Reports.

[26]  Dario Farina,et al.  GLIMPSE: Google Glass interface for sensory feedback in myoelectric hand prostheses , 2017, Journal of neural engineering.

[27]  Silvestro Micera,et al.  Biomimetic Intraneural Sensory Feedback Enhances Sensation Naturalness, Tactile Sensitivity, and Manual Dexterity in a Bidirectional Prosthesis , 2018, Neuron.

[28]  Thierry Keller,et al.  Multichannel Electrotactile Feedback With Spatial and Mixed Coding for Closed-Loop Control of Grasping Force in Hand Prostheses , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Guohong Chai,et al.  Characterization of evoked tactile sensation in forearm amputees with transcutaneous electrical nerve stimulation , 2015, Journal of neural engineering.

[30]  D. McCloskey,et al.  Proprioceptive sensation at the terminal joint of the middle finger. , 1983, The Journal of physiology.

[31]  K. Horch,et al.  Object Discrimination With an Artificial Hand Using Electrical Stimulation of Peripheral Tactile and Proprioceptive Pathways With Intrafascicular Electrodes , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Silvestro Micera,et al.  A somatotopic bidirectional hand prosthesis with transcutaneous electrical nerve stimulation based sensory feedback , 2017, Scientific Reports.

[33]  Li Li,et al.  Non-linearity in the dynamic world of human movement , 2016, Journal of sport and health science.

[34]  L. Miller,et al.  Electrical Stimulation of the Proprioceptive Cortex (Area 3a) Used to Instruct a Behaving Monkey , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Joseph E O'Doherty,et al.  A learning–based approach to artificial sensory feedback leads to optimal integration , 2014, Nature Neuroscience.

[36]  Kianoush Nazarpour,et al.  Artificial Proprioceptive Feedback for Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Keehoon Kim,et al.  Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. , 2011, Brain : a journal of neurology.

[38]  G A Clark,et al.  Restoring motor control and sensory feedback in people with upper extremity amputations using arrays of 96 microelectrodes implanted in the median and ulnar nerves , 2016, Journal of neural engineering.

[39]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[40]  G.S. Dhillon,et al.  Direct neural sensory feedback and control of a prosthetic arm , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  S Micera,et al.  Control of Hand Prostheses Using Peripheral Information , 2010, IEEE Reviews in Biomedical Engineering.

[42]  Arthur Prochazka,et al.  Sensory control of normal movement and of movement aided by neural prostheses , 2015, Journal of anatomy.

[43]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[44]  Rafael Granja-Vazquez,et al.  Illusory movement perception improves motor control for prosthetic hands , 2018, Science Translational Medicine.

[45]  M. Keith,et al.  A neural interface provides long-term stable natural touch perception , 2014, Science Translational Medicine.

[46]  Silvestro Micera,et al.  A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback , 2018 .