Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses

A multigrasp, bidirectional hand prosthesis delivers dynamic sensory feedback, allowing a user with a hand amputation to achieve fine grasping force control and realistic object sensing. An Artificial Hand’s Sense of Touch To feel the hard curvature of a baseball or the soft cylinder that is a soda can—these sensations we often take for granted. But amputees with a prosthetic arm know only that they are holding an object, the shape and stiffness discernible only by eye or from experience. Toward a more sophisticated prosthetic that can “feel” an object, Raspopovic and colleagues incorporated a feedback system connected to the amputee’s arm nerves, which delivers sensory information in real time. The authors connected electrodes in the arm nerves to sensors in two fingers of the prosthetic hand. To “feel” an object, the electrodes delivered electrical stimuli to the nerves that were proportional to the finger sensor readouts. To grasp an object and perform other motor commands, muscle signals were decoded. This bidirectional hand prosthetic was tested in a single amputee who was blindfolded and acoustically shielded to assure that sound and vision were not being used to manipulate objects. In more than 700 trials, the subject showed that he could modulate force and grasp and identify physical characteristics of different types of objects, such as cotton balls, an orange, and a piece of wood. Such sensory feedback with precise control over a hand prosthetic would allow amputees to more freely and naturally explore their environments. Hand loss is a highly disabling event that markedly affects the quality of life. To achieve a close to natural replacement for the lost hand, the user should be provided with the rich sensations that we naturally perceive when grasping or manipulating an object. Ideal bidirectional hand prostheses should involve both a reliable decoding of the user’s intentions and the delivery of nearly “natural” sensory feedback through remnant afferent pathways, simultaneously and in real time. However, current hand prostheses fail to achieve these requirements, particularly because they lack any sensory feedback. We show that by stimulating the median and ulnar nerve fascicles using transversal multichannel intrafascicular electrodes, according to the information provided by the artificial sensors from a hand prosthesis, physiologically appropriate (near-natural) sensory information can be provided to an amputee during the real-time decoding of different grasping tasks to control a dexterous hand prosthesis. This feedback enabled the participant to effectively modulate the grasping force of the prosthesis with no visual or auditory feedback. Three different force levels were distinguished and consistently used by the subject. The results also demonstrate that a high complexity of perception can be obtained, allowing the subject to identify the stiffness and shape of three different objects by exploiting different characteristics of the elicited sensations. This approach could improve the efficacy and “life-like” quality of hand prostheses, resulting in a keystone strategy for the near-natural replacement of missing hands.

[1]  Miles C. Bowman,et al.  Control strategies in object manipulation tasks , 2006, Current Opinion in Neurobiology.

[2]  H. E. Torebjörk,et al.  Peripheral projections of fascicles in the human median nerve. , 1983, Brain : a journal of neurology.

[3]  A. Goodwin,et al.  Encoding of object curvature by tactile afferents from human fingers. , 1997, Journal of neurophysiology.

[4]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[5]  J. Gerring A case study , 2011, Technology and Society.

[6]  Christine Connolly,et al.  Prosthetic hands from Touch Bionics , 2008, Ind. Robot.

[7]  Jian Zhang,et al.  Residual motor signal in long-term human severed peripheral nerves and feasibility of neural signal-controlled artificial limb. , 2007, The Journal of hand surgery.

[8]  Vittorio Pizzella,et al.  A neuromagnetic study of movement-related somatosensory gating in the human brain , 2004, Experimental Brain Research.

[9]  J. Ochoa,et al.  Innervation territories for touch and pain afferents of single fascicles of the human ulnar nerve. Mapping through intraneural microrecording and microstimulation. , 1990, Brain : a journal of neurology.

[10]  Robert D. Lipschutz,et al.  Targeted reinnervation for enhanced prosthetic arm function in a woman with a proximal amputation: a case study , 2007, The Lancet.

[11]  Elaine Biddiss,et al.  Consumer design priorities for upper limb prosthetics , 2007, Disability and rehabilitation. Assistive technology.

[12]  K. Horch,et al.  Effects of short-term training on sensory and motor function in severed nerves of long-term human amputees. , 2005, Journal of neurophysiology.

[13]  Silvestro Micera,et al.  Design of a cybernetic hand for perception and action , 2006, Biological Cybernetics.

[14]  Silvestro Micera,et al.  A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems , 2005, Journal of the peripheral nervous system : JPNS.

[15]  K. Reilly,et al.  Persistent hand motor commands in the amputees' brain. , 2006, Brain : a journal of neurology.

[16]  T. Stieglitz,et al.  A transverse intrafascicular multichannel electrode (TIME) to interface with the peripheral nerve. , 2010, Biosensors & bioelectronics.

[17]  Stuart D. Harshbarger,et al.  An Overview of the Developmental Process for the Modular Prosthetic Limb , 2011 .

[18]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[19]  Blair A. Lock,et al.  Redirection of cutaneous sensation from the hand to the chest skin of human amputees with targeted reinnervation , 2007, Proceedings of the National Academy of Sciences.

[20]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[21]  T. Kuiken,et al.  Sensory capacity of reinnervated skin after redirection of amputated upper limb nerves to the chest , 2009, Brain : a journal of neurology.

[22]  K. Horch,et al.  Residual function in peripheral nerve stumps of amputees: implications for neural control of artificial limbs. , 2004, The Journal of hand surgery.

[23]  D. Atkins,et al.  Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities , 1996 .

[24]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[25]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[26]  A. Goodwin,et al.  Sensory signals in neural populations underlying tactile perception and manipulation. , 2004, Annual review of neuroscience.

[27]  M. Srinivasan,et al.  Tactual discrimination of softness. , 1995, Journal of neurophysiology.

[28]  R. Schmidt,et al.  Responsiveness of the somatosensory system after nerve injury and amputation in the human hand , 1994, Annals of neurology.

[29]  Antonio Frisoli,et al.  The contribution of cutaneous and kinesthetic sensory modalities in haptic perception of orientation , 2011, Brain Research Bulletin.

[30]  P. Rossini,et al.  Double nerve intraneural interface implant on a human amputee for robotic hand control , 2010, Clinical Neurophysiology.

[31]  R.F. Weir,et al.  The Optimal Controller Delay for Myoelectric Prostheses , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.