Psychometric characterization of incidental feedback sources during grasping with a hand prosthesis

BackgroundA prosthetic system should ideally reinstate the bidirectional communication between the user’s brain and its end effector by restoring both motor and sensory functions lost after an amputation. However, current commercial prostheses generally do not incorporate somatosensory feedback. Even without explicit feedback, grasping using a prosthesis partly relies on sensory information. Indeed, the prosthesis operation is characterized by visual and sound cues that could be exploited by the user to estimate the prosthesis state. However, the quality of this incidental feedback has not been objectively evaluated.MethodsIn this study, the psychometric properties of the auditory and visual feedback of prosthesis motion were assessed and compared to that of a vibro-tactile interface. Twelve able-bodied subjects passively observed prosthesis closing and grasping an object, and they were asked to discriminate (experiment I) or estimate (experiment II) the closing velocity of the prosthesis using visual (VIS), acoustic (SND), or combined (VIS + SND) feedback. In experiment II, the subjects performed the task also with a vibrotactile stimulus (VIB) delivered using a single tactor. The outcome measures for the discrimination and estimation experiments were just noticeable difference (JND) and median absolute estimation error (MAE), respectively.ResultsThe results demonstrated that the incidental sources provided a remarkably good discrimination and estimation of the closing velocity, significantly outperforming the vibrotactile feedback. Using incidental sources, the subjects could discriminate almost the minimum possible increment/decrement in velocity that could be commanded to the prosthesis (median JND < 2% for SND and VIS + SND). Similarly, the median MAE in estimating the prosthesis velocity randomly commanded from the full working range was also low, i.e., approximately 5% in SND and VIS + SND.ConclusionsSince the closing velocity is proportional to grasping force in state-of-the-art myoelectric prostheses, the results of the present study imply that the incidental feedback, when available, could be usefully exploited for grasping force control. Therefore, the impact of incidental feedback needs to be considered when designing a feedback interface in prosthetics, especially since the quality of estimation using supplemental sources (e.g., vibration) can be worse compared to that of the intrinsic cues.

[1]  Y. Matsuoka,et al.  Repeated Training with Augmentative Vibrotactile Feedback Increases Object Manipulation Performance , 2012, PloS one.

[2]  S C Jacobsen,et al.  Extended physiologic taction: design and evaluation of a proportional force feedback system. , 1989, Journal of rehabilitation research and development.

[3]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[4]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[5]  J C Rothwell,et al.  Manual motor performance in a deafferented man. , 1982, Brain : a journal of neurology.

[6]  M. Keith,et al.  A neural interface provides long-term stable natural touch perception , 2014, Science Translational Medicine.

[7]  Ali Zarrinpar,et al.  Portable device for the analysis of liver function: a boon to liver surgery and critical care , 2016, Expert review of medical devices.

[8]  Jacqueline S. Hebert,et al.  Novel Targeted Sensory Reinnervation Technique to Restore Functional Hand Sensation After Transhumeral Amputation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Dario Farina,et al.  The clinical relevance of advanced artificial feedback in the control of a multi-functional myoelectric prosthesis , 2018, Journal of NeuroEngineering and Rehabilitation.

[10]  Stefan Glasauer,et al.  How predictive is grip force control in the complete absence of somatosensory feedback? , 2004, Brain : a journal of neurology.

[11]  Christian Cipriani,et al.  Improving internal model strength and performance of prosthetic hands using augmented feedback , 2018, Journal of NeuroEngineering and Rehabilitation.

[12]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[13]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[14]  Jacqueline S. Hebert,et al.  Applications of sensory feedback in motorized upper extremity prosthesis: a review , 2014, Expert review of medical devices.

[15]  A Mazzoni,et al.  Comparison of linear frequency and amplitude modulation for intraneural sensory feedback in bidirectional hand prostheses , 2018, Scientific Reports.

[16]  Dario Farina,et al.  Sensory Feedback in Prosthetics: A Standardized Test Bench for Closed-Loop Control , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  D. Wolpert Probabilistic models in human sensorimotor control. , 2007, Human movement science.

[18]  Manuel G. Catalano,et al.  HapPro: A Wearable Haptic Device for Proprioceptive Feedback , 2019, IEEE Transactions on Biomedical Engineering.

[19]  Dario Farina,et al.  Myocontrol is closed-loop control: incidental feedback is sufficient for scaling the prosthesis force in routine grasping , 2018, Journal of NeuroEngineering and Rehabilitation.

[20]  Silvestro Micera,et al.  Biomimetic Intraneural Sensory Feedback Enhances Sensation Naturalness, Tactile Sensitivity, and Manual Dexterity in a Bidirectional Prosthesis , 2018, Neuron.

[21]  Marcia Kilchenman O'Malley,et al.  Tactile Feedback of Object Slip Facilitates Virtual Object Manipulation , 2015, IEEE Transactions on Haptics.

[22]  Edoardo Battaglia,et al.  The Rice Haptic Rocker: Skin stretch haptic feedback with the Pisa/IIT SoftHand , 2017, 2017 IEEE World Haptics Conference (WHC).

[23]  N. Prins Psychophysics: A Practical Introduction , 2009 .

[24]  R N Scott,et al.  Myoelectric prostheses: state of the art. , 1988, Journal of medical engineering & technology.

[25]  A. Fuglevand,et al.  Perception of electrical and mechanical stimulation of the skin: implications for electrotactile feedback , 2009, Journal of neural engineering.

[26]  Dario Farina,et al.  EMG Biofeedback for online predictive control of grasping force in a myoelectric prosthesis , 2015, Journal of NeuroEngineering and Rehabilitation.

[27]  Daniel Tan,et al.  Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis , 2016, Journal of neural engineering.

[28]  Jason Friedman,et al.  Visuomotor behaviors and performance in a dual-task paradigm with and without vibrotactile feedback when using a myoelectric controlled hand , 2018, Assistive technology : the official journal of RESNA.

[29]  Christian Antfolk,et al.  A review of invasive and non-invasive sensory feedback in upper limb prostheses , 2017, Expert review of medical devices.

[30]  Peter H. Veltink,et al.  Stiffness Feedback for Myoelectric Forearm Prostheses Using Vibrotactile Stimulation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Dario Farina,et al.  New developments in prosthetic arm systems , 2016, Orthopedic research and reviews.

[32]  Nitish V. Thakor,et al.  Testing a Prosthetic Haptic Feedback Simulator With an Interactive Force Matching Task , 2008 .

[33]  Silvestro Micera,et al.  Intraneural sensory feedback restores grip force control and motor coordination while using a prosthetic hand , 2019, Journal of neural engineering.

[34]  Max Ortiz-Catalan,et al.  An osseointegrated human-machine gateway for long-term sensory feedback and motor control of artificial limbs , 2014, Science Translational Medicine.

[35]  Frank A. Saunders,et al.  Electrocutaneous Stimulation for Sensory Communication in Rehabilitation Engineering , 1982, IEEE Transactions on Biomedical Engineering.

[36]  R. J. Vogelstein,et al.  Restoring the sense of touch with a prosthetic hand through a brain interface , 2013, Proceedings of the National Academy of Sciences.

[37]  Christian Antfolk,et al.  Sensory feedback in upper limb prosthetics , 2013, Expert review of medical devices.

[38]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[39]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[40]  Dario Farina,et al.  Electrotactile EMG feedback improves the control of prosthesis grasping force , 2016, Journal of neural engineering.

[41]  Andrew Y. Paek,et al.  An exploration of grip force regulation with a low-impedance myoelectric prosthesis featuring referred haptic feedback , 2015, Journal of NeuroEngineering and Rehabilitation.

[42]  Christian Cipriani,et al.  Non-Invasive, Temporally Discrete Feedback of Object Contact and Release Improves Grasp Control of Closed-Loop Myoelectric Transradial Prostheses , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Dustin J Tyler,et al.  Artificial tactile and proprioceptive feedback improves performance and confidence on object identification tasks , 2018, PloS one.

[44]  Gursel Alici,et al.  A Review of Non-Invasive Sensory Feedback Methods for Transradial Prosthetic Hands , 2018, IEEE Access.

[45]  Peter H Veltink,et al.  Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users , 2015, Prosthetics and orthotics international.

[46]  Dudley S. Childress,et al.  Closed-loop control in prosthetic systems: Historical perspective , 2006, Annals of Biomedical Engineering.

[47]  A. Kargov,et al.  Design and Evaluation of a Low-Cost Force Feedback System for Myoelectric Prosthetic Hands , 2006 .

[48]  Christian Balkenius,et al.  A Tactile Display System for Hand Prostheses to Discriminate Pressure and Individual Finger Localization , 2010 .

[49]  Christian Cipriani,et al.  Discrete Vibro-Tactile Feedback Prevents Object Slippage in Hand Prostheses More Intuitively Than Other Modalities , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  S. Vijayakumar,et al.  The role of feed-forward and feedback processes for closed-loop prosthesis control , 2011, Journal of NeuroEngineering and Rehabilitation.

[51]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[52]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[53]  Gregory A. Clark,et al.  Motor Control and Sensory Feedback Enhance Prosthesis Embodiment and Reduce Phantom Pain After Long-Term Hand Amputation , 2018, Front. Hum. Neurosci..

[54]  Dario Farina,et al.  Closed-Loop Control of Grasping With a Myoelectric Hand Prosthesis: Which Are the Relevant Feedback Variables for Force Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  P E Patterson,et al.  Design and evaluation of a sensory feedback system that provides grasping pressure in a myoelectric hand. , 1992, Journal of rehabilitation research and development.

[56]  Jason P. Carey,et al.  Design and Integration of an Inexpensive Wearable Mechanotactile Feedback System for Myoelectric Prostheses , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[57]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.