Amplitude versus spatially modulated electrotactile feedback for myoelectric control of two degrees of freedom

OBJECTIVE Artificial proprioceptive feedback from a myoelectric prosthesis is an important aspect in enhancing embodiment and user satisfaction, possibly lowering the demand for visual attention while controlling a prosthesis in everyday tasks. Contemporary myoelectric prostheses are advanced mechatronic systems with multiple degrees of freedom, and therefore, to communicate the prosthesis state, the feedback interface needs to transmit several variables simultaneously. In the present study, two different configurations for conveying proprioceptive information of wrist rotation and hand aperture through multichannel electrotactile stimulation were developed and evaluated during online myoelectric control. APPROACH Myoelectric recordings were acquired from the dominant forearm and electrotactile stimulation was delivered on the non-dominant forearm using a compact interface. The first feedback configuration, which was based on spatial coding, transmitted the information using a moving tactile stimulus, whereas the second, amplitude-based configuration conveyed the position via sensation intensity. Thirteen able-bodied subjects used pattern classification-based myoelectric control with both feedback configurations to accomplish a target-reaching task. MAIN RESULTS High task performance (completion rate > 90%) was observed for both configurations, with no significant difference in completion rate, time to reach the target and path efficiency, respectively. SIGNIFICANCE Overall, the results demonstrated that both feedback configurations allowed subjects to perceive and interpret two feedback variables delivered simultaneously, despite using a compact stimulation interface. This is an encouraging result for the prospect of communicating the full state of a multifunctional hand prosthesis.

[1]  Christian Cipriani,et al.  Humans can integrate feedback of discrete events in their sensorimotor control of a robotic hand , 2014, Experimental Brain Research.

[2]  Dario Farina,et al.  Virtual Grasping: Closed-Loop Force Control Using Electrotactile Feedback , 2014, Comput. Math. Methods Medicine.

[3]  Loredana Zollo,et al.  Literature Review on Needs of Upper Limb Prosthesis Users , 2016, Front. Neurosci..

[4]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[5]  S. Vijayakumar,et al.  The role of feed-forward and feedback processes for closed-loop prosthesis control , 2011, Journal of NeuroEngineering and Rehabilitation.

[6]  Xiaogang Hu,et al.  Object stiffness recognition using haptic feedback delivered through transcutaneous proximal nerve stimulation , 2019, Journal of neural engineering.

[7]  Dario Farina,et al.  User adaptation in Myoelectric Man-Machine Interfaces , 2017, Scientific Reports.

[8]  Per Magnus,et al.  Mental health and satisfaction with life among upper limb amputees: a Norwegian population-based survey comparing adult acquired major upper limb amputees with a control group , 2011, Disability and rehabilitation.

[9]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[10]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[11]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[12]  Peter H Veltink,et al.  Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users , 2015, Prosthetics and orthotics international.

[13]  Thierry Keller,et al.  Optimization of Semiautomated Calibration Algorithm of Multichannel Electrotactile Feedback for Myoelectric Hand Prosthesis , 2019, Applied bionics and biomechanics.

[14]  Christian Antfolk,et al.  A review of invasive and non-invasive sensory feedback in upper limb prostheses , 2017, Expert review of medical devices.

[15]  Silvestro Micera,et al.  A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback , 2018, Science Robotics.

[16]  Silvestro Micera,et al.  Intraneural sensory feedback restores grip force control and motor coordination while using a prosthetic hand , 2019, Journal of neural engineering.

[17]  F. Sup,et al.  A Haptic Feedback Scheme to Accurately Position a Virtual Wrist Prosthesis Using a Three-Node Tactor Array , 2015, PloS one.

[18]  Christian Cipriani,et al.  Non-Invasive, Temporally Discrete Feedback of Object Contact and Release Improves Grasp Control of Closed-Loop Myoelectric Transradial Prostheses , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Dustin J Tyler,et al.  Artificial tactile and proprioceptive feedback improves performance and confidence on object identification tasks , 2018, PloS one.

[20]  Thierry Keller,et al.  Multichannel Electrotactile Feedback With Spatial and Mixed Coding for Closed-Loop Control of Grasping Force in Hand Prostheses , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Strahinja Dosen,et al.  Psychometric characterization of incidental feedback sources during grasping with a hand prosthesis , 2019, Journal of NeuroEngineering and Rehabilitation.

[22]  Levi J Hargrove,et al.  A real-time comparison between direct control, sequential pattern recognition control and simultaneous pattern recognition control using a Fitts’ law style assessment procedure , 2014, Journal of NeuroEngineering and Rehabilitation.

[23]  Purushothaman Geethanjali,et al.  Myoelectric control of prosthetic hands: state-of-the-art review , 2016, Medical devices.

[24]  Silvestro Micera,et al.  A somatotopic bidirectional hand prosthesis with transcutaneous electrical nerve stimulation based sensory feedback , 2017, Scientific Reports.

[25]  Silvestro Micera,et al.  Six‐Month Assessment of a Hand Prosthesis with Intraneural Tactile Feedback , 2018, Annals of neurology.

[26]  R. Miall,et al.  The role of proprioception and attention in a visuomotor adaptation task , 2000, Experimental Brain Research.

[27]  Andrew J Fuglevand,et al.  Object discrimination using electrotactile feedback , 2018, Journal of neural engineering.

[28]  Nitish V. Thakor,et al.  User Training for Pattern Recognition-Based Myoelectric Prostheses: Improving Phantom Limb Movement Consistency and Distinguishability , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Guohong Chai,et al.  Characterization of evoked tactile sensation in forearm amputees with transcutaneous electrical nerve stimulation , 2015, Journal of neural engineering.

[30]  Erik J Scheme,et al.  On the usability of intramuscular EMG for prosthetic control: a Fitts' Law approach. , 2014, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[31]  Kazunori Okada,et al.  Simple space-domain features for low-resolution sEMG pattern recognition , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[33]  K. Horch,et al.  Object Discrimination With an Artificial Hand Using Electrical Stimulation of Peripheral Tactile and Proprioceptive Pathways With Intrafascicular Electrodes , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Nitish V. Thakor,et al.  Improving the functionality, robustness, and adaptability of myoelectric control for dexterous motion restoration , 2018, Experimental Brain Research.

[35]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[37]  R. J. Vogelstein,et al.  Restoring the sense of touch with a prosthetic hand through a brain interface , 2013, Proceedings of the National Academy of Sciences.

[38]  Matteo Bianchi,et al.  Skin Stretch Haptic Feedback to Convey Closure Information in Anthropomorphic, Under-Actuated Upper Limb Soft Prostheses , 2019, IEEE Transactions on Haptics.

[39]  Winnie Jensen,et al.  Evaluation of sensation evoked by electrocutaneous stimulation on forearm in nondisabled subjects. , 2012, Journal of rehabilitation research and development.

[40]  Jacqueline S. Hebert,et al.  Applications of sensory feedback in motorized upper extremity prosthesis: a review , 2014, Expert review of medical devices.

[41]  Thierry Keller,et al.  Electrotactile Feedback Improves Performance and Facilitates Learning in the Routine Grasping Task , 2016, European journal of translational myology.

[42]  Erik J. Scheme,et al.  Validation of a Selective Ensemble-Based Classification Scheme for Myoelectric Control Using a Three-Dimensional Fitts' Law Test , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Winnie Jensen,et al.  Impacts of selected stimulation patterns on the perception threshold in electrocutaneous stimulation , 2011, Journal of NeuroEngineering and Rehabilitation.

[44]  Winnie Jensen,et al.  The Short-Term Repeatability of Subdermal Electrical Stimulation for Sensory Feedback , 2020, IEEE Access.

[45]  Todd A Kuiken,et al.  Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. , 2011, Journal of rehabilitation research and development.

[46]  Peter H. Veltink,et al.  Stiffness Feedback for Myoelectric Forearm Prostheses Using Vibrotactile Stimulation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[48]  Dario Farina,et al.  Proportional estimation of finger movements from high-density surface electromyography , 2016, Journal of NeuroEngineering and Rehabilitation.

[49]  M. Solomonow,et al.  Electrotactile two-point discrimination as a function of frequency, body site, laterality, and stimulation codes , 1977, Annals of Biomedical Engineering.

[50]  Winnie Jensen,et al.  On the robustness of real-time myoelectric control investigations: a multiday Fitts' law approach. , 2019, Journal of neural engineering.

[51]  Dario Farina,et al.  Closed-Loop Control of Myoelectric Prostheses With Electrotactile Feedback: Influence of Stimulation Artifact and Blanking , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  Jacob L. Segil,et al.  Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. , 2013, Journal of rehabilitation research and development.

[53]  Dario Farina,et al.  Myocontrol is closed-loop control: incidental feedback is sufficient for scaling the prosthesis force in routine grasping , 2018, Journal of NeuroEngineering and Rehabilitation.

[54]  K. Ikeda,et al.  Human ability to discriminate various parameters in afferent electrical nerve stimulation with particular reference to prostheses sensory feedback , 1977, Medical and Biological Engineering and Computing.

[55]  Dario Farina,et al.  Time-division multiplexing for myoelectric closed-loop control using electrotactile feedback , 2014, Journal of NeuroEngineering and Rehabilitation.

[56]  Thierry Keller,et al.  Short- and Long-Term Learning of Feedforward Control of a Myoelectric Prosthesis with Sensory Feedback by Amputees , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  Dario Farina,et al.  Electrotactile EMG feedback improves the control of prosthesis grasping force , 2016, Journal of neural engineering.

[58]  Thierry Keller,et al.  Sensor fusion and computer vision for context-aware control of a multi degree-of-freedom prosthesis , 2016 .

[59]  Frank A. Saunders,et al.  Electrocutaneous Stimulation for Sensory Communication in Rehabilitation Engineering , 1982, IEEE Transactions on Biomedical Engineering.

[60]  Maurizio Valle,et al.  A System for Electrotactile Feedback Using Electronic Skin and Flexible Matrix Electrodes: Experimental Evaluation , 2017, IEEE Transactions on Haptics.

[61]  John J. Soraghan,et al.  Study on Interaction Between Temporal and Spatial Information in Classification of EMG Signals for Myoelectric Prostheses , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[62]  Erik J. Scheme,et al.  Confidence-Based Rejection for Improved Pattern Recognition Myoelectric Control , 2013, IEEE Transactions on Biomedical Engineering.

[63]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[64]  Stephen T. Foldes,et al.  Intracortical microstimulation of human somatosensory cortex , 2016, Science Translational Medicine.