Combining Vibrotactile Feedback with Volitional Myoelectric Control for Robotic Transtibial Prostheses

In recent years, the development of myoelectric control for robotic lower-limb prostheses makes it possible for amputee users to volitionally control prosthetic joints. However, the human-centered control loop is not closed due to the lack of sufficient feedback of prosthetic joint movement, and it may result in poor control performance. In this research, we propose a vibrotactile stimulation system to provide the feedback of ankle joint position, and validate the necessity of combining it with volitional myoelectric control to achieve improved control performance. The stimulation system is wearable and consists of six vibrators. Three of the vibrators are placed on the anterior side of the thigh and the other three on the posterior side of the thigh. To explore the potential of applying the proposed vibrotactile feedback system for prosthetic ankle control, eight able-bodied subjects and two transtibial amputee subjects (TT1 and TT2) were recruited in this research, and several experiments were designed to investigate subjects’ sensitivities to discrete and continuous vibration stimulations applied on the thigh. Then, we proposed a stimulation controller to produce different stimulation patterns according to current ankle angle. Amputee subjects were asked to control a virtual ankle displayed on the computer screen to reach different target ankle angles with a myoelectric controller, and control performances under different feedback conditions were compared. Experimental results indicated that subjects were more sensitive to stimulation position changes (identification accuracies were 96.39 ± 0.86, 91.11, and 93.89% for able-bodied subjects, TT1, and TT2, respectively) than stimulation amplitude changes (identification accuracies were 89.89 ± 2.40, 87.04, and 85.19% for able-bodied subjects, TT1, and TT2, respectively). Response times of able-bodied subjects, TT1, and TT2 to stimulation pattern changes were 0.47 ± 0.02 s, 0.53 s, and 0.48 s, respectively. Furthermore, for both TT1 and TT2, the absolute error of virtual ankle control reduced by about 50% with the addition of vibrotactile feedback. These results suggest that it is promising to apply the vibrotactile feedback system for the control of robotic transtibial prostheses.

[1]  Peter H. Veltink,et al.  Vibrotactile stimulation of the upper leg: Effects of location, stimulation method and habituation , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Bram Vanderborght,et al.  Design and Validation of the Ankle Mimicking Prosthetic (AMP-) Foot 2.0 , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Wenwei Yu,et al.  Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study , 2012, Journal of NeuroEngineering and Rehabilitation.

[4]  Chih-Hung King,et al.  A Haptic Feedback System for Lower-Limb Prostheses , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  C. D. Hoover,et al.  Stair Ascent With a Powered Transfemoral Prosthesis Under Direct Myoelectric Control , 2013, IEEE/ASME Transactions on Mechatronics.

[6]  J. Wheeler,et al.  Investigation of Rotational Skin Stretch for Proprioceptive Feedback With Application to Myoelectric Systems , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  E Kentala,et al.  Control of sway using vibrotactile feedback of body tilt in patients with moderate and severe postural control deficits. , 2005, Journal of vestibular research : equilibrium & orientation.

[8]  P. Bonato,et al.  An EMG-position controlled system for an active ankle-foot prosthesis: an initial experimental study , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[9]  Mark R. Cutkosky,et al.  Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[10]  Michael Goldfarb,et al.  A Robotic Leg Prosthesis: Design, Control, and Implementation , 2014, IEEE Robotics & Automation Magazine.

[11]  S. Bamberg,et al.  The Lower Extremity Ambulation Feedback System for Analysis of Gait Asymmetries: Preliminary Design and Validation Results , 2010 .

[12]  D. G. Buma,et al.  Intermittent Stimulation Delays Adaptation to Electrocutaneous Sensory Feedback , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Long Wang,et al.  Walk the Walk: A Lightweight Active Transtibial Prosthesis , 2015, IEEE Robotics & Automation Magazine.

[14]  Ashley N. Johnson,et al.  Dual-task motor performance with a tongue-operated assistive technology compared with hand operations , 2012, Journal of NeuroEngineering and Rehabilitation.

[15]  Y. Matsuoka,et al.  Repeated Training with Augmentative Vibrotactile Feedback Increases Object Manipulation Performance , 2012, PloS one.

[16]  K. Hagberg,et al.  Can vibratory feedback be used to improve postural stability in persons with transtibial limb loss? , 2012, Journal of rehabilitation research and development.

[17]  Andrew Erwin,et al.  Design and perceptibility of a wearable haptic device using low-frequency stimulations on the forearm , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[18]  Simona Crea,et al.  Providing Time-Discrete Gait Information by Wearable Feedback Apparatus for Lower-Limb Amputees: Usability and Functional Validation , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  F. Sup,et al.  A Haptic Feedback Scheme to Accurately Position a Virtual Wrist Prosthesis Using a Three-Node Tactor Array , 2015, PloS one.

[20]  Jing Wang,et al.  Proportional EMG control of ankle plantar flexion in a powered transtibial prosthesis , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[21]  Daniel P. Ferris,et al.  An Experimental Powered Lower Limb Prosthesis Using Proportional Myoelectric Control , 2014 .

[22]  A. A. Gopalai,et al.  A Wearable Real-Time Intelligent Posture Corrective System Using Vibrotactile Feedback , 2011, IEEE/ASME Transactions on Mechatronics.

[23]  Christian Cipriani,et al.  A Miniature Vibrotactile Sensory Substitution Device for Multifingered Hand Prosthetics , 2012, IEEE Transactions on Biomedical Engineering.

[24]  John A. Sabolich,et al.  Sense of Feel for Lower-Limb Amputees , 1994 .

[25]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[26]  Michael Goldfarb,et al.  Design and Control of a Powered Transfemoral Prosthesis , 2008, Int. J. Robotics Res..

[27]  Thomas Sugar,et al.  Robotic transtibial prosthesis with biomechanical energy regeneration , 2009, Ind. Robot.

[28]  Long Wang,et al.  Adaptive Slope Walking With a Robotic Transtibial Prosthesis Based on Volitional EMG Control , 2015, IEEE/ASME Transactions on Mechatronics.

[29]  S.M.N.A. Senanayake,et al.  A Real-Time System With Assistive Feedback for Postural Control in Rehabilitation , 2010, IEEE/ASME Transactions on Mechatronics.

[30]  Philip A Voglewede,et al.  Concept Through Preliminary Bench Testing of a Powered Lower Limb Prosthetic Device. , 2010, Journal of mechanisms and robotics.

[31]  Christian Antfolk,et al.  Sensory feedback in upper limb prosthetics , 2013, Expert review of medical devices.

[32]  Andrea W. Chew A vibrotactile display design for the feedback of external prosthesis sensory information to the amputee wearer , 2006 .

[33]  Michael Goldfarb,et al.  Volitional Control of a Prosthetic Knee Using Surface Electromyography , 2011, IEEE Transactions on Biomedical Engineering.

[34]  Hugh M. Herr,et al.  Powered Ankle--Foot Prosthesis Improves Walking Metabolic Economy , 2009, IEEE Transactions on Robotics.

[35]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.

[36]  J. Sabolich,et al.  Sense of Feel for Lower‐Limb Amputees: A Phase‐One Study , 1994 .

[37]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[38]  Kevin B. Fite,et al.  EMG control of a bionic knee prosthesis: Exploiting muscle co-contractions for improved locomotor function , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[39]  S. Bamberg,et al.  Utilization of a lower extremity ambulatory feedback system to reduce gait asymmetry in transtibial amputation gait. , 2012, Gait & posture.

[40]  Long Wang,et al.  Promise of using surface EMG signals to volitionally control ankle joint position for powered transtibial prostheses , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.