Teleoperation of an ankle-foot prosthesis with a wrist exoskeleton

Objective We aimed to develop a system for people with amputation that non-invasively restores missing control and sensory information for an ankle-foot prosthesis. Methods In our approach, a wrist exoskeleton allows people with amputation to control and receive feedback from their prosthetic ankle via teleoperation. We implemented two control schemes: position control with haptic feedback of ankle torque at the wrist; and torque control that allows the user to modify a baseline torque profile by moving their wrist against a virtual spring. We measured tracking error and frequency response for the ankle-foot prosthesis and the wrist exoskeleton. To demonstrate feasibility and evaluate system performance, we conducted an experiment in which one participant with a transtibial amputation tracked desired wrist trajectories during walking, while we measured wrist and ankle response. Results Benchtop testing demonstrated that for relevant walking frequencies, system error was below human perceptual error. During the walking experiment, the participant was able to voluntarily follow different wrist trajectories with an average RMS error of 1.55° after training. The ankle was also able to track desired trajectories below human perceptual error for both position control (RMSE = 0.8°) and torque control (RMSE = 8.4%). Conclusion We present a system that allows a user with amputation to control an ankle-foot prosthesis and receive feedback about its state using a wrist exoskeleton, with accuracy comparable to biological neuromotor control. Significance This bilateral teleoperation system enables novel prosthesis control and feedback strategies that could improve prosthesis control and aid motor learning.

[1]  D A Winter,et al.  Measurement and reduction of noise in kinematics of locomotion. , 1974, Journal of biomechanics.

[2]  S. Azen,et al.  Normal range of motion of joints in male subjects. , 1979, The Journal of bone and joint surgery. American volume.

[3]  C. T. Huang,et al.  Amputation: energy cost of ambulation. , 1979, Archives of physical medicine and rehabilitation.

[4]  Blake Hannaford,et al.  Stability and performance tradeoffs in bi-lateral telemanipulation , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[5]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[6]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[7]  K. Hagberg,et al.  Consequences of non-vascular trans-femoral amputation: A survey of quality of life, prosthetic use and problems , 2001, Prosthetics and orthotics international.

[8]  W. Miller,et al.  The prevalence and risk factors of falling and fear of falling among lower extremity amputees. , 2001, Archives of physical medicine and rehabilitation.

[9]  M. C. Cavusoglu Kinematics and Dynamics of Phantom(TM) model 1.5 Haptic Interface , 2001 .

[10]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[11]  D. Connelly,et al.  Reliability and validity of ankle proprioceptive measures. , 2003, Archives of physical medicine and rehabilitation.

[12]  J. Flanagan,et al.  Task-specific internal models for kinematic transformations. , 2003, Journal of neurophysiology.

[13]  J. McGavock,et al.  The Role of Exercise in the Treatment of Cardiovascular Disease Associated with Type 2 Diabetes Mellitus , 2004, Sports medicine.

[14]  N. H. Molen Energy/speed relation of below-knee amputees walking on a motor-driven treadmill , 1973, Internationale Zeitschrift für angewandte Physiologie einschließlich Arbeitsphysiologie.

[15]  P. Bonato,et al.  An EMG-position controlled system for an active ankle-foot prosthesis: an initial experimental study , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[16]  J. Czerniecki,et al.  The prevalence of knee pain and symptomatic knee osteoarthritis among veteran traumatic amputees and nonamputees. , 2005, Archives of physical medicine and rehabilitation.

[17]  C. Burgar,et al.  MIME robotic device for upper-limb neurorehabilitation in subacute stroke subjects: A follow-up study. , 2006, Journal of rehabilitation research and development.

[18]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[19]  R. Gailey,et al.  Review of secondary physical conditions associated with lower-limb amputation and long-term prosthesis use. , 2008, Journal of rehabilitation research and development.

[20]  A. Okamura Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[21]  Hugh M. Herr,et al.  Powered Ankle--Foot Prosthesis Improves Walking Metabolic Economy , 2009, IEEE Transactions on Robotics.

[22]  A. Panarese,et al.  Humans Can Integrate Force Feedback to Toes in Their Sensorimotor Control of a Robotic Hand , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  C. V. van Heugten,et al.  The prevalence of osteoarthritis of the intact hip and knee among traumatic leg amputees. , 2009, Archives of physical medicine and rehabilitation.

[24]  Marcia Kilchenman O'Malley,et al.  Functionally biarticular control for smart prosthetics , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[25]  Paolo Fiorini,et al.  Evaluation of force and torque magnitude discrimination thresholds on the human hand-arm system , 2010, TAP.

[26]  Cara E. Stepp,et al.  Relative to direct haptic feedback, remote vibrotactile feedback improves but slows object manipulation , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[27]  Christina T Fuentes,et al.  Where is your arm? Variations in proprioception across space and tasks. , 2010, Journal of neurophysiology.

[28]  Alena M. Grabowski,et al.  Bionic ankle–foot prosthesis normalizes walking gait for persons with leg amputation , 2012, Proceedings of the Royal Society B: Biological Sciences.

[29]  H. P. Crowell,et al.  Gait retraining to reduce lower extremity loading in runners. , 2011, Clinical biomechanics.

[30]  Christian Cipriani,et al.  Vibrotactile Sensory Substitution Elicits Feeling of Ownership of an Alien Hand , 2012, PloS one.

[31]  Samuel R. Hamner,et al.  How muscle fiber lengths and velocities affect muscle force generation as humans walk and run at different speeds , 2013, Journal of Experimental Biology.

[32]  Robert D. Lipschutz,et al.  Robotic leg control with EMG decoding in an amputee with nerve transfers. , 2013, The New England journal of medicine.

[33]  Septimiu E. Salcudean,et al.  Asymmetric force feedback control framework for teleoperated robot-assisted surgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[34]  Jing Wang,et al.  Proportional EMG control of ankle plantar flexion in a powered transtibial prosthesis , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[35]  Josien C. van den Noort,et al.  Real-time visual feedback for gait retraining: toward application in knee osteoarthritis , 2014, Medical & Biological Engineering & Computing.

[36]  Hugh M. Herr,et al.  Volitional control of ankle plantar flexion in a powered transtibial prosthesis during stair-ambulation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  J. Stevens,et al.  Falls and Fall Injuries Among Adults with Arthritis — United States, 2012 , 2014, MMWR. Morbidity and mortality weekly report.

[38]  Barbara Caputo,et al.  Stable myoelectric control of a hand prosthesis using non-linear incremental learning , 2014, Front. Neurorobot..

[39]  Hao Xu,et al.  Haptic proprioception in a virtual locomotor task , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Y. Yoshii,et al.  Measurement of wrist flexion and extension torques in different forearm positions , 2015, Biomedical engineering online.

[41]  Chien Chern Cheah,et al.  Experimental comparison of torque control methods on an ankle exoskeleton during human walking , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Jessica C. Selinger,et al.  Humans Can Continuously Optimize Energetic Cost during Walking , 2015, Current Biology.

[43]  J. Konczak,et al.  Robot-Aided Assessment of Wrist Proprioception , 2015, Front. Hum. Neurosci..

[44]  Leonardo Cappello,et al.  Preliminary analysis of non-dominant proprioceptive acuity and interlimb asymmetry in the human wrist , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[45]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[46]  G. Bergen,et al.  Falls and Fall Injuries Among Adults Aged ≥65 Years - United States, 2014. , 2016, MMWR. Morbidity and mortality weekly report.

[47]  P. Morasso,et al.  Robot-Aided Mapping of Wrist Proprioceptive Acuity across a 3D Workspace , 2016, PloS one.

[48]  Daniel P. Ferris,et al.  Locomotor Adaptation by Transtibial Amputees Walking With an Experimental Powered Prosthesis Under Continuous Myoelectric Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  Levi J. Hargrove,et al.  Detection of and Compensation for EMG Disturbances for Powered Lower Limb Prosthesis Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  Elliott J. Rouse,et al.  Stiffness Perception During Active Ankle and Knee Movement , 2017, IEEE Transactions on Biomedical Engineering.

[51]  Suzanne B. Finucane,et al.  Online adaptive neural control of a robotic lower limb prosthesis , 2018, Journal of neural engineering.

[52]  W. Miltner,et al.  Leg Prosthesis With Somatosensory Feedback Reduces Phantom Limb Pain and Increases Functionality , 2018, Front. Neurol..

[53]  Shriya S Srinivasan,et al.  Proprioception from a neurally controlled lower-extremity prosthesis , 2018, Science Translational Medicine.

[54]  Shriya S. Srinivasan,et al.  The Ewing Amputation: The First Human Implementation of the Agonist-Antagonist Myoneural Interface , 2018, Plastic and reconstructive surgery. Global open.

[55]  Francis R. Willett,et al.  Hand Knob Area of Motor Cortex in People with Tetraplegia Represents the Whole Body in a Modular Way , 2019, bioRxiv.

[56]  S. Micera,et al.  Sensory feedback restoration in leg amputees improves walking speed, metabolic cost and phantom pain , 2019, Nature Medicine.

[57]  Steven H. Collins,et al.  Shortcomings of human-in-the-loop optimization for an ankle-foot prosthesis: a case series , 2020, bioRxiv.

[58]  Steve Collins,et al.  An Ankle-Foot Prosthesis Emulator Capable of Modulating Center of Pressure , 2020, IEEE Transactions on Biomedical Engineering.