Joint Speed Discrimination and Augmentation For Prosthesis Feedback

Sensory feedback is critical in fine motor control, learning, and adaptation. However, robotic prosthetic limbs currently lack the feedback segment of the communication loop between user and device. Sensory substitution feedback can close this gap, but sometimes this improvement only persists when users cannot see their prosthesis, suggesting the provided feedback is redundant with vision. Thus, given the choice, users rely on vision over artificial feedback. To effectively augment vision, sensory feedback must provide information that vision cannot provide or provides poorly. Although vision is known to be less precise at estimating speed than position, no work has compared speed precision of biomimetic arm movements. In this study, we investigated the uncertainty of visual speed estimates as defined by different virtual arm movements. We found that uncertainty was greatest for visual estimates of joint speeds, compared to absolute rotational or linear endpoint speeds. Furthermore, this uncertainty increased when the joint reference frame speed varied over time, potentially caused by an overestimation of joint speed. Finally, we demonstrate a joint-based sensory substitution feedback paradigm capable of significantly reducing joint speed uncertainty when paired with vision. Ultimately, this work may lead to improved prosthesis control and capacity for motor learning.

[1]  T. Matsushima,et al.  Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks , 2016, Front. Neurosci..

[2]  C Ghez,et al.  Proprioceptive control of interjoint coordination. , 1995, Canadian journal of physiology and pharmacology.

[3]  Christian Cipriani,et al.  Humans can integrate feedback of discrete events in their sensorimotor control of a robotic hand , 2014, Experimental Brain Research.

[4]  Maria C. Bengtson,et al.  The Arm Movement Detection (AMD) test: a fast robotic test of proprioceptive acuity in the arm , 2017, Journal of NeuroEngineering and Rehabilitation.

[5]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[6]  Ahmed W Shehata,et al.  Audible Feedback Improves Internal Model Strength and Performance of Myoelectric Prosthesis Control , 2018, Scientific Reports.

[7]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[8]  A. Geurts,et al.  Definition dependent properties of the cortical silent period in upper-extremity muscles, a methodological study , 2014, Journal of NeuroEngineering and Rehabilitation.

[9]  Dudley S. Childress,et al.  Closed-loop control in prosthetic systems: Historical perspective , 2006, Annals of Biomedical Engineering.

[10]  Valay A. Shah,et al.  Erratum to: Supplemental vibrotactile feedback control of stabilization and reaching actions of the arm using limb state and position error encodings , 2017, Journal of NeuroEngineering and Rehabilitation.

[11]  Dario Farina,et al.  Tactile feedback is an effective instrument for the training of grasping with a prosthesis at low- and medium-force levels , 2017, Experimental Brain Research.

[12]  Dario Farina,et al.  Closed-Loop Control of Grasping With a Myoelectric Hand Prosthesis: Which Are the Relevant Feedback Variables for Force Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Jonathon W. Sensinger,et al.  EMG Versus Torque Control of Human–Machine Systems: Equalizing Control Signal Variability Does not Equalize Error or Uncertainty , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[15]  S. D. Reimers,et al.  Kinesthetic Sensing for the EMG Controlled "Boston Arm" , 1970 .

[16]  A. Bilodeau,et al.  Motor-Skills Learning , 1961 .

[17]  Konrad P. Körding,et al.  Estimating the Relevance of World Disturbances to Explain Savings, Interference and Long-Term Motor Adaptation Effects , 2011, PLoS Comput. Biol..

[18]  D. M. Green,et al.  Frequency discrimination as a function of frequency and sensation level. , 1977, The Journal of the Acoustical Society of America.

[19]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[20]  Martin Buss,et al.  Combination and Integration in the Perception of Visual-Haptic Compliance Information , 2010, IEEE Transactions on Haptics.

[21]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[22]  Susan Hillier,et al.  The effectiveness of robotic-assisted gait training for paediatric gait disorders: systematic review , 2017, Journal of NeuroEngineering and Rehabilitation.

[23]  Wiebren Zijlstra,et al.  Audio-Biofeedback training for posture and balance in Patients with Parkinson's disease , 2011, Journal of NeuroEngineering and Rehabilitation.

[24]  D. Levi,et al.  Stimulus uncertainty affects velocity discrimination , 1998, Vision Research.

[25]  Daniel Tan,et al.  Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis , 2016, Journal of neural engineering.

[26]  Reva E. Johnson,et al.  Joint-based velocity feedback to virtual limb dynamic perturbations , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[27]  Katherine J. Kuchenbecker,et al.  Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance , 2012, IEEE Transactions on Haptics.

[28]  R L Sainburg,et al.  Control of limb dynamics in normal subjects and patients without proprioception. , 1995, Journal of neurophysiology.

[29]  Rafael Granja-Vazquez,et al.  Illusory movement perception improves motor control for prosthetic hands , 2018, Science Translational Medicine.

[30]  L. Jones Kinesthetic Sensing , 2000 .

[31]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[32]  Jacqueline S. Hebert,et al.  Applications of sensory feedback in motorized upper extremity prosthesis: a review , 2014, Expert review of medical devices.

[33]  Christian Antfolk,et al.  Sensory feedback in upper limb prosthetics , 2013, Expert review of medical devices.

[34]  Ahmed W. Shehata,et al.  Evaluating Internal Model Strength and Performance of Myoelectric Prosthesis Control Strategies , 2017, bioRxiv.

[35]  Valay A. Shah,et al.  Supplemental vibrotactile feedback control of stabilization and reaching actions of the arm using limb state and position error encodings , 2017, Journal of NeuroEngineering and Rehabilitation.

[36]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[37]  Reva E. Johnson,et al.  Joint Speed Discrimination and Augmentation For Prosthesis Feedback , 2018 .

[38]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[39]  Loredana Zollo,et al.  Literature Review on Needs of Upper Limb Prosthesis Users , 2016, Front. Neurosci..

[40]  Mohammad M D Sobuh,et al.  Visuomotor behaviours when using a myoelectric prosthesis , 2014, Journal of NeuroEngineering and Rehabilitation.

[41]  Jeremy Fairbank,et al.  Historical Perspective , 1987, Do We Really Understand Quantum Mechanics?.

[42]  M. Keith,et al.  A neural interface provides long-term stable natural touch perception , 2014, Science Translational Medicine.

[43]  D. Wolpert,et al.  When Feeling Is More Important Than Seeing in Sensorimotor Adaptation , 2002, Current Biology.