Virtual Integration Environment as an Advanced Prosthetic Limb Training Platform

Background: Despite advances in prosthetic development and neurorehabilitation, individuals with upper extremity (UE) loss continue to face functional and psychosocial challenges following amputation. Recent advanced myoelectric prostheses offer intuitive control over multiple, simultaneous degrees of motion and promise sensory feedback integration, but require complex training to effectively manipulate. We explored whether a virtual reality simulator could be used to teach dexterous prosthetic control paradigms to individuals with UE loss. Methods: Thirteen active-duty military personnel with UE loss (14 limbs) completed twenty, 30-min passive motor training sessions over 1–2 months. Participants were asked to follow the motions of a virtual avatar using residual and phantom limbs, and electrical activity from the residual limb was recorded using surface electromyography. Eight participants (nine limbs), also completed twenty, 30-min active motor training sessions. Participants controlled a virtual avatar through three motion sets of increasing complexity (Basic, Advanced, and Digit) and were scored on how accurately they performed requested motions. Score trajectory was assessed as a function of time using longitudinal mixed effects linear regression. Results: Mean classification accuracy for passive motor training was 43.8 ± 10.7% (14 limbs, 277 passive sessions). In active motor sessions, >95% classification accuracy (which we used as the threshold for prosthetic acceptance) was achieved by all participants for Basic sets and by 50% of participants in Advanced and Digit sets. Significant improvement in active motor scores over time was observed in Basic and Advanced sets (per additional session: β-coefficient 0.125, p = 0.022; β-coefficient 0.45, p = 0.001, respectively), and trended toward significance for Digit sets (β-coefficient 0.594, p = 0.077). Conclusions: These results offer robust evidence that a virtual reality training platform can be used to quickly and efficiently train individuals with UE loss to operate advanced prosthetic control paradigms. Participants can be trained to generate muscle contraction patterns in residual limbs that are interpreted with high accuracy by computer software as distinct active motion commands. These results support the potential viability of advanced myoelectric prostheses relying on pattern recognition feedback or similar controls systems.

[1]  Jonathan Cole,et al.  Virtual reality therapies for phantom limb pain , 2014, European journal of pain.

[2]  J. Edward Colgate,et al.  Enabling closed-loop control of the Modular Prosthetic Limb through haptic feedback , 2013 .

[3]  Raoul M. Bongers,et al.  Task-Oriented Gaming for Transfer to Prosthesis Use , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  R.J. Vogelstein,et al.  Air-Guitar Hero: A real-time video game interface for training and evaluation of dexterous upper-extremity neuroprosthetic control algorithms , 2008, 2008 IEEE Biomedical Circuits and Systems Conference.

[5]  R. Jacob Vogelstein,et al.  A Real-Time Virtual Integration Environment for Neuroprosthetics and Rehabilitation , 2011 .

[6]  Kevin Englehart,et al.  High density electromyography data of normally limbed and transradial amputee subjects for multifunction prosthetic control. , 2012, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[7]  Kapil D. Katyal,et al.  Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject , 2016, Journal of neural engineering.

[8]  Ana Ivelisse Avilés,et al.  Linear Mixed Models for Longitudinal Data , 2001, Technometrics.

[9]  Courtney W. Moran,et al.  Revolutionizing Prosthetics 2009 Modular Prosthetic Limb – Body Interface : Overview of the Prosthetic Socket Development , 2011 .

[10]  Geert Molenberghs,et al.  Linear Mixed Models in Practice , 1997 .

[11]  Rahman Davoodi,et al.  A Software Tool for Faster Development of Complex Models of Musculoskeletal Systems and Sensorimotor Controllers in Simulink TM , 2002 .

[12]  G A Hunter,et al.  A review of employment patterns of industrial amputees—factors influencing rehabilitation , 1985, Prosthetics and orthotics international.

[13]  T. Wright,et al.  Prosthetic usage in major upper extremity amputations. , 1995, The Journal of hand surgery.

[14]  José Luis Pons Rovira,et al.  Virtual reality training and EMG control of the MANUS hand prosthesis , 2005, Robotica.

[15]  Nitish V. Thakor,et al.  User Training for Pattern Recognition-Based Myoelectric Prostheses: Improving Phantom Limb Movement Consistency and Distinguishability , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[17]  G. Lundborg,et al.  Refined myoelectric control in below-elbow amputees using artificial neural networks and a data glove. , 2005, The Journal of hand surgery.

[18]  Robert S. Armiger,et al.  Initial Clinical Evaluation of the Modular Prosthetic Limb , 2018, Front. Neurol..

[19]  S. Krishnan,et al.  Real-Time Classification of Forearm Electromyographic Signals Corresponding to User-Selected Intentional Movements for Multifunction Prosthesis Control , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  N. Thakor,et al.  A Training Strategy for Learning Pattern Recognition Control for Myoelectric Prostheses , 2013, Journal of prosthetics and orthotics : JPO.

[21]  Peter S. Lum,et al.  Trans-radial upper extremity amputees are capable of adapting to a novel dynamic environment , 2008, Experimental Brain Research.

[22]  B. Hudgins,et al.  A Real-Time Pattern Recognition Based Myoelectric Control Usability Study Implemented in a Virtual Environment , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Stuart D. Harshbarger,et al.  An Overview of the Developmental Process for the Modular Prosthetic Limb , 2011 .

[24]  Todd A Kuiken,et al.  Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. , 2011, Journal of rehabilitation research and development.

[25]  M. Hauschild,et al.  A Virtual Reality Environment for Designing and Fitting Neural Prosthetic Limbs , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Courtney Moran,et al.  Use of a Virtual Integrated Environment in Prosthetic Limb Development and Phantom Limb Pain , 2012, Annual Review of Cybertherapy and Telemedicine.

[27]  Christian Cipriani,et al.  Principal components analysis based control of a multi-dof underactuated prosthetic hand , 2010, Journal of NeuroEngineering and Rehabilitation.

[28]  K. Sheikh,et al.  Return to work following limb injuries. , 1985, The Journal of the Society of Occupational Medicine.