On design and implementation of an embedded sysem for neural-machine interface for artificial legs

According to limb loss statistics, there are over one million leg amputees in the US whose lives are severely impacted by their conditions. In order to improve the quality of life of patients with leg amputations, neural activities have been studied by many researchers for intuitive prosthesis control. The neural signals collected from muscles are electromyographic (EMG) signals, which represent neuromuscular activities and are effective bioelectrical signals for expressing movement intent. EMG pattern recognition (PR) is a widely used method for characterizing EMG signals and classifying movement intent. The key to the success of neural-controlled artificial limbs is the neural-machine interface (NMI) that collects neural signals, interprets the signals, and makes accurate decisions for prosthesis control. This dissertation presents the design and implementation of a real-time NMI that recognizes user intent for control of artificial legs. To realize the NMI that can be carried by leg amputees in daily lives, a unique integration of the hardware and software of the NMI on an embedded system has been proposed, which is real-time, accurate, memory efficient, and reliable. The embedded NMI contains two major parts: a data collection module for sensing and buffering input signals and a computing engine for fast processing the user intent recognition (UIR) algorithm. The designed NMI has been completely built and tested as a working prototype. The system performance of the real-time experiments on both able-bodied and amputee subjects for recognizing multiple locomotion tasks has demonstrated the feasibility of a self-contained real-time NMI for artificial legs. One of the challenges for applying the designed PR-based NMI to clinical practice is the lack of practical system training methods. The traditional training procedure for the locomotion mode recognition (LMR) system is time consuming and manually conducted by experts. To address this challenge, an automatic and userdriven training method for the LMR system has been presented in this dissertation. In this method, a wearable terrain detection interface based on a portable laser distance sensor and an inertial measurement unit is applied to detect the terrain change in front of the prosthesis user. The identification of terrain alterations together with the information of current gait phase can be used to automatically identify the transitions among various locomotion modes, and labels the training data with movement class in real-time. The pilot experimental results on an able-bodied subject have demonstrated that this new method can significantly simplify the LMR training system and the training procedure without sacrificing the system performance. Environmental uncertainty is another challenge to the design of NMI for artificial limbs. EMG signals can be easily contaminated by noise and disturbances, which may degrade the classification performance. The last part of the dissertation presents a realtime implementation of a self-recovery EMG PR interface. A novel self-recovery module consisting of multiple sensor fault detectors and a fast linear discriminant analysis (LDA) based classifier retraining strategy has been developed to immediately recover the classification performance from signal disturbances. The self-recovery EMG PR system has been implemented on a real-time embedded system. The preliminary experimental evaluation on an able-bodied subject has shown that the system can maintain high accuracy in classifying multiple movement tasks while motion artifacts have been manually introduced. The results may propel the clinical use of EMG PR for multifunctional prosthesis control.

[1]  E. Kaplan Muscles Alive. Their Functions Revealed by Electromyography. J. V. Basmajian. Baltimore, The Williams and Wilkins Co., 1962. $8.50 , 1962 .

[2]  R. Scott,et al.  Myoelectric control of prostheses. , 1986, Critical reviews in biomedical engineering.

[3]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[4]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Tzyy-Ping Jung,et al.  Noninvasive Neural Prostheses Using Mobile and Wireless EEG , 2008, Proceedings of the IEEE.

[6]  Jens H. Krüger,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007, Eurographics.

[7]  He Huang,et al.  An Analysis of EMG Electrode Configuration for Targeted Muscle Reinnervation Based Neural Machine Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Yao Zhang,et al.  Parallel Computing Experiences with CUDA , 2008, IEEE Micro.

[9]  Fan Zhang,et al.  Trust sensor interface for improving reliability of EMG-based user intent recognition , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Gregory D. Peterson,et al.  High-Performance Mixed-Precision Linear Solver for FPGAs , 2008, IEEE Transactions on Computers.

[11]  Emmanuel Yashchin,et al.  Using Statistical Process Control to Monitor Active Managers , 2003 .

[12]  Ann M. Simon,et al.  Prosthesis-Guided Training For Practical Use Of Pattern Recognition Control Of Prostheses , 2011 .

[13]  Fan Zhang,et al.  Preliminary design of a terrain recognition system , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[15]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[16]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[17]  Zhu Han,et al.  Information theoretic framework of trust modeling and evaluation for ad hoc networks , 2006, IEEE Journal on Selected Areas in Communications.

[18]  R. Buschbacher Anatomical Guide for the Electromyographer: The Limbs and Trunk , 2007 .

[19]  F. E. Delagi Anatomical guide for the electromyographer , 2014 .

[20]  B.M. Wilamowski,et al.  Neural network architectures and learning algorithms , 2009, IEEE Industrial Electronics Magazine.

[21]  T. Kuiken Targeted reinnervation for improved prosthetic function. , 2006, Physical Medicine and Rehabilitation Clinics of North America.

[22]  Fan Zhang,et al.  Continuous Locomotion-Mode Identification for Prosthetic Legs Based on Neuromuscular–Mechanical Fusion , 2011, IEEE Transactions on Biomedical Engineering.

[23]  He Huang,et al.  A Strategy for Identifying Locomotion Modes Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[24]  Michael Chu,et al.  Scientific and Engineering Computing Using ATI Stream Technology , 2009, Computing in Science & Engineering.

[25]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[26]  C. Scoville,et al.  Amputation Is Not Isolated: An Overview of the US Army Amputee Patient Care Program and Associated Amputee Injuries , 2006, The Journal of the American Academy of Orthopaedic Surgeons.

[27]  Yoichi Hori,et al.  A New Control Method for Power-Assisted Wheelchair Based on the Surface Myoelectric Signal , 2010, IEEE Transactions on Industrial Electronics.

[28]  Sabri Koçer,et al.  Classification of EMG Signals Using PCA and FFT , 2005, Journal of Medical Systems.

[29]  Qing Yang,et al.  Design and implementation of a special purpose embedded system for neural machine interface , 2010, 2010 IEEE International Conference on Computer Design.

[30]  José del R. Millán,et al.  Brain-controlled telepresence robot by motor-disabled people , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Hugh Herr,et al.  User-adaptive control of a magnetorheological prosthetic knee , 2003, Ind. Robot.

[32]  Levi J. Hargrove,et al.  A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control , 2008, Biomed. Signal Process. Control..

[33]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[34]  Fan Zhang,et al.  Design of a robust EMG sensing interface for pattern classification , 2010, Journal of neural engineering.

[35]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[36]  Mehran Jahed,et al.  A Neuro–Fuzzy Inference System for sEMG-Based Identification of Hand Motion Commands , 2011, IEEE Transactions on Industrial Electronics.

[37]  王人成,et al.  Terrain Identification for Prosthetic Knees Based on Electromyographic Signal Features , 2006 .

[38]  John D. Owens,et al.  GPU Computing , 2008, Proceedings of the IEEE.

[39]  Erik Scheme,et al.  A FLEXIBLE USER INTERFACE FOR RAPID PROTOTYPING OF ADVANCED REAL-TIME MYOELECTRIC CONTROL SCHEMES , 2008 .

[40]  Qing Yang,et al.  Real-time implementation of a self-recovery EMG pattern recognition interface for artificial arms , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[41]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[42]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[43]  Junji Hirai,et al.  Development of a Biofeedback Therapeutic-Exercise-Supporting Manipulator , 2009, IEEE Transactions on Industrial Electronics.

[44]  Fan Zhang,et al.  Real-time implementation of an intent recognition system for artificial legs , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Fan Zhang,et al.  A Novel CPS System for Evaluating a Neural-Machine Interface for Artificial Legs , 2011, 2011 IEEE/ACM Second International Conference on Cyber-Physical Systems.

[46]  Weijun Xiao,et al.  Promise of embedded system with GPU in artificial leg control: Enabling time-frequency feature extraction from electromyography , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[47]  Fan Zhang,et al.  Integrating neuromuscular and cyber systems for neural control of artificial legs , 2010, ICCPS '10.

[48]  Fan Zhang,et al.  On Design and Implementation of Neural-Machine Interface for Artificial Legs , 2012, IEEE Transactions on Industrial Informatics.

[49]  Qing Yang,et al.  Implementing an FPGA system for real-time intent recognition for prosthetic legs , 2012, DAC Design Automation Conference 2012.

[50]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[51]  William J. Dally,et al.  The GPU Computing Era , 2010, IEEE Micro.

[52]  J.W. Sensinger,et al.  Adaptive Pattern Recognition of Myoelectric Signals: Exploration of Conceptual Framework and Practical Algorithms , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Henry P. Moreton,et al.  The GeForce 6800 , 2005, IEEE Micro.