Novel Method for Predicting Dexterous Individual Finger Movements by Imaging Muscle Activity Using a Wearable Ultrasonic System

Recently there have been major advances in the electro-mechanical design of upper extremity prosthetics. However, the development of control strategies for such prosthetics has lagged significantly behind. Conventional noninvasive myoelectric control strategies rely on the amplitude of electromyography (EMG) signals from flexor and extensor muscles in the forearm. Surface EMG has limited specificity for deep contiguous muscles because of cross talk and cannot reliably differentiate between individual digit and joint motions. We present a novel ultrasound imaging based control strategy for upper arm prosthetics that can overcome many of the limitations of myoelectric control. Real time ultrasound images of the forearm muscles were obtained using a wearable mechanically scanned single element ultrasound system, and analyzed to create maps of muscle activity based on changes in the ultrasound echogenicity of the muscle during contraction. Individual digit movements were associated with unique maps of activity. These maps were correlated with previously acquired training data to classify individual digit movements. Preliminary results using ten healthy volunteers demonstrated this approach could provide robust classification of individual finger movements with 98% accuracy (precision 96%-100% and recall 97%-100% for individual finger flexions). The change in ultrasound echogenicity was found to be proportional to the digit flexion speed (R2=0.9), and thus our proposed strategy provided a proportional signal that can be used for fine control. We anticipate that ultrasound imaging based control strategies could be a significant improvement over conventional myoelectric control of prosthetics.

[1]  Elias S. Manolakos,et al.  Flexible IP cores for the k-NN classification problem and their FPGA implementation , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[2]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[3]  Philip R. Troyk,et al.  Implantable Myoelectric Sensors (IMESs) for Intramuscular Electromyogram Recording , 2009, IEEE Transactions on Biomedical Engineering.

[4]  R.F. Weir,et al.  The Optimal Controller Delay for Myoelectric Prostheses , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Siddhartha Sikdar,et al.  Measurement of tendon velocities using vector Tissue Doppler Imaging: A feasibility study , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[6]  Martin O Culjat,et al.  A review of tissue substitutes for ultrasound imaging. , 2010, Ultrasound in medicine & biology.

[7]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[8]  William D Richard,et al.  A Low-Cost B-Mode USB Ultrasound Probe , 2008, Ultrasonic imaging.

[9]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[10]  Wayne H. Wolf,et al.  The future of multiprocessor systems-on-chips , 2004, Proceedings. 41st Design Automation Conference, 2004..

[11]  M. Goldfarb,et al.  A Method for the Control of Multigrasp Myoelectric Prosthetic Hands , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  D T Hutchinson,et al.  Continuous Detection and Decoding of Dexterous Finger Flexions With Implantable MyoElectric Sensors , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Kevin Englehart,et al.  High density electromyography data of normally limbed and transradial amputee subjects for multifunction prosthetic control. , 2012, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[14]  Gamini Dissanayake,et al.  Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals , 2012, Expert Syst. Appl..

[15]  Terence D Sanger,et al.  Bayesian filtering of myoelectric signals. , 2007, Journal of neurophysiology.

[16]  Brian Waryck,et al.  Comparison Of Two Myoelectric Multi-Articulating Prosthetic Hands , 2011 .

[17]  E J MacKenzie,et al.  Incidence, acute care length of stay, and discharge to rehabilitation of traumatic amputee patients: an epidemiologic study. , 1998, Archives of physical medicine and rehabilitation.

[18]  Jing-Yi Guo,et al.  Recognition of finger flexion motion from ultrasound image: a feasibility study. , 2012, Ultrasound in medicine & biology.

[19]  M. Ziskin,et al.  International recommendations and guidelines for the safe use of diagnostic ultrasound in medicine. , 2000, Ultrasound in medicine & biology.

[20]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Silvestro Micera,et al.  Interfacing with the peripheral nervous system to develop innovative neuroprostheses. , 2009, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[22]  E L Morin,et al.  Sampling, noise-reduction and amplitude estimation issues in surface electromyography. , 2002, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[23]  Silvestro Micera,et al.  A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems , 2005, Journal of the peripheral nervous system : JPNS.

[24]  Tetsuya Hayashi,et al.  A single mediaprocessor-based programmable ultrasound system , 2003, IEEE Transactions on Information Technology in Biomedicine.

[25]  Yong-Ku Kong,et al.  Crosstalk effect on surface electromyogram of the forearm flexors during a static grip task. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[26]  H. H. Sears,et al.  PROPORTIONAL MYOELECTRIC HAND CONTROL: AN EVALUATION , 1991, American journal of physical medicine & rehabilitation.

[27]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[28]  Todd A. Kuiken,et al.  A Decision-Based Velocity Ramp for Minimizing the Effect of Misclassifications During Real-Time Pattern Recognition Control , 2011, IEEE Transactions on Biomedical Engineering.

[29]  C. Castellini,et al.  Using Ultrasound Images of the Forearm to Predict Finger Positions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[31]  Jing-Yi Guo,et al.  Sonomyography (SMG) control for powered prosthetic hand: a study with normal subjects. , 2010, Ultrasound in medicine & biology.

[32]  Charles H. Pritham,et al.  Evolution and Development of the Silicone Suction Socket (3S) for Below-Knee Prostheses , 1989 .

[33]  P. Kyberd,et al.  Survey of Upper-Extremity Prosthesis Users in Sweden and the United Kingdom , 2007 .

[34]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[35]  Nitish V. Thakor,et al.  Decoding of Individuated Finger Movements Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[36]  Wen-Jyi Hwang,et al.  Fast kNN classification algorithm based on partial distance search , 1998 .

[37]  Jeng-Shyang Pan,et al.  A Fast K Nearest Neighbors Classification Algorithm , 2004 .

[38]  F. Foster,et al.  A history of medical and biological imaging with polyvinylidene fluoride (PVDF) transducers , 2000, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[39]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Siddhartha Sikdar,et al.  Measurement of rectus femoris muscle velocities during patellar tendon jerk using vector tissue doppler imaging , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  D. Atkins,et al.  Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities , 1996 .