A CNN-SVM combined model for pattern recognition of knee motion using mechanomyography signals.

The commonly used classifiers for pattern recognition of human motion, like backpropagation neural network (BPNN) and support vector machine (SVM), usually implement the classification by extracting some hand-crafted features from the human biological signals. These features generally require the domain knowledge for researchers to be designed and take a long time to be tested and selected for high classification performance. In contrast, convolutional neural network (CNN), which has been widely applied to computer vision, can learn to automatically extract features from the training data by means of convolution and subsampling, but CNN training usually requires large sample data and has the overfitting problem. On the other hand, SVM has good generalization ability and can solve the small sample problem. Therefore, we proposed a CNN-SVM combined model to make use of their advantages. In this paper, we detected 4-channel mechanomyography (MMG) signals from the thigh muscles and fed them in the form of time series signals to the CNN-SVM combined model for the pattern recognition of knee motion. Compared with the common classifier performing the classification with hand-crafted features, the CNN-SVM combined model could automatically extract features using CNN, and better improved the generalization ability of CNN and the classification accuracy by means of combining the SVM. This study would provide reference for human motion recognition using other time series signals and further expand the application fields of CNN.

[1]  C. Orizio Muscle sound: bases for the introduction of a mechanomyographic signal in muscle studies. , 1993, Critical reviews in biomedical engineering.

[2]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[3]  Rubin Wang,et al.  Pattern Recognition of Momentary Mental Workload Based on Multi-Channel Electrophysiological Data and Ensemble Convolutional Neural Networks , 2017, Front. Neurosci..

[4]  Tom Chau,et al.  A self-contained, mechanomyography-driven externally powered prosthesis. , 2005, Archives of physical medicine and rehabilitation.

[5]  Mingyang Li,et al.  Continuous Recognition of Multifunctional Finger and Wrist Movements in Amputee Subjects Based on sEMG and Accelerometry , 2016, The open biomedical engineering journal.

[6]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[7]  Levi J. Hargrove,et al.  A Classification Method for User-Independent Intent Recognition for Transfemoral Amputees Using Powered Lower Limb Prostheses , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  C. Orizio,et al.  Surface mechanomyogram reflects muscle fibres twitches summation. , 1996, Journal of biomechanics.

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Nicola Vitiello,et al.  Intention-Based EMG Control for Powered Exoskeletons , 2012, IEEE Transactions on Biomedical Engineering.

[11]  Wei Zhang,et al.  Automatic Recognition of fMRI-Derived Functional Networks Using 3-D Convolutional Neural Networks , 2018, IEEE Transactions on Biomedical Engineering.

[12]  Ching Y. Suen,et al.  A novel hybrid CNN-SVM classifier for recognizing handwritten digits , 2012, Pattern Recognit..

[13]  Shu Zhan,et al.  Robust face detection using local CNN and SVM based on kernel combination , 2016, Neurocomputing.

[14]  Lifu Gao,et al.  Real-time continuous recognition of knee motion using multi-channel mechanomyography signals detected on clothes. , 2018, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[15]  Raimon Jané,et al.  Index for estimation of muscle force from mechanomyography based on the Lempel-Ziv algorithm. , 2013, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[16]  D T Barry,et al.  Acoustic myography as a control signal for an externally powered prosthesis. , 1986, Archives of physical medicine and rehabilitation.

[17]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[18]  D. Barry,et al.  Muscle sounds are emitted at the resonant frequencies of skeletal muscle , 1990, IEEE Transactions on Biomedical Engineering.

[19]  Richard J. Schmidt,et al.  A mechanomyographic frequency-based fatigue threshold test , 2010, Journal of Neuroscience Methods.

[20]  Anselmo Frizera-Neto,et al.  Towards a Robotic Knee Exoskeleton Control Based on Human Motion Intention through EEG and sEMGsignals , 2015 .

[21]  Nur Azah Hamzaid,et al.  Mechanomyography and muscle function assessment: a review of current state and prospects. , 2014, Clinical biomechanics.

[22]  Joseph P Weir,et al.  Does the frequency content of the surface mechanomyographic signal reflect motor unit firing rates? A brief review. , 2007, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[23]  K Mita,et al.  Electromyographic and mechanomyographic estimation of motor unit activation strategy in voluntary force production. , 2004, Electromyography and clinical neurophysiology.

[24]  Tom Chau,et al.  Uncovering patterns of forearm muscle activity using multi-channel mechanomyography. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[25]  C. J. Tierra-Criollo,et al.  Detection of movement intention using EEG in a human-robot interaction environment , 2015 .

[26]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[27]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[28]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[29]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Hong-Bo Xie,et al.  Classification of the mechanomyogram signal using a wavelet packet transform and singular value decomposition for multifunction prosthesis control , 2009, Physiological measurement.

[31]  Majd Latah,et al.  Human action recognition using support vector machines and 3D convolutional neural networks , 2017 .