Deep learning-based classification of fine hand movements from low frequency EEG

The classification of different fine hand movements from EEG signals represents a relevant research challenge, e.g., in brain-computer interface applications for motor rehabilitation. Here, we analyzed two different datasets where fine hand movements (touch, grasp, palmar and lateral grasp) were performed in a self-paced modality. We trained and tested a newly proposed convolutional neural network (CNN), and we compared its classification performance into respect to two well-established machine learning models, namely, a shrinked-LDA and a Random Forest. Compared to previous literature, we took advantage of the knowledge of the neuroscience field, and we trained our CNN model on the so-called Movement Related Cortical Potentials (MRCPs)s. They are EEG amplitude modulations at low frequencies, i.e., (0.3, 3) Hz, that have been proved to encode several properties of the movements, e.g., type of grasp, force level and speed. We showed that CNN achieved good performance in both datasets and they were similar or superior to the baseline models. Also, compared to the baseline, our CNN requires a lighter and faster pre-processing procedure, paving the way for its possible use in an online modality, e.g., for many brain-computer interface applications.

[1]  Takashi Hanakawa,et al.  The curse of motor expertise: Use-dependent focal dystonia as a manifestation of maladaptive changes in body representation , 2016, Neuroscience Research.

[2]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[3]  Gernot R Müller-Putz,et al.  Upper limb movements can be decoded from the time-domain of low-frequency EEG , 2017, PloS one.

[4]  Giulia Cisotto,et al.  Kinematic and Neurophysiological Consequences of an Assisted-Force-Feedback Brain-Machine Interface Training: A Case Study , 2013, Front. Neurol..

[5]  M. Hallett,et al.  What is the Bereitschaftspotential? , 2006, Clinical Neurophysiology.

[6]  Kip A Ludwig,et al.  Using a common average reference to improve cortical neuron recordings from microelectrode arrays. , 2009, Journal of neurophysiology.

[7]  Gernot R. Müller-Putz,et al.  Unimanual and Bimanual Reach-and-Grasp Actions Can Be Decoded From Human EEG , 2020, IEEE Transactions on Biomedical Engineering.

[8]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[9]  Christa Neuper,et al.  Autocalibration and Recurrent Adaptation: Towards a Plug and Play Online ERD-BCI , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[11]  Gernot Müller-Putz,et al.  Cybathlon experiences of the Graz BCI racing team Mirage91 in the brain-computer interface discipline , 2017, Journal of NeuroEngineering and Rehabilitation.

[12]  Ji-Hoon Jeong,et al.  Motor Imagery Classification of Single-Arm Tasks Using Convolutional Neural Network based on Feature Refining , 2020, 2020 8th International Winter Conference on Brain-Computer Interface (BCI).

[13]  Silvano Pupolin,et al.  An EEG-Based BCI Platform to Improve Arm Reaching Ability of Chronic Stroke Patients by Means of an Operant Learning Training with a Contingent Force Feedback , 2014, Int. J. E Health Medical Commun..

[14]  Sadasivan Puthusserypady,et al.  An end-to-end deep learning approach to MI-EEG signal classification for BCIs , 2018, Expert Syst. Appl..

[15]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[16]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[17]  Emily S. Cross,et al.  On-line grasp control is mediated by the contralateral hemisphere , 2007, Brain Research.

[18]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[19]  J. Pereira,et al.  Decoding natural reach-and-grasp actions from human EEG , 2018, Journal of neural engineering.

[20]  Urszula Markowska-Kaczmar,et al.  Comparison of Attention-based Deep Learning Models for EEG Classification , 2020, ArXiv.

[21]  Gernot R. Müller-Putz,et al.  A co-adaptive sensory motor rhythms Brain-Computer Interface based on common spatial patterns and Random Forest , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Silvano Pupolin,et al.  Brain-computer interface in chronic stroke: An application of sensorimotor closed-loop and contingent force feedback , 2013, 2013 IEEE International Conference on Communications (ICC).

[23]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[24]  Klaus-Robert Müller,et al.  Covariance shrinkage for autocorrelated data , 2014, NIPS.