A pipeline of spatio-temporal filtering for predicting the laterality of self-initiated fine movements from single trial readiness potentials

OBJECTIVE In recent years, the readiness potential (RP), a type of pre-movement neural activity, has been investigated for asynchronous electroencephalogram (EEG)-based brain-computer interfaces (BCIs). Since the RP is attenuated for involuntary movements, a BCI driven by RP alone could facilitate intentional control amid a plethora of unintentional movements. Previous studies have attempted single trial classification of RP via spatial and temporal filtering methods, or by combining the RP with event-related desynchronization. However, RP feature extraction remains challenging due to the slow non-oscillatory nature of the potential, its variability among participants and the inherent noise in EEG signals. Here, we propose a participant-specific, individually optimized pipeline of spatio-temporal filtering (PSTF) to improve RP feature extraction for laterality prediction. APPROACH PSTF applies band-pass filtering on RP signals, followed by Fisher criterion spatial filtering to maximize class separation, and finally temporal window averaging for feature dimension reduction. Optimal parameters are simultaneously found by cross-validation for each participant. Using EEG data from 14 participants performing self-initiated left or right key presses as well as two benchmark BCI datasets, we compared the performance of PSTF to two popular methods: common spatial subspace decomposition, and adaptive spatio-temporal filtering. MAIN RESULTS On the BCI benchmark data sets, PSTF performed comparably to both existing methods. With the key press EEG data, PSTF extracted more discriminative features, thereby leading to more accurate (74.99% average accuracy) predictions of RP laterality than that achievable with existing methods. SIGNIFICANCE Naturalistic and volitional interaction with the world is an important capacity that is lost with traditional system-paced BCIs. We demonstrated a significant improvement in fine movement laterality prediction from RP features alone. Our work supports further study of RP-based BCI for intuitive asynchronous control of the environment, such as augmentative communication or wheelchair navigation.

[1]  Pedro J. García-Laencina,et al.  Efficient Automatic Selection and Combination of EEG Features in Least Squares Classifiers for Motor Imagery Brain-Computer Interfaces , 2013, Int. J. Neural Syst..

[2]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[3]  G. Pfurtscheller,et al.  A fully automated correction method of EOG artifacts in EEG recordings , 2007, Clinical Neurophysiology.

[4]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[5]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[6]  Jun Lu,et al.  Adaptive Spatio-Temporal Filtering for Movement Related Potentials in EEG-Based Brain–Computer Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[8]  J. Millán,et al.  Detection of self-paced reaching movement intention from EEG signals , 2012, Front. Neuroeng..

[9]  Tom Chau,et al.  Electrode Fusion for the Prediction of Self-Initiated Fine Movements from Single-Trial Readiness Potentials , 2015, Int. J. Neural Syst..

[10]  H. Adeli,et al.  Brain-computer interface technologies: from signal to action , 2013, Reviews in the neurosciences.

[11]  B. Allison,et al.  The effects of self-movement, observation, and imagination on mu rhythms and readiness potentials (RP's): toward a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  Urbano Nunes,et al.  Statistical spatial filtering for a P300-based BCI: Tests in able-bodied, and patients with cerebral palsy and amyotrophic lateral sclerosis , 2011, Journal of Neuroscience Methods.

[13]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[14]  P. Sajda,et al.  A data analysis competition to evaluate machine learning algorithms for use in brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  J. Buford,et al.  Brain–Computer Interface after Nervous System Injury , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[16]  Dan Wu,et al.  Combining Spatial Filters for the Classification of Single-Trial EEG in a Finger Movement Task , 2007, IEEE Transactions on Biomedical Engineering.

[17]  Nicola Smania,et al.  Modulation of event-related desynchronization in robot-assisted hand performance: brain oscillatory changes in active, passive and imagined movements , 2013, Journal of NeuroEngineering and Rehabilitation.

[18]  L. Deecke,et al.  Neuroimage of Voluntary Movement: Topography of the Bereitschaftspotential, a 64-Channel DC Current Source Density Study , 1999, NeuroImage.

[19]  Xingyu Wang,et al.  An ERP-Based BCI using an oddball Paradigm with Different Faces and Reduced errors in Critical Functions , 2014, Int. J. Neural Syst..

[20]  R. Barry,et al.  Removal of ocular artifact from the EEG: a review , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[21]  Patrick Berg,et al.  Common spatial subspace decomposition applied to analysis of brain responses under multiple task conditions: a simulation study , 1999, Clinical Neurophysiology.

[22]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[23]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[24]  Haixian Wang,et al.  Local discriminative spatial patterns for movement-related potentials-based EEG classification , 2011, Biomed. Signal Process. Control..

[25]  Ross Cunnington,et al.  Neural activity in readiness for incidental and explicitly timed actions , 2012, Neuropsychologia.

[26]  Begoña Garcia-Zapirain,et al.  EEG artifact removal—state-of-the-art and guidelines , 2015, Journal of neural engineering.

[27]  M. Hallett,et al.  What is the Bereitschaftspotential? , 2006, Clinical Neurophysiology.

[28]  K.-R. Muller,et al.  The Berlin brain-computer interface: EEG-based communication without subject training , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  H. Kornhuber,et al.  Hirnpotentialänderungen bei Willkürbewegungen und passiven Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale , 1965, Pflüger's Archiv für die gesamte Physiologie des Menschen und der Tiere.

[30]  Pavel Jurák,et al.  Intracerebral recording of cortical activity related to self-paced voluntary movements: a Bereitschaftspotential and event-related desynchronization/synchronization. SEEG study , 2006, Experimental Brain Research.

[31]  Gernot R. Müller-Putz,et al.  A Single-Switch BCI Based on Passive and imagined movements: toward Restoring Communication in Minimally Conscious patients , 2013, Int. J. Neural Syst..

[32]  Tom Chau,et al.  Automatic single-trial classification of prefrontal hemodynamic activity in an individual with Duchenne muscular dystrophy , 2013, Developmental neurorehabilitation.

[33]  Fusheng Yang,et al.  BCI competition 2003-data set IV:An algorithm based on CSSD and FDA for classifying single-trial EEG , 2004, IEEE Transactions on Biomedical Engineering.

[34]  Tom Chau,et al.  Bedside computer access for an individual with severe and multiple disabilities: A case study , 2010, Disability and rehabilitation. Assistive technology.

[35]  K.-R. Muller,et al.  Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Francisco J. Pelayo,et al.  An auditory Brain-Computer Interface with Accuracy Prediction , 2012, Int. J. Neural Syst..

[37]  J C Rothwell,et al.  Simple tics in Gilles de la Tourette's syndrome are not prefaced by a normal premovement EEG potential. , 1981, Journal of neurology, neurosurgery, and psychiatry.

[38]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[39]  M. Hallett,et al.  Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries , 2008, Clinical Neurophysiology.

[40]  K.-R. Muller,et al.  Linear and nonlinear methods for brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Klaus-Robert Müller,et al.  Combining Features for BCI , 2002, NIPS.