A Low-Cost Computational Method for Characterizing Event-Related Potentials for BCI Applications and Beyond

Event-related potentials (ERPs) are important neurophysiological markers widely used in scientific, medical and engineering contexts. Proper ERP detection contributes to widening the scope of use and, in general, improving functionality. The morphology and latency of ERPs are variable among subject sessions, which complicates their detection. Although variability is an intrinsic feature of neuronal activity, it can be addressed with novel views on ERP detection techniques. In this paper, we propose an agile method for characterizing and thus detecting variable ERPs, which keeps track of their temporal and spatial information through the continuous measurement of the area under the curve in ERP components. We illustrate the usefulness of the proposed ERP characterization for electrode selection in brain-computer interfaces (BCIs) and compare the results with other standard methods. We assess ERP classification for BCI use with Bayesian linear discriminant analysis (BLDA) and cross-validation. We also evaluate performance with both the information transfer rate and BCI utility. The results of our validation tests show that this characterization helps to take advantage of the information on the evolution of positive and negative ERP components and, therefore, to efficiently select electrodes for optimized ERP detection. The proposed method improves the classification accuracy and bitrate of all sets of electrodes analyzed. Furthermore, the method is robust between different day sessions. Our work contributes to the efficient detection of ERPs, manages inter- and intrasubject variability, decreases the computational cost of classic detection methods and contributes to promoting low-cost personalized brain-computer interfaces.

[1]  Li Yao,et al.  Classifying four-category visual objects using multiple ERP components in single-trial ERP , 2016, Cognitive Neurodynamics.

[2]  Michael T McCann,et al.  Electrode subset selection methods for an EEG-based P300 brain-computer interface , 2015, Disability and rehabilitation. Assistive technology.

[3]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[4]  Li Yao,et al.  Combining features from ERP components in single-trial EEG for discriminating four-category visual objects , 2012, Journal of neural engineering.

[5]  Robert F. Tate,et al.  Correlation Between a Discrete and a Continuous Variable. Point-Biserial Correlation , 1954 .

[6]  R Chavarriaga,et al.  Latency correction of event-related potentials between different experimental protocols. , 2014, Journal of neural engineering.

[7]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[8]  Riccardo Poli,et al.  Brain–Computer Interfaces for Detection and Localization of Targets in Aerial Images , 2017, IEEE Transactions on Biomedical Engineering.

[9]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[10]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[11]  Jun Kong,et al.  Investigation of different classifiers and channel configurations of a mobile P300-based brain–computer interface , 2017, Medical & Biological Engineering & Computing.

[12]  James C. Christensen,et al.  The effects of day-to-day variability of physiological data on operator functional state classification , 2012, NeuroImage.

[13]  Xingyu Wang,et al.  Optimizing the Face Paradigm of BCI System by Modified Mismatch Negative Paradigm , 2016, Front. Neurosci..

[14]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[15]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[16]  O Bertrand,et al.  A robust sensor-selection method for P300 brain–computer interfaces , 2011, Journal of neural engineering.

[17]  Francisco B. Rodríguez,et al.  Algorithmic clustering based on string compression to extract P300 structure in EEG signals , 2019, Comput. Methods Programs Biomed..

[18]  M. Eimer Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. , 2000, Brain research. Cognitive brain research.

[19]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Nader Pouratian,et al.  A method for optimizing EEG electrode number and configuration for signal acquisition in P300 speller systems , 2015, Clinical Neurophysiology.

[21]  Athanasios V. Vasilakos,et al.  Brain computer interface: control signals review , 2017, Neurocomputing.

[22]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[23]  Pablo Varona,et al.  An electrode selection approach in P300-based BCIs to address inter- and intra-subject variability , 2018, 2018 6th International Conference on Brain-Computer Interface (BCI).

[24]  J.J. Vidal,et al.  Real-time detection of brain events in EEG , 1977, Proceedings of the IEEE.

[25]  Andrea Hildebrandt,et al.  Exploiting the intra-subject latency variability from single-trial event-related potentials in the P3 time range: A review and comparative evaluation of methods , 2017, Neuroscience & Biobehavioral Reviews.

[26]  Ying Zeng,et al.  Combining Multiple ERP Components for Detecting Targets in Remote-Sensing Images , 2017, 2017 9th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[27]  David E Thompson,et al.  Classifier-based latency estimation: a novel way to estimate and predict BCI accuracy , 2013, Journal of neural engineering.

[28]  Sadasivan Puthusserypady,et al.  Spatial filter feature extraction methods for P300 BCI speller: A comparison , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  Wei Wang,et al.  A Study on RSVP Paradigm Based on Brain Computer Interface Across Subjects , 2018, 2018 9th International Conference on Awareness Science and Technology (iCAST).

[30]  Róbert Móro,et al.  Towards adaptive brain-computer interfaces: Improving accuracy of detection of event-related potentials , 2017, 2017 12th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP).

[31]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[32]  Chi Zhang,et al.  A novel P300 BCI speller based on the Triple RSVP paradigm , 2018, Scientific Reports.

[33]  P. Sajda,et al.  Cortically coupled computer vision for rapid image search , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Klaus-Robert Müller,et al.  Recent Progress in Brain and Cognitive Engineering , 2015, Trends in Augmentation of Human Performance.

[36]  Edmund C Lalor,et al.  A gaze independent hybrid-BCI based on visual spatial attention , 2017, Journal of neural engineering.

[37]  Rami Saab,et al.  A Hybrid Brain–Computer Interface Based on the Fusion of P300 and SSVEP Scores , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[39]  D. B. Ryan,et al.  Evaluating brain-computer interface performance using color in the P300 checkerboard speller , 2017, Clinical Neurophysiology.

[40]  David E Thompson,et al.  Enhancing P300-BCI performance using latency estimation. , 2017, Brain computer interfaces.

[41]  E W Sellers,et al.  Faces, locations, and tools: a proposed two-stimulus P300 brain computer interface , 2019, Journal of neural engineering.

[42]  Ernesto Bribiesca,et al.  P300 Detection Based on EEG Shape Features , 2016, Comput. Math. Methods Medicine.

[43]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[44]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[45]  K. A. Colwell,et al.  Channel selection methods for the P300 Speller , 2014, Journal of Neuroscience Methods.

[46]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[47]  Natasha M. Maurits,et al.  Stimuli and Feature Extraction Algorithms for Brain-Computer Interfaces: A Systematic Comparison , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  B O Mainsah,et al.  Optimizing the stimulus presentation paradigm design for the P300-based brain-computer interface using performance prediction , 2017, Journal of neural engineering.

[49]  Lucas C. Parra,et al.  Extracting multidimensional stimulus-response correlations using hybrid encoding-decoding of neural activity , 2017, NeuroImage.

[50]  Brendan Z. Allison,et al.  Assessing Command-Following and Communication With Vibro-Tactile P300 Brain-Computer Interface Tools in Patients With Unresponsive Wakefulness Syndrome , 2018, Front. Neurosci..

[51]  Dewen Hu,et al.  A Novel Single-Character Visual BCI Paradigm With Multiple Active Cognitive Tasks , 2019, IEEE Transactions on Biomedical Engineering.

[52]  Klaus-Robert Müller,et al.  Learning from label proportions in brain-computer interfaces: Online unsupervised learning with guarantees , 2017, PloS one.

[53]  Francisco B. Rodríguez,et al.  How to Reduce Classification Error in ERP-Based BCI: Maximum Relative Areas as a Feature for P300 Detection , 2017, IWANN.

[54]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[55]  Christian Jutten,et al.  Transfer Learning: A Riemannian Geometry Framework With Applications to Brain–Computer Interfaces , 2018, IEEE Transactions on Biomedical Engineering.

[56]  Yuanqing Li,et al.  Grouped Automatic Relevance Determination and Its Application in Channel Selection for P300 BCIs , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[58]  Anthony J. Ries,et al.  Best practice for single-trial detection of event-related potentials: Application to brain-computer interfaces. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[59]  Alexandre Barachant,et al.  A Plug&Play P300 BCI Using Information Geometry , 2014, ArXiv.

[60]  Heung-Il Suk,et al.  A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  T. Kašpárek,et al.  Event-related Potentials and Their Applications , 2014 .

[62]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[63]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[64]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[65]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[66]  Andrés Úbeda,et al.  Visual evoked potential-based brain-machine interface applications to assist disabled people , 2012, Expert Syst. Appl..

[67]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[68]  Daniela De Venuto,et al.  Real-time P300-based BCI in mechatronic control by using a multi-dimensional approach , 2018, IET Softw..