Improving the Efficacy of ERP-Based BCIs Using Different Modalities of Covert Visuospatial Attention and a Genetic Algorithm-Based Classifier

We investigated whether the covert orienting of visuospatial attention can be effectively used in a brain-computer interface guided by event-related potentials. Three visual interfaces were tested: one interface that activated voluntary orienting of visuospatial attention and two interfaces that elicited automatic orienting of visuospatial attention. We used two epoch classification procedures. The online epoch classification was performed via Independent Component Analysis, and then it was followed by fixed features extraction and support vector machines classification. The offline epoch classification was performed by means of a genetic algorithm that permitted us to retrieve the relevant features of the signal, and then to categorise the features with a logistic classifier. The offline classification, but not the online one, allowed us to differentiate between the performances of the interface that required voluntary orienting of visuospatial attention and those that required automatic orienting of visuospatial attention. The offline classification revealed an advantage of the participants in using the “voluntary” interface. This advantage was further supported, for the first time, by neurophysiological data. Moreover, epoch analysis was performed better with the “genetic algorithm classifier” than with the “independent component analysis classifier”. We suggest that the combined use of voluntary orienting of visuospatial attention and of a classifier that permits feature extraction ad personam (i.e., genetic algorithm classifier) can lead to a more efficient control of visual BCIs.

[1]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[2]  J. Kaipio,et al.  Subspace regularization method for the single-trial estimation of evoked potentials , 1999, IEEE Transactions on Biomedical Engineering.

[3]  Luca Citi,et al.  Feature Selection and Classification in Brain Computer Interfaces by a Genetic Algorithm , 2004 .

[4]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[5]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[6]  Y. Nakajima,et al.  Visual stimuli for the P300 brain–computer interface: A comparison of white/gray and green/blue flicker matrices , 2009, Clinical Neurophysiology.

[7]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[8]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[9]  N. Birbaumer Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[10]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[11]  T. Sejnowski,et al.  Analysis and visualization of single‐trial event‐related potentials , 2001, Human brain mapping.

[12]  Francesco Piccione,et al.  User adaptive BCIs: SSVEP and P300 based interfaces , 2003, PsychNology J..

[13]  M. Matteucci,et al.  The Utility Metric: A Novel Method to Assess the Overall Performance of Discrete Brain–Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  S. Cessie,et al.  Ridge Estimators in Logistic Regression , 1992 .

[15]  J. Selhorst,et al.  "Locked-in" syndrome. , 1987, Stroke.

[16]  Luca T. Mainardi,et al.  Online Detection of P300 and Error Potentials in a BCI Speller , 2010, Comput. Intell. Neurosci..

[17]  B.Z. Allison,et al.  ERPs evoked by different matrix sizes: implications for a brain computer interface (BCI) system , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[19]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[20]  Bin He,et al.  Classifying EEG-based motor imagery tasks by means of time–frequency synthesized spatial patterns , 2004, Clinical Neurophysiology.

[21]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[22]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[24]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[25]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[26]  Miceli Gabriele,et al.  Batteria per l'analisi dei deficit afasici. B.A.D.A. , 1994 .

[27]  Tzyy-Ping Jung,et al.  Extended ICA Removes Artifacts from Electroencephalographic Recordings , 1997, NIPS.

[28]  M. Stone Cross-validation and multinomial prediction , 1974 .

[29]  Hossein Arabalibeik,et al.  Evaluation of Hidden Markov Model for P300 Detection in EEG Signal , 2009, MMVR.

[30]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[31]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[32]  Steven L. Johnson,et al.  A P300-Based Brain–Computer Interface: Effects of Interface Type and Screen Size , 2010, Int. J. Hum. Comput. Interact..

[33]  Niels Birbaumer,et al.  Brain–computer-interface research: Coming of age , 2006, Clinical Neurophysiology.

[34]  D. Hu,et al.  Gaze independent brain–computer speller with covert visual search tasks , 2011, Clinical Neurophysiology.

[35]  N. Birbaumer,et al.  An auditory oddball (P300) spelling system for brain-computer interfaces. , 2009, Psychophysiology.

[36]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[37]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[38]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[39]  P. Tonin,et al.  P300-Based Brain–Computer Interface Communication: Evaluation and Follow-up in Amyotrophic Lateral Sclerosis , 2009, Front. Neuropro..

[40]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[41]  S. Silvoni,et al.  Exogenous and endogenous orienting of visuospatial attention in P300-guided brain computer interfaces: A pilot study on healthy participants , 2012, Clinical Neurophysiology.

[42]  G. Cardarilli,et al.  Performances Evaluation and Optimization of Brain Computer Interface Systems in a Copy Spelling Task , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Bernhard Graimann,et al.  A comparison approach toward finding the best feature and classifier in cue-based BCI , 2007, Medical & Biological Engineering & Computing.

[44]  C. Neuper,et al.  Toward a high-throughput auditory P300-based brain–computer interface , 2009, Clinical Neurophysiology.

[45]  B. Schoelkopf,et al.  Transition from the locked in to the completely locked-in state: A physiological analysis , 2011, Clinical Neurophysiology.

[46]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[47]  T. Gillingwater,et al.  Review: Neuromuscular synaptic vulnerability in motor neurone disease: amyotrophic lateral sclerosis and spinal muscular atrophy , 2010, Neuropathology and applied neurobiology.

[48]  S. Gielen,et al.  The brain–computer interface cycle , 2009, Journal of neural engineering.

[49]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[50]  Margot J. Taylor,et al.  Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. , 2000, Psychophysiology.

[51]  Hubert Cecotti,et al.  A Self-Paced and Calibration-Less SSVEP-Based Brain–Computer Interface Speller , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[53]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[54]  Luca T. Mainardi,et al.  A genetic algorithm for automatic feature extraction in P300 detection , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[55]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[56]  N. Birbaumer,et al.  An auditory oddball brain–computer interface for binary choices , 2010, Clinical Neurophysiology.

[57]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[58]  J. Cohen,et al.  On the number of trials needed for P300. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[59]  Febo Cincotti,et al.  Out of the frying pan into the fire--the P300-based BCI faces real-world challenges. , 2011, Progress in brain research.