A P300 Brain-Computer Interface Based on a Modification of the Mismatch Negativity Paradigm

The P300-based brain-computer interface (BCI) is an extension of the oddball paradigm, and can facilitate communication for people with severe neuromuscular disorders. It has been shown that, in addition to the P300, other event-related potential (ERP) components have been shown to contribute to successful operation of the P300 BCI. Incorporating these components into the classification algorithm can improve the classification accuracy and information transfer rate (ITR). In this paper, a single character presentation paradigm was compared to a presentation paradigm that is based on the visual mismatch negativity. The mismatch negativity paradigm showed significantly higher classification accuracy and ITRs than a single character presentation paradigm. In addition, the mismatch paradigm elicited larger N200 and N400 components than the single character paradigm. The components elicited by the presentation method were consistent with what would be expected from a mismatch paradigm and a typical P300 was also observed. The results show that increasing the signal-to-noise ratio by increasing the amplitude of ERP components can significantly improve BCI speed and accuracy. The mismatch presentation paradigm may be considered a viable option to the traditional P300 BCI paradigm.

[1]  Brendan Z Allison,et al.  Effects of SOA and flash pattern manipulations on ERPs, performance, and preference: implications for a BCI system. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[2]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[3]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[4]  Valéria Csépe,et al.  Electroencephalography effects to semantic and non-semantic mismatch in properties of visually presented single-characters: The N2b and the N400 , 2007, Neuroscience Letters.

[5]  István Czigler,et al.  ERPs and deviance detection: Visual mismatch negativity to repeated visual stimuli , 2006, Neuroscience Letters.

[6]  H. Adeli,et al.  Brain-computer interface technologies: from signal to action , 2013, Reviews in the neurosciences.

[7]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[8]  Andrzej Cichocki,et al.  Whether generic model works for rapid ERP-based BCI calibration , 2013, Journal of Neuroscience Methods.

[9]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[10]  Pedro J. García-Laencina,et al.  Efficient Automatic Selection and Combination of EEG Features in Least Squares Classifiers for Motor Imagery Brain-Computer Interfaces , 2013, Int. J. Neural Syst..

[11]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[12]  Jonathan R. Folstein,et al.  Novelty and conflict in the categorization of complex stimuli. , 2008, Psychophysiology.

[13]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[14]  K. A. Colwell,et al.  Channel selection methods for the P300 Speller , 2014, Journal of Neuroscience Methods.

[15]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[16]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[17]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.

[18]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Jie Li,et al.  Design of assistive Wheelchair System directly Steered by Human Thoughts , 2013, Int. J. Neural Syst..

[20]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[21]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[22]  J. Buford,et al.  Brain–Computer Interface after Nervous System Injury , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[23]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[24]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[25]  Wei Yen Hsu,et al.  Application of Competitive Hopfield Neural Network to Brain-Computer Interface Systems , 2012, Int. J. Neural Syst..

[26]  Cuntai Guan,et al.  Unsupervised Brain Computer Interface Based on Intersubject Information and Online Adaptation , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Yuping Wang,et al.  The sequential processing of visual feature conjunction mismatches in the human brain. , 2004, Psychophysiology.

[28]  Brendan Z. Allison,et al.  P300 brain computer interface: current challenges and emerging trends , 2012, Front. Neuroeng..

[29]  Marc M. Van Hulle,et al.  Multichannel Decoding for Phase-Coded SSVEP Brain-Computer Interface , 2012, Int. J. Neural Syst..

[30]  R. Cammann.  Is there a mismatch negativity (MMN) in visual modality? , 1990, Behavioral and Brain Sciences.

[31]  M. Kimura.  Visual mismatch negativity and unintentional temporal-context-based prediction in vision. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[32]  Gernot R. Müller-Putz,et al.  A Single-Switch BCI Based on Passive and imagined movements: toward Restoring Communication in Minimally Conscious patients , 2013, Int. J. Neural Syst..

[33]  R. Näätänen.  Attention and brain function , 1992 .

[34]  E. Schröger,et al.  Top-down attention affects sequential regularity representation in the human visual system. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[36]  W. Pritchard.  Psychophysiology of P300. , 1981, Psychological bulletin.

[37]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[38]  A. Cichocki,et al.  A novel BCI based on ERP components sensitive to configural processing of human faces , 2012, Journal of neural engineering.

[39]  M. Kuba,et al.  Visual mismatch negativity elicited by magnocellular system activation , 2006, Vision Research.

[40]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[41]  Francisco J. Pelayo,et al.  An auditory Brain-Computer Interface with Accuracy Prediction , 2012, Int. J. Neural Syst..

[42]  Xingyu Wang,et al.  A combined brain–computer interface based on P300 potentials and motion-onset visual evoked potentials , 2012, Journal of Neuroscience Methods.

[43]  S M M Martens,et al.  Overlap and refractory effects in a brain–computer interface speller based on the visual P300 event-related potential , 2009, Journal of neural engineering.

[44]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[45]  J. Buford,et al.  Combined corticospinal and reticulospinal effects on upper limb muscles , 2014, Neuroscience Letters.

[46]  Xingyu Wang,et al.  Spatial-Temporal Discriminant Analysis for ERP-Based Brain-Computer Interface , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Erich Schröger,et al.  Human Visual System Automatically Encodes Sequential Regularities of Discrete Events , 2010, Journal of Cognitive Neuroscience.

[48]  Xingyu Wang,et al.  Targeting an efficient target-to-target interval for P300 speller brain–computer interfaces , 2012, Medical & Biological Engineering & Computing.

[49]  Heikki Lyytinen,et al.  Benefits of Multi-Domain Feature of mismatch Negativity Extracted by Non-Negative Tensor Factorization from EEG Collected by Low-Density Array , 2012, Int. J. Neural Syst..

[50]  Xingyu Wang,et al.  An ERP-Based BCI using an oddball Paradigm with Different Faces and Reduced errors in Critical Functions , 2014, Int. J. Neural Syst..

[51]  Clemens Brunner,et al.  An adaptive P 300-based control system , 2011 .

[52]  Motohiro Kimura,et al.  Attention switching function of memory-comparison-based change detection system in the visual modality. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[53]  Motohiro Kimura,et al.  Probability-independent and -dependent ERPs reflecting visual change detection. , 2006, Psychophysiology.

[54]  J. Wolpaw,et al.  Toward enhanced P 300 speller performance , 2007 .

[55]  István Czigler,et al.  Visual Mismatch Negativity and Categorization , 2014, Brain Topography.

[56]  István Czigler,et al.  Processing of unattended facial emotions: A visual mismatch negativity study , 2012, NeuroImage.

[57]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[58]  H. Adeli,et al.  Analysis of EEG records in an epileptic patient using wavelet transform , 2003, Journal of Neuroscience Methods.

[59]  Jie Li,et al.  Evaluation and Application of a Hybrid Brain Computer Interface for Real Wheelchair Parallel Control with Multi-Degree of Freedom , 2014, Int. J. Neural Syst..

[60]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[61]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[62]  Xingyu Wang,et al.  Aggregation of Sparse Linear Discriminant analyses for Event-Related potential Classification in Brain-Computer Interface , 2014, Int. J. Neural Syst..

[63]  Xingyu Wang,et al.  An adaptive P300-based control system , 2011, Journal of neural engineering.

[64]  Xingyu Wang,et al.  Optimized stimulus presentation patterns for an event-related potential EEG-based brain–computer interface , 2011, Medical & Biological Engineering & Computing.

[65]  Ko-ichiro Miyamoto,et al.  A brain-computer interface (BCI) system based on auditory stream segregation , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[66]  R. Knight,et al.  Contributions of temporal-parietal junction to the human auditory P3 , 1989, Brain Research.

[67]  Andrzej Cichocki,et al.  Tensor classification for P300-based brain computer interface , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[68]  J. Polich,et al.  P300 amplitude is determined by target-to-target interval. , 2002, Psychophysiology.