Spatial–Temporal Discriminative Restricted Boltzmann Machine for Event-Related Potential Detection and Analysis

Detecting event-related potential (ERP) is a challenging problem because of its low signal-to-noise ratio and complex spatial–temporal features. Conventional detection methods usually rely on the ensemble averaging technique, which may eliminate subtle but important information in ERP signals and lead to poor detection performance. Inspired by the good performance of discriminative restricted Boltzmann machine (DRBM) in feature extraction and classification, we propose a spatial–temporal DRBM (ST-DRBM) to extract spatial and temporal features for ERP detection. The experimental results and statistical analyses demonstrate that the proposed method is able to achieve state-of-the-art ERP detection performance. The ST-DRBM is not only an effective ERP detector, but also a practical tool for ERP analysis. Based on the proposed model, similar scalp distribution and temporal variations were found in the ERP signals of different sessions, which indicated the feasibility of cross-session ERP detection. Given its state-of-the-art performance and effective analytical technique, ST-DRBM is promising for ERP-based brain–computer interfaces and neuroscience research.

[1]  Stephen P. Boyd,et al.  Disciplined Convex Programming , 2006 .

[2]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[3]  Wei Wu,et al.  Bayesian estimation of ERP components from multicondition and multichannel EEG , 2014, NeuroImage.

[4]  Christa Neuper,et al.  Restricted Boltzmann Machines as useful tool for detecting oscillatory EEG components , 2011 .

[5]  Amy Loutfi,et al.  Sleep Stage Classification Using Unsupervised Feature Learning , 2012, Adv. Artif. Neural Syst..

[6]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[7]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[8]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[10]  Xingyu Wang,et al.  Spatial-Temporal Discriminant Analysis for ERP-Based Brain-Computer Interface , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[12]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  Yoshua Bengio,et al.  Classification using discriminative restricted Boltzmann machines , 2008, ICML '08.

[14]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[15]  Fusheng Yang,et al.  BCI competition 2003-data set IIb: enhancing P300 wave detection using ICA-based subspace projections for BCI applications , 2004, IEEE Transactions on Biomedical Engineering.

[16]  Nicolas Chapados,et al.  Statistical Machine Learning Algorithms for Target Classification from Acoustic Signature , 2009 .

[17]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[18]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[19]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Justin A. Blanco,et al.  Modeling electroencephalography waveforms with semi-supervised deep belief nets: fast classification and anomaly measurement , 2011, Journal of neural engineering.

[21]  Yuanqing Li,et al.  Grouped Automatic Relevance Determination and Its Application in Channel Selection for P300 BCIs , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  R. Quian Quiroga,et al.  Single-trial event-related potentials with wavelet denoising , 2003, Clinical Neurophysiology.

[23]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[24]  Charles H. Hillman,et al.  Acute exercise facilitates brain function and cognition in children who need it most: An ERP study of individual differences in inhibitory control capacity , 2013, Developmental Cognitive Neuroscience.

[25]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[26]  Paul D. Kieffaber,et al.  Evaluation of a clinically practical, ERP-based neurometric battery: Application to age-related changes in brain function , 2016, Clinical Neurophysiology.

[27]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Nicolas Le Roux,et al.  Representational Power of Restricted Boltzmann Machines and Deep Belief Networks , 2008, Neural Computation.

[29]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[31]  Gian Domenico Iannetti,et al.  A novel approach for enhancing the signal-to-noise ratio and detecting automatically event-related potentials (ERPs) in single trials , 2010, NeuroImage.

[32]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[33]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[34]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[35]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[36]  Lianwen Jin,et al.  A Hybrid Network for ERP Detection and Analysis Based on Restricted Boltzmann Machine , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.