Deep Neural Networks for Forecasting Single-Trial Event-Related Neural Activity

In this work, we propose a deep neural network to forecast single-trial event-related electroencephalographic (EEG) activity using observed pre-event EEG data. Forecasting eventrelated potentials (ERPs) have a number of potential benefits for brain-computer interface (BCI) systems. Accurate predictions of neural responses can reduce the latencies of neural signal classification algorithms and closed-loop feedback systems. Various models of ERPs propose that there exists a causal dependency between post-event neural responses and ongoing pre-event neural dynamics. Accordingly, we implement a deep neural network that extracts features from pre-event data in order to predict a single-trial ERP. To capture the variability of a single trial, the network constructs the post-event waveform in two parts: 1) generating ongoing neural activity and 2) generating event-related components comprising the ERP. We evaluate our model by forecasting 500 milliseconds of single channel postevent data from a Rapid Series Visual Presentation (RSVP) task. Our results indicate a significant increase in forecasting performance compared to baseline methods, suggesting that deep neural networks can extract informative features from pre-event EEG data in order to generate a prediction of the post-event waveform.

[1]  S. Bressler,et al.  Stochastic modeling of neurobiological time series: power, coherence, Granger causality, and separation of evoked responses from ongoing activity. , 2006, Chaos.

[2]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[3]  Mingzhou Ding,et al.  Estimation of single-trial multicomponent ERPs: Differentially variable component analysis (dVCA) , 2003, Biological Cybernetics.

[4]  Kenneth Kreutz-Delgado,et al.  EyeCatch: Data-mining over half a million EEG independent components to construct a fully-automated eye-component detector , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Yoshua Bengio,et al.  SampleRNN: An Unconditional End-to-End Neural Audio Generation Model , 2016, ICLR.

[6]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[10]  Ankoor S. Shah,et al.  Neural dynamics and the fundamental mechanisms of event-related brain potentials. , 2004, Cerebral cortex.

[11]  Tonio Ball,et al.  Hierarchical internal representation of spectral features in deep convolutional networks trained for EEG decoding , 2017, 2018 6th International Conference on Brain-Computer Interface (BCI).

[12]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[13]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[14]  R. Coppola,et al.  Signal to noise ratio and response variability measurements in single trial evoked potentials. , 1978, Electroencephalography and clinical neurophysiology.

[15]  Siem Jan Koopman,et al.  Time Series Analysis by State Space Methods , 2001 .

[16]  Katarzyna J. Blinowska,et al.  Non-linear and linear forecasting of the EEG time series , 1991, Biological Cybernetics.

[17]  Piotr J. Durka,et al.  Single evoked potential reconstruction by means of wavelet transform , 2004, Biological Cybernetics.