Multi Resolution LSTM For Long Term Prediction In Neural Activity Video

Epileptic seizures are caused by abnormal, overly syn- chronized, electrical activity in the brain. The abnor- mal electrical activity manifests as waves, propagating across the brain. Accurate prediction of the propagation velocity and direction of these waves could enable real- time responsive brain stimulation to suppress or prevent the seizures entirely. However, this problem is very chal- lenging because the algorithm must be able to predict the neural signals in a sufficiently long time horizon to allow enough time for medical intervention. We consider how to accomplish long term prediction using a LSTM network. To alleviate the vanishing gradient problem, we propose two encoder-decoder-predictor structures, both using multi-resolution representation. The novel LSTM structure with multi-resolution layers could significantly outperform the single-resolution benchmark with similar number of parameters. To overcome the blurring effect associated with video prediction in the pixel domain using standard mean square error (MSE) loss, we use energy- based adversarial training to improve the long-term pre- diction. We demonstrate and analyze how a discriminative model with an encoder-decoder structure using 3D CNN model improves long term prediction.

[1]  J. Gotman,et al.  Discriminating preictal and interictal states in patients with temporal lobe epilepsy using wavelet analysis of intracerebral EEG , 2012, Clinical Neurophysiology.

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Shufang Li,et al.  Seizure Prediction Using Spike Rate of Intracranial EEG , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Daan Wierstra,et al.  One-shot Learning with Memory-Augmented Neural Networks , 2016, ArXiv.

[5]  Alex Graves,et al.  Neural Turing Machines , 2014, ArXiv.

[6]  Mojtaba Bandarabadi,et al.  Epileptic seizure prediction using relative spectral power features , 2015, Clinical Neurophysiology.

[7]  Isa Conradsen,et al.  Automatic epileptic seizure onset detection using Matching Pursuit: A case study , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[8]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[9]  Lior Wolf,et al.  Unsupervised Cross-Domain Image Generation , 2016, ICLR.

[10]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[11]  Yann LeCun,et al.  Deep multi-scale video prediction beyond mean square error , 2015, ICLR.

[12]  Gabriel Kreiman,et al.  Unsupervised Learning of Visual Structure using Predictive Generative Networks , 2015, ArXiv.

[13]  G. Lightbody,et al.  EEG-based neonatal seizure detection with Support Vector Machines , 2011, Clinical Neurophysiology.

[14]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Theoden Netoff,et al.  Seizure prediction using cost-sensitive support vector machine , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Jürgen Schmidhuber,et al.  Highway Networks , 2015, ArXiv.

[17]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[18]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[19]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[20]  C. M. Lim,et al.  Automatic identification of epileptic electroencephalography signals using higher-order spectra , 2009, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[21]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  U. Rajendra Acharya,et al.  Automatic Detection of Epileptic EEG Signals Using Higher Order cumulant Features , 2011, Int. J. Neural Syst..

[24]  Phil Blunsom,et al.  Reasoning about Entailment with Neural Attention , 2015, ICLR.

[25]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[26]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[27]  Yoshua Bengio,et al.  Memory Augmented Neural Networks with Wormhole Connections , 2017, ArXiv.

[28]  Lukasz Kaiser,et al.  Neural GPUs Learn Algorithms , 2015, ICLR.

[29]  Koray Kavukcuoglu,et al.  Pixel Recurrent Neural Networks , 2016, ICML.

[30]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[31]  Timothy G. Constandinou,et al.  Ngram-Derived Pattern Recognition for the Detection and Prediction of Epileptic Seizures , 2014, PloS one.

[32]  Brian Litt,et al.  Flexible, Foldable, Actively Multiplexed, High-Density Electrode Array for Mapping Brain Activity in vivo , 2011, Nature Neuroscience.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Philip Bachman,et al.  Natural Language Comprehension with the EpiReader , 2016, EMNLP.

[35]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[36]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[37]  Yann LeCun,et al.  Energy-based Generative Adversarial Network , 2016, ICLR.

[38]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.