Fuzzy Integral Optimization with Deep Q-Network for EEG-Based Intention Recognition

Non-invasive brain-computer interface using electroencephalography (EEG) signals promises a convenient approach empowering humans to communicate with and even control the outside world only with intentions. Herein, we propose to analyze EEG signals using fuzzy integral with deep reinforcement learning optimization to aggregate two aspects of information contained within EEG signals, namely local spatio-temporal and global temporal information, and demonstrate its benefits in EEG-based human intention recognition tasks. The EEG signals are first transformed into a 3D format preserving both topological and temporal structures, followed by distinctive local spatio-temporal feature extraction by a 3D-CNN, as well as the global temporal feature extraction by an RNN. Next, a fuzzy integral with respect to the optimized fuzzy measures with deep reinforcement learning is utilized to integrate the two extracted information and makes a final decision. The proposed approach retains the topological and temporal structures of EEG signals and merges them in a more efficient way. Experiments on a public EEG-based movement intention dataset demonstrate the effectiveness and superior performance of our proposed method.

[1]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[2]  Mohammed Yeasin,et al.  Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks , 2015, ICLR.

[3]  Lina Yao,et al.  Multi-Person Brain Activity Recognition via Comprehensive EEG Signal Analysis , 2017, MobiQuitous.

[4]  S.B. Shouraki,et al.  Combination Of Multiple Classifiers With Fuzzy Integral Method for Classifying The EEG Signals in Brain-Computer Interface , 2006, 2006 International Conference on Biomedical and Pharmaceutical Engineering.

[5]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  G. J. Nair,et al.  Feature extraction and classification of EEG signals for mapping motor area of the brain , 2013, 2013 International Conference on Control Communication and Computing (ICCC).

[9]  Jong-Hwan Kim,et al.  Fuzzy Integral-Based Gaze Control of a Robotic Head for Human Robot Interaction , 2015, IEEE Transactions on Cybernetics.

[10]  Cuntai Guan,et al.  Shrinkage estimator based regularization for EEG motor imagery classification , 2015, 2015 10th International Conference on Information, Communications and Signal Processing (ICICS).

[11]  Jong-Hwan Kim,et al.  Fuzzy Integral-Based Gaze Control Architecture Incorporated With Modified-Univector Field-Based Navigation for Humanoid Robots , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[13]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[14]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Lucia Rita Quitadamo,et al.  A Fuzzy Integral Ensemble Method in Visual P300 Brain-Computer Interface , 2015, Comput. Intell. Neurosci..