Speech Recognition using EEG signals recorded using dry electrodes

In this paper, we demonstrate speech recognition using electroencephalography (EEG) signals obtained using dry electrodes on a limited English vocabulary consisting of three vowels and one word using a deep learning model. We demonstrate a test accuracy of 79.07 percent on a subset vocabulary consisting of two English vowels. Our results demonstrate the feasibility of using EEG signals recorded using dry electrodes for performing the task of speech recognition.

[1]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[2]  Boreom Lee,et al.  EEG classification in a single-trial basis for vowel speech perception using multivariate empirical mode decomposition , 2014, Journal of neural engineering.

[3]  Ahmed Tewfik,et al.  Advancing Speech Recognition With No Speech Or With Noisy Speech , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[4]  Yasuharu Koike,et al.  Decoding of Covert Vowel Articulation Using Electroencephalography Cortical Currents , 2016, Front. Neurosci..

[5]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[6]  Debi Prosad Dogra,et al.  Envisioned speech recognition using EEG sensors , 2018, Personal and Ubiquitous Computing.

[7]  Ahmed H. Tewfik,et al.  Speech Recognition with No Speech or with Noisy Speech , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Yan Han,et al.  Improving EEG based Continuous Speech Recognition , 2019, ArXiv.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Jozef Juhár,et al.  Voice command recognition using EEG signals , 2017, 2017 International Symposium ELMAR.

[12]  Jun Qin,et al.  Neural networks based EEG-Speech Models , 2016, ArXiv.

[13]  Yan Han,et al.  Speech Synthesis Using EEG , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.