Electroencephalogram (EEG) Based Imagined Speech Decoding and Recognition

1State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology Tianjin 300130, China 2Biomedical Engineering Department, University of Ilorin, P.M.B. 1515, Ilorin-Nigeria 3Electrical and Electronics Department, Taraba State University, Jalingo-Nigeria 4Electrical Engineering Department, Ahmadu Bello University, Zaria-Nigeria Electroencephalogram (EEG) Based Imagined Speech Decoding and Recognition

[1]  Tomás Ward,et al.  Artifact Removal in Physiological Signals—Practices and Possibilities , 2012, IEEE Transactions on Information Technology in Biomedicine.

[2]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[3]  Shrikanth Narayanan,et al.  An Empirical Study of Speech Processing in the Brain by Analyzing the Temporal Syllable Structure in Speech-input Induced EEG , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Norizam Sulaiman,et al.  Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review , 2020, Frontiers in Neurorobotics.

[5]  Iván E. Gareis,et al.  Open access database of EEG signals recorded during imagined speech , 2017, Symposium on Medical Information Processing and Analysis.

[6]  Jongin Kim,et al.  Vowel Imagery Decoding toward Silent Speech BCI Using Extreme Learning Machine with Electroencephalogram , 2016, BioMed research international.

[7]  Heidi Christensen,et al.  Discriminating Between Imagined Speech and Non-Speech Tasks Using EEG , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Sahar Moghimi,et al.  EEG signal classification of imagined speech based on Riemannian distance of correntropy spectral density , 2020, Biomed. Signal Process. Control..

[9]  Tom Chau,et al.  EEG Classification of Covert Speech Using Regularized Neural Networks , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[10]  Robert Bogue.  Brain-computer interfaces: control by thought , 2010, Ind. Robot.

[11]  Michael D'Zmura,et al.  Toward EEG Sensing of Imagined Speech , 2009, HCI.

[12]  Yu Zhang,et al.  Analysis and classification of speech imagery EEG for BCI , 2013, Biomed. Signal Process. Control..

[13]  Ahmad Taher Azar,et al.  Classification of EEG-Based Brain-Computer Interfaces , 2014, Advanced Intelligent Computational Technologies and Decision Support Systems.

[14]  Pramit Saha,et al.  Hierarchical Deep Feature Learning For Decoding Imagined Speech From EEG , 2019, AAAI.

[15]  Frank Rudzicz,et al.  Classifying phonological categories in imagined and articulated speech , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Diego A. Rojas,et al.  Recognition of Spanish Vowels through Imagined Speech by using Spectral Analysis and SVM , 2016, J. Inf. Hiding Multim. Signal Process..

[17]  S. Shenbaga Devi,et al.  Imagined Speech Classification using EEG , 2014 .

[18]  Boreom Lee,et al.  Multiclass Classification of Word Imagination Speech With Hybrid Connectivity Features , 2018, IEEE Transactions on Biomedical Engineering.

[19]  N. Ramsey,et al.  Fully Implanted Brain-Computer Interface in a Locked-In Patient with ALS. , 2016, The New England journal of medicine.

[20]  Omar Farooq,et al.  EEG based vowel classification during speech imagery , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[21]  Kendrick N Kay,et al.  I can see what you see , 2009, Nature Neuroscience.

[22]  Jerrin Thomas Panachakel,et al.  A Novel Deep Learning Architecture for Decoding Imagined Speech from EEG , 2020, ArXiv.

[23]  Jonathan Berger,et al.  Natural music evokes correlated EEG responses reflecting temporal structure and beat , 2020, NeuroImage.

[24]  S. Shamma,et al.  Musical expertise enhances the cortical tracking of the acoustic envelope during naturalistic music listening , 2020, Acoustical Science and Technology.

[25]  Rabab K Ward,et al.  A survey of signal processing algorithms in brain–computer interfaces based on electrical brain signals , 2007, Journal of neural engineering.

[26]  Lingli Yu,et al.  Applying Extreme Learning Machine to classification of EEG BCI , 2016, 2016 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[27]  Mariko Matsumoto,et al.  Silent speech decoder using adaptive collection , 2014, IUI Companion '14.

[28]  Francis R. Willett,et al.  Restoration of reaching and grasping in a person with tetraplegia through brain-controlled muscle stimulation: a proof-of-concept demonstration , 2017, The Lancet.

[29]  Amir Rastegarnia,et al.  Methods for artifact detection and removal from scalp EEG: A review , 2016, Neurophysiologie Clinique/Clinical Neurophysiology.

[30]  Yusuf Uzzaman Khan,et al.  EEG based classification of imagined vowel sounds , 2015, 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom).

[31]  R. Palaniappan,et al.  Utilizing Gamma Band to Improve Mental Task Based Brain-Computer Interface Design , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Edward F. Chang,et al.  Speech synthesis from neural decoding of spoken sentences , 2019, Nature.

[33]  G. Ojemann.  Cortical organization of language , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Raffaella Folli,et al.  Optimizing Layers Improves CNN Generalization and Transfer Learning for Imagined Speech Decoding from EEG , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[35]  Gerwin Schalk,et al.  Temporal evolution of gamma activity in human cortex during an overt and covert word repetition task , 2012, Front. Hum. Neurosci..

[36]  M S Treder,et al.  Decoding auditory attention to instruments in polyphonic music using single-trial EEG classification , 2014, Journal of neural engineering.

[37]  Naveed Muhammad,et al.  Classification of Vowels from Imagined Speech with Convolutional Neural Networks , 2020, Comput..

[38]  Tom Francart,et al.  An Interpretable Performance Metric for Auditory Attention Decoding Algorithms in a Context of Neuro-Steered Gain Control , 2019, bioRxiv.

[39]  Jonathan Berger,et al.  Natural music evokes correlated EEG responses reflecting temporal structure and beat , 2019, NeuroImage.

[40]  Dean J. Krusienski,et al.  Generating Natural, Intelligible Speech From Brain Activity in Motor, Premotor, and Inferior Frontal Cortices , 2019, Front. Neurosci..

[41]  Joseph G. Makin,et al.  Real-time decoding of question-and-answer speech dialogue using human cortical activity , 2019, Nature Communications.

[42]  B. V. K. Vijaya Kumar,et al.  Subject identification from electroencephalogram (EEG) signals during imagined speech , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[43]  Tanja Schultz,et al.  EEG-based Speech Recognition - Impact of Temporal Effects , 2009, BIOSIGNALS.

[44]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[45]  Hema A Murthy,et al.  Comparison of Feature-Model Variants for coSpeech-EEG Classification , 2020, 2020 National Conference on Communications (NCC).

[46]  Shrikanth S. Narayanan,et al.  Neural Speech Decoding During Audition, Imagination and Production , 2020, IEEE Access.

[47]  Jack L. Gallant,et al.  Encoding and decoding in fMRI , 2011, NeuroImage.

[48]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[49]  Luis Villaseñor Pineda,et al.  Subjects identification using EEG-recorded imagined speech , 2019, Expert Syst. Appl..

[50]  G. Thierry,et al.  Renewal of the neurophysiology of language: functional neuroimaging. , 2005, Physiological reviews.

[51]  Omar Farooq,et al.  Vowel classification using wavelet decomposition during speech imagery , 2016, 2016 3rd International Conference on Signal Processing and Integrated Networks (SPIN).

[52]  Francis R. Willett,et al.  High performance communication by people with paralysis using an intracortical brain-computer interface , 2017, eLife.

[53]  Mustaqeem,et al.  CLSTM: Deep Feature-Based Speech Emotion Recognition Using the Hierarchical ConvLSTM Network , 2020 .

[54]  Stefan Oniga,et al.  A Review of Processing Methods and Classification Algorithm for EEG Signal , 2020 .

[55]  G. Hickok.  Computational neuroanatomy of speech production , 2012, Nature Reviews Neuroscience.

[56]  Debadatta Dash,et al.  Decoding Imagined and Spoken Phrases From Non-invasive Neural (MEG) Signals , 2020, Frontiers in Neuroscience.

[57]  Bernd T. Meyer,et al.  Neuro-Steered Hearing Devices: Decoding Auditory Attention From the Brain , 2020 .

[58]  Gaël Richard,et al.  EEG-Based Decoding of Auditory Attention to a Target Instrument in Polyphonic Music , 2019, 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA).

[59]  Snehanshu Saha,et al.  A Communication Paradigm Using Subvocalized Speech: Translating Brain Signals into Speech , 2016, Augmented Human Research.

[60]  Aparajita Haldar,et al.  EEG-based classification of bilingual unspoken speech using ANN , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[61]  Francisco Sepulveda,et al.  Classifying speech related vs. idle state towards onset detection in brain-computer interfaces overt, inhibited overt, and covert speech sound production vs. idle state , 2014, 2014 IEEE Biomedical Circuits and Systems Conference (BioCAS) Proceedings.

[62]  Siyi Deng,et al.  EEG classification of imagined syllable rhythm using Hilbert spectrum methods , 2010, Journal of neural engineering.

[63]  Damien Coyle,et al.  Classification of imagined spoken Word-Pairs using Convolutional Neural Networks , 2019, GBCIC.

[64]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[65]  B. V. K. Vijaya Kumar,et al.  Imagined Speech Classification with EEG Signals for Silent Communication: A Preliminary Investigation into Synthetic Telepathy , 2010, 2010 4th International Conference on Bioinformatics and Biomedical Engineering.

[66]  Tiago H. Falk,et al.  Deep learning-based electroencephalography analysis: a systematic review , 2019, Journal of neural engineering.

[67]  Makoto Sato,et al.  Single-trial classification of vowel speech imagery using common spatial patterns , 2009, Neural Networks.

[68]  Makoto Sato,et al.  Spatial filtering and single-trial classification of EEG during vowel speech imagery , 2009, i-CREATe.

[69]  Michael D'Zmura,et al.  EEG-Based Discrimination of Imagined Speech Phonemes , 2011 .