Vowel Imagery Decoding toward Silent Speech BCI Using Extreme Learning Machine with Electroencephalogram

The purpose of this study is to classify EEG data on imagined speech in a single trial. We recorded EEG data while five subjects imagined different vowels, /a/, /e/, /i/, /o/, and /u/. We divided each single trial dataset into thirty segments and extracted features (mean, variance, standard deviation, and skewness) from all segments. To reduce the dimension of the feature vector, we applied a feature selection algorithm based on the sparse regression model. These features were classified using a support vector machine with a radial basis function kernel, an extreme learning machine, and two variants of an extreme learning machine with different kernels. Because each single trial consisted of thirty segments, our algorithm decided the label of the single trial by selecting the most frequent output among the outputs of the thirty segments. As a result, we observed that the extreme learning machine and its variants achieved better classification rates than the support vector machine with a radial basis function kernel and linear discrimination analysis. Thus, our results suggested that EEG responses to imagined speech could be successfully classified in a single trial using an extreme learning machine with a radial basis function and linear kernel. This study with classification of imagined speech might contribute to the development of silent speech BCI systems.

[1]  Makoto Sato,et al.  Single-trial classification of vowel speech imagery using common spatial patterns , 2009, Neural Networks.

[2]  Minkyu Ahn,et al.  Journal of Neuroscience Methods , 2015 .

[3]  Tanja Schultz,et al.  Automatic Speech Recognition from Neural Signals: A Focused Review , 2016, Front. Neurosci..

[4]  Chang-Hwan Im,et al.  EEG-Based Brain-Computer Interfaces: A Thorough Literature Survey , 2013, Int. J. Hum. Comput. Interact..

[5]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[6]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[7]  G. Pfurtscheller,et al.  Motor imagery and action observation: Modulation of sensorimotor brain rhythms during mental control of a brain–computer interface , 2009, Clinical Neurophysiology.

[8]  Bao-Liang Lu,et al.  EEG-based vigilance estimation using extreme learning machines , 2013, Neurocomputing.

[9]  Mahyar Hamedi,et al.  Electroencephalographic Motor Imagery Brain Connectivity Analysis for BCI: A Review , 2016, Neural Computation.

[10]  N. Birbaumer,et al.  Brain–computer interfaces for communication and rehabilitation , 2016, Nature Reviews Neurology.

[11]  Wei Cheng,et al.  EEG classification for motor imagery and resting state in BCI applications using multi-class Adaboost extreme learning machine. , 2016, The Review of scientific instruments.

[12]  Omar Farooq,et al.  Vowel classification using wavelet decomposition during speech imagery , 2016, 2016 3rd International Conference on Signal Processing and Integrated Networks (SPIN).

[13]  Luciano Boquete,et al.  EOG-based eye movements codification for human computer interaction , 2012, Expert Syst. Appl..

[14]  Yi Su,et al.  A semi-automatic approach to the segmentation of liver parenchyma from 3D CT images with Extreme Learning Machine , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Frank H. Guenther,et al.  Brain-computer interfaces for speech communication , 2010, Speech Commun..

[16]  Boreom Lee,et al.  EEG classification in a single-trial basis for vowel speech perception using multivariate empirical mode decomposition , 2014, Journal of neural engineering.

[17]  Narasimhan Sundararajan,et al.  Classification of Mental Tasks from Eeg Signals Using Extreme Learning Machine , 2006, Int. J. Neural Syst..

[18]  Itzhak Fried,et al.  Decoding speech perception from single cell activity in humans , 2015, NeuroImage.

[19]  Yong Peng,et al.  Discriminative manifold extreme learning machine and applications to image and EEG signal classification , 2016, Neurocomputing.

[20]  Han-Jeong Hwang,et al.  Neurofeedback-based motor imagery training for brain–computer interface (BCI) , 2009, Journal of Neuroscience Methods.

[21]  M. Arthanari,et al.  Classification of electrocardiogram signals with support vector machines and extreme learning machine , 2011, Neural Computing and Applications.

[22]  G. Schalk,et al.  Silent Communication: Toward Using Brain Signals , 2012, IEEE Pulse.

[23]  José del R. Millán,et al.  Word pair classification during imagined speech using direct brain recordings , 2016 .

[24]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[25]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[26]  G. Schalk,et al.  Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans , 2011, Journal of neural engineering.

[27]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[28]  Kwangsoo Shin,et al.  Robust algorithm for arrhythmia classification in ECG using extreme learning machine , 2009, Biomedical engineering online.

[29]  Fanglin Chen,et al.  A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm , 2013, Journal of neural engineering.

[30]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[31]  Michael H Kohrman,et al.  ECoG gamma activity during a language task: differentiating expressive and receptive speech areas. , 2008, Brain : a journal of neurology.

[32]  Snehanshu Saha,et al.  A Communication Paradigm Using Subvocalized Speech: Translating Brain Signals into Speech , 2016, Augmented Human Research.

[33]  Hang Joon Jo,et al.  Multiclass Classification for the Differential Diagnosis on the ADHD Subtypes Using Recursive Feature Elimination and Hierarchical Extreme Learning Machine: Structural MRI Study , 2016, PloS one.

[34]  Amir Ali Khan,et al.  Inter comparison of classification techniques for vowel speech imagery using EEG sensors , 2014, The 2014 2nd International Conference on Systems and Informatics (ICSAI 2014).

[35]  Peter L. Bartlett,et al.  The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network , 1998, IEEE Trans. Inf. Theory.

[36]  Zhiping Lin,et al.  Composite function wavelet neural networks with extreme learning machine , 2010, Neurocomputing.

[37]  Siyi Deng,et al.  EEG classification of imagined syllable rhythm using Hilbert spectrum methods , 2010, Journal of neural engineering.

[38]  Jiaxiang Zhang,et al.  Automatic recognition of epileptic EEG patterns via Extreme Learning Machine and multiresolution feature extraction , 2013, Expert Syst. Appl..

[39]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[40]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[41]  B. V. K. Vijaya Kumar,et al.  Imagined Speech Classification with EEG Signals for Silent Communication: A Preliminary Investigation into Synthetic Telepathy , 2010, 2010 4th International Conference on Bioinformatics and Biomedical Engineering.

[42]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[43]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[44]  Weidong Zhou,et al.  Epileptic EEG classification based on extreme learning machine and nonlinear features , 2011, Epilepsy Research.

[45]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Brian N. Pasley,et al.  Decoding spectrotemporal features of overt and covert speech from the human cortex , 2014, Front. Neuroeng..

[47]  Dean J. Krusienski,et al.  Progress in speech decoding from the electrocorticogram , 2015 .