A Deep Evolutionary Approach to Bioinspired Classifier Optimisation for Brain-Machine Interaction

This study suggests a new approach to EEG data classification by exploring the idea of using evolutionary computation to both select useful discriminative EEG features and optimise the topology of Artificial Neural Networks. An evolutionary algorithm is applied to select the most informative features from an initial set of 2550 EEG statistical features. Optimisation of a Multilayer Perceptron (MLP) is performed with an evolutionary approach before classification to estimate the best hyperparameters of the network. Deep learning and tuning with Long Short-Term Memory (LSTM) are also explored, and Adaptive Boosting of the two types of models is tested for each problem. Three experiments are provided for comparison using different classifiers: one for attention state classification, one for emotional sentiment classification, and a third experiment in which the goal is to guess the number a subject is thinking of. The obtained results show that an Adaptive Boosted LSTM can achieve an accuracy of 84.44%, 97.06%, and 9.94% on the attentional, emotional, and number datasets, respectively. An evolutionary-optimised MLP achieves results close to the Adaptive Boosted LSTM for the two first experiments and significantly higher for the number-guessing experiment with an Adaptive Boosted DEvo MLP reaching 31.35%, while being significantly quicker to train and classify. In particular, the accuracy of the nonboosted DEvo MLP was of 79.81%, 96.11%, and 27.07% in the same benchmarks. Two datasets for the experiments were gathered using a Muse EEG headband with four electrodes corresponding to TP9, AF7, AF8, and TP10 locations of the international EEG placement standard. The EEG MindBigData digits dataset was gathered from the TP9, FP1, FP2, and TP10 locations.

[1]  Dimitrios I. Fotiadis,et al.  Epileptic Seizure Detection in EEGs Using Time–Frequency Analysis , 2009, IEEE Transactions on Information Technology in Biomedicine.

[2]  Sandeep Mittal,et al.  Invasive electroencephalography monitoring: Indications and presurgical planning , 2014, Annals of Indian Academy of Neurology.

[3]  Vinit Suri,et al.  An unusual cause of ischemic stroke - Cerebral air embolism , 2014, Annals of Indian Academy of Neurology.

[4]  D. E. Knuth,et al.  Postscript about NP-hard problems , 1974, SIGA.

[5]  R T Knight,et al.  A dry electrode for EEG recording. , 1994, Electroencephalography and clinical neurophysiology.

[6]  A. Aarabi,et al.  A multistage knowledge-based system for EEG seizure detection in newborn infants , 2007, Clinical Neurophysiology.

[7]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[8]  Anikó Ekárt,et al.  High Resolution Sentiment Analysis by Ensemble Classification , 2019, Advances in Intelligent Systems and Computing.

[9]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[10]  S. Jangid,et al.  Evolutionary Algorithms: A Critical Review and its Future Prospects , 2019 .

[11]  Cristiano Premebida,et al.  Applying probabilistic Mixture Models to semantic place classification in mobile robotics , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Kirsi-Marja Rytkönen,et al.  Automated sleep scoring in rats and mice using the naive Bayes classifier , 2011, Journal of Neuroscience Methods.

[13]  W. David Hairston,et al.  Effects of Cable Sway, Electrode Surface Area, and Electrode Mass on Electroencephalography Signal Quality during Motion , 2018, Sensors.

[14]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[15]  H. Lövheim A new three-dimensional model for emotions and monoamine neurotransmitters. , 2012, Medical hypotheses.

[16]  Nuno Lourenço,et al.  DENSER: deep evolutionary network structured representation , 2018, Genetic Programming and Evolvable Machines.

[17]  Cuntai Guan,et al.  Clinical study of neurorehabilitation in stroke using EEG-based motor imagery brain-computer interface with robotic feedback , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[18]  Tan Ching Seong,et al.  Classification of Human Emotions from EEG Signals using Statistical Features and Neural Network , 2009 .

[19]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[20]  Cristiano Premebida,et al.  Dynamic Bayesian network for semantic place classification in mobile robotics , 2017, Auton. Robots.

[21]  K. Jordan,et al.  Emergency EEG and Continuous EEG Monitoring in Acute Ischemic Stroke , 2004, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[22]  Yong Peng,et al.  Discriminative extreme learning machine with supervised sparsity preserving for image classification , 2017, Neurocomputing.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  E. John,et al.  Electroencephalography: Basic Principles and Applications , 2001 .

[25]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[26]  Daniel P Ferris,et al.  Induction and separation of motion artifacts in EEG data using a mobile phantom head device , 2016, Journal of neural engineering.

[27]  Jordan J. Bird,et al.  Mental Emotional Sentiment Classification with an EEG-based Brain-machine Interface , 2018 .

[28]  Ahmad Lotfi,et al.  Anomaly Detection in Activities of Daily Living Using One-Class Support Vector Machine , 2018, UKCI.

[29]  Fillia Makedon,et al.  Brain-EE: Brain Enjoyment Evaluation using Commercial EEG Headband , 2016, PETRA.

[30]  Cristiano Premebida,et al.  Affective facial expressions recognition for human-robot interaction , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[31]  Anikó Ekárt,et al.  Evolutionary Optimisation of Fully Connected Artificial Neural Network Topology , 2019 .

[32]  Stephan Kratzer,et al.  Propofol and Sevoflurane Differentially Modulate Cortical Depolarization following Electric Stimulation of the Ventrobasal Thalamus , 2017, Front. Comput. Neurosci..

[33]  C. Loan Computational Frameworks for the Fast Fourier Transform , 1992 .

[34]  Chad C. Williams,et al.  Choosing MUSE: Validation of a Low-Cost, Portable EEG System for ERP Research , 2017, Front. Neurosci..

[35]  Caroline S. Langensiepen,et al.  A multi-level refinement approach towards the classification of quotidian activities using accelerometer data , 2019, J. Ambient Intell. Humaniz. Comput..

[36]  John Gruzelier,et al.  A theory of alpha/theta neurofeedback, creative performance enhancement, long distance functional connectivity and psychological integration , 2009, Cognitive Processing.

[37]  Anikó Ekárt,et al.  A Study on Mental State Classification using EEG-based Brain-Machine Interface , 2018, 2018 International Conference on Intelligent Systems (IS).

[38]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[39]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[40]  Oksana Zayachkivska,et al.  Adolf Beck: A Forgotten Pioneer in Electroencephalography , 2014, Journal of the history of the neurosciences.

[41]  Jordan J. Bird,et al.  A Study on CNN Transfer Learning for Image Classification , 2018, UKCI.

[42]  P. R. Davidson,et al.  Detecting Behavioral Microsleeps using EEG and LSTM Recurrent Neural Networks , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[43]  Natheer Khasawneh,et al.  Automated sleep stage identification system based on time-frequency analysis of a single EEG channel and random forest classifier , 2012, Comput. Methods Programs Biomed..

[44]  Ahmad Lotfi,et al.  Human Activities Transfer Learning for Assistive Robotics , 2017, UKCI.

[45]  Alessandro De Gloria,et al.  Exploiting Real-Time EEG Analysis for Assessing Flow in Games , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[46]  Valery Naranjo,et al.  EvoDeep: A new evolutionary approach for automatic Deep Neural Networks parametrisation , 2018, J. Parallel Distributed Comput..

[47]  Nicola Bellotto,et al.  Social activity recognition based on probabilistic merging of skeleton features with proximity priors from RGB-D data , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[48]  Yong Peng,et al.  EEG-based emotion classification using deep belief networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[49]  Jordan J. Bird,et al.  Learning from Interaction: An Intelligent Networked-Based Human-Bot and Bot-Bot Chatbot System , 2018, UKCI.

[50]  Yong Peng,et al.  Immune clonal algorithm based feature selection for epileptic EEG signal classification , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[51]  B E Swartz,et al.  The advantages of digital over analog recording techniques. , 1998, Electroencephalography and clinical neurophysiology.

[52]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[53]  Charles Darwin,et al.  On the origin of species, 1859 , 1988 .

[54]  T Hori,et al.  Statistical features of hypnagogic EEG measured by a new scoring system. , 1996, Sleep.

[55]  Tom Leonard,et al.  The Matrix-Logarithmic Covariance Model , 1996 .