Identification of Auditory Object-Specific Attention from Single-Trial Electroencephalogram Signals via Entropy Measures and Machine Learning

Existing research has revealed that auditory attention can be tracked from ongoing electroencephalography (EEG) signals. The aim of this novel study was to investigate the identification of peoples’ attention to a specific auditory object from single-trial EEG signals via entropy measures and machine learning. Approximate entropy (ApEn), sample entropy (SampEn), composite multiscale entropy (CmpMSE) and fuzzy entropy (FuzzyEn) were used to extract the informative features of EEG signals under three kinds of auditory object-specific attention (Rest, Auditory Object1 Attention (AOA1) and Auditory Object2 Attention (AOA2)). The linear discriminant analysis and support vector machine (SVM), were used to construct two auditory attention classifiers. The statistical results of entropy measures indicated that there were significant differences in the values of ApEn, SampEn, CmpMSE and FuzzyEn between Rest, AOA1 and AOA2. For the SVM-based auditory attention classifier, the auditory object-specific attention of Rest, AOA1 and AOA2 could be identified from EEG signals using ApEn, SampEn, CmpMSE and FuzzyEn as features and the identification rates were significantly different from chance level. The optimal identification was achieved by the SVM-based auditory attention classifier using CmpMSE with the scale factor τ = 10. This study demonstrated a novel solution to identify the auditory object-specific attention from single-trial EEG signals without the need to access the auditory stimulus.

[1]  Zhendong Mu,et al.  Driver Fatigue Detection System Using Electroencephalography Signals Based on Combined Entropy Features , 2017 .

[2]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Murat Akçakaya,et al.  EEG-assisted modulation of sound sources in the auditory scene , 2016, Biomed. Signal Process. Control..

[5]  K. Cheng,et al.  Analysis of EEG entropy during visual evocation of emotion in schizophrenia , 2017, Annals of General Psychiatry.

[6]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[7]  Jonathan Z. Simon,et al.  Real-Time Tracking of Selective Auditory Attention From M/EEG: A Bayesian Filtering Approach , 2017, bioRxiv.

[8]  G. Schalk,et al.  Identifying the Attended Speaker Using Electrocorticographic (ECoG) Signals. , 2015, Brain computer interfaces.

[9]  M. Firoozabadi,et al.  Analysis of EEG Signals Related to Artists and Nonartists during Visual Perception, Mental Imagery, and Rest Using Approximate Entropy , 2014, BioMed research international.

[10]  Alessandro Presacco,et al.  Robust decoding of selective auditory attention from MEG in a competing-speaker environment via state-space modeling , 2016, NeuroImage.

[11]  Alexander Bertrand,et al.  Online detection of auditory attention with mobile EEG: closing the loop with neurofeedback , 2017, bioRxiv.

[12]  Jing Li,et al.  Using Permutation Entropy to Measure the Changes in EEG Signals During Absence Seizures , 2014, Entropy.

[13]  Stefan Debener,et al.  Identifying auditory attention with ear-EEG: cEEGrid versus high-density cap-EEG comparison , 2016, Journal of neural engineering.

[14]  G. Ouyang,et al.  Predictability analysis of absence seizures with permutation entropy , 2007, Epilepsy Research.

[15]  Chun-Chieh Wang,et al.  Time Series Analysis Using Composite Multiscale Entropy , 2013, Entropy.

[16]  Nsreen A. Alahmadi.  Classifying Children with Learning Disabilities on the Basis of Resting State EEG Measures Using a Linear Discriminant Analysis , 2015 .

[17]  Maarten De Vos,et al.  Decoding the attended speech stream with multi-channel EEG: implications for online, daily-life applications , 2015, Journal of neural engineering.

[18]  K. Badie,et al.  A Comparative Investigation of Wavelet Families for Analysis of EEG Signals Related to Artists and Nonartists During Visual Perception, Mental Imagery, and Rest , 2013 .

[19]  U. Rajendra Acharya,et al.  Author's Personal Copy Biomedical Signal Processing and Control Automated Diagnosis of Epileptic Eeg Using Entropies , 2022 .

[20]  Zhuo Chen,et al.  Neural decoding of attentional selection in multi-speaker environments without access to clean sources , 2017, Journal of neural engineering.

[21]  Lenny A. Varghese,et al.  Quantifying attentional modulation of auditory-evoked cortical responses from single-trial electroencephalography , 2013, Front. Hum. Neurosci..

[22]  T. Griffiths,et al.  What is an auditory object? , 2004, Nature Reviews Neuroscience.

[23]  A. Vannucci,et al.  BICS Bath Institute for Complex Systems A note on time-dependent DiPerna-Majda measures , 2008 .

[24]  Zhenhu Liang,et al.  Entropy Measures in Neural Signals , 2016 .

[25]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[26]  A. Gazzaley.  Influence of early attentional modulation on working memory , 2011, Neuropsychologia.

[27]  James P. Reilly,et al.  Machine learning based framework for EEG/ERP analysis , 2016 .

[28]  Eberhard F. Kochs,et al.  Non-stationarity of EEG during wakefulness and anaesthesia: advantages of EEG permutation entropy monitoring , 2014, Journal of Clinical Monitoring and Computing.

[29]  U. Rajendra Acharya,et al.  An Integrated Index for the Identification of Focal Electroencephalogram Signals Using Discrete Wavelet Transform and Entropy Measures , 2015, Entropy.

[30]  Dong Ming,et al.  Research on Visual Attention Classification Based on EEG Entropy Parameters , 2013 .

[31]  Maysam F. Abbod,et al.  Application of Multivariate Empirical Mode Decomposition and Sample Entropy in EEG Signals via Artificial Neural Networks for Interpreting Depth of Anesthesia , 2013, Entropy.

[32]  U. Rajendra Acharya,et al.  Application of Non-Linear and Wavelet Based Features for the Automated Identification of Epileptic EEG signals , 2012, Int. J. Neural Syst..

[33]  Mounya Elhilali,et al.  Modelling auditory attention , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  D. Abásolo,et al.  Entropy analysis of the EEG background activity in Alzheimer's disease patients , 2006, Physiological measurement.

[35]  U. Rajendra Acharya,et al.  Application of Entropy Measures on Intrinsic Mode Functions for the Automated Identification of Focal Electroencephalogram Signals , 2015, Entropy.

[36]  T. Picton,et al.  Human Cortical Responses to the Speech Envelope , 2008, Ear and hearing.

[37]  Kevin Noronha,et al.  Decision support system for the glaucoma using Gabor transformation , 2015, Biomed. Signal Process. Control..

[38]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[39]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[40]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[41]  Niels Wessel,et al.  Practical considerations of permutation entropy , 2013, The European Physical Journal Special Topics.

[42]  Wangxin Yu,et al.  Characterization of Surface EMG Signal Based on Fuzzy Entropy , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Karsten Keller,et al.  Ordinal Patterns, Entropy, and EEG , 2014, Entropy.

[44]  T. Fukami,et al.  QUANTIFICATION OF SUBJECT WAKEFULNESS STATE DURING ROUTINE EEG EXAMINATION , 2013 .

[45]  Francesco Carlo Morabito,et al.  SVM classification of epileptic EEG recordings through multiscale permutation entropy , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[46]  Yangsong Zhang,et al.  Z-Score Linear Discriminant Analysis for EEG Based Brain-Computer Interfaces , 2013, PloS one.

[47]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[48]  Haesun Park,et al.  A comparison of generalized linear discriminant analysis algorithms , 2008, Pattern Recognit..

[49]  Edmund C. Lalor,et al.  The Multivariate Temporal Response Function (mTRF) Toolbox: A MATLAB Toolbox for Relating Neural Signals to Continuous Stimuli , 2016, Front. Hum. Neurosci..

[50]  M. D'Zmura,et al.  Envelope responses in single-trial EEG indicate attended speaker in a ‘cocktail party’ , 2014, Journal of Neural Engineering.

[51]  Hung T. Nguyen,et al.  The detection of Freezing of Gait in Parkinson's disease patients using EEG signals based on Wavelet decomposition , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  S. A. Hosseini,et al.  Emotion recognition method using entropy analysis of EEG signals , 2011 .

[53]  John J. Foxe,et al.  Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG. , 2015, Cerebral cortex.

[54]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[55]  J. Gallant,et al.  Complete functional characterization of sensory neurons by system identification. , 2006, Annual review of neuroscience.