Spectral Entropy Can Predict Changes of Working Memory Performance Reduced by Short-Time Training in the Delayed-Match-to-Sample Task

Spectral entropy, which was generated by applying the Shannon entropy concept to the power distribution of the Fourier-transformed electroencephalograph (EEG), was utilized to measure the uniformity of power spectral density underlying EEG when subjects performed the working memory tasks twice, i.e., before and after training. According to Signed Residual Time (SRT) scores based on response speed and accuracy trade-off, 20 subjects were divided into two groups, namely high-performance and low-performance groups, to undertake working memory (WM) tasks. We found that spectral entropy derived from the retention period of WM on channel FC4 exhibited a high correlation with SRT scores. To this end, spectral entropy was used in support vector machine classifier with linear kernel to differentiate these two groups. Receiver operating characteristics analysis and leave-one out cross-validation (LOOCV) demonstrated that the averaged classification accuracy (CA) was 90.0 and 92.5% for intra-session and inter-session, respectively, indicating that spectral entropy could be used to distinguish these two different WM performance groups successfully. Furthermore, the support vector regression prediction model with radial basis function kernel and the root-mean-square error of prediction revealed that spectral entropy could be utilized to predict SRT scores on individual WM performance. After testing the changes in SRT scores and spectral entropy for each subject by short-time training, we found that 16 in 20 subjects’ SRT scores were clearly promoted after training and 15 in 20 subjects’ SRT scores showed consistent changes with spectral entropy before and after training. The findings revealed that spectral entropy could be a promising indicator to predict individual’s WM changes by training and further provide a novel application about WM for brain–computer interfaces.

[1]  Christian Mühl,et al.  Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction , 2013, PhyCS.

[2]  H. Davis,et al.  Age-related change in neural processing of time-dependent stimulus features. , 2005, Brain research. Cognitive brain research.

[3]  Nitish Thakor,et al.  Cognitive Workload Assessment Based on the Tensorial Treatment of EEG Estimates of Cross-Frequency Phase Interactions , 2014, Annals of Biomedical Engineering.

[4]  Tanja Schultz,et al.  Utterance selection for speech acts in a cognitive tourguide scenario , 2010, INTERSPEECH.

[5]  Dirk Heylen,et al.  Affective brain-computer interfaces: neuroscientific approaches to affect detection , 2015 .

[6]  Xiao Hu,et al.  Improved wavelet entropy calculation with window functions and its preliminary application to study intracranial pressure , 2013, Comput. Biol. Medicine.

[7]  Thomas D. Gauthier,et al.  Detecting Trends Using Spearman's Rank Correlation Coefficient , 2001 .

[8]  François-Benoît Vialatte,et al.  A cognitive brain-computer interface prototype for the continuous monitoring of visual working memory load , 2015, 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP).

[9]  Scott E. Kerick,et al.  Evolution of cerebral cortico-cortical communication during visuomotor adaptation to a cognitive-motor executive challenge , 2015, Biological Psychology.

[10]  Usama S. Ali,et al.  A comparison of item response models for accuracy and speed of item responses with applications to adaptive testing , 2017, The British journal of mathematical and statistical psychology.

[11]  Huan Nai-Jen,et al.  Classification of mental tasks using fixed and adaptive autoregressive models of EEG signals , 2005, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Tanja Schultz,et al.  Hybrid fNIRS-EEG based classification of auditory and visual perception processes , 2014, Front. Neurosci..

[13]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[14]  Geoffrey R. John,et al.  Prediction of Tanzanian Energy Demand using Support Vector Machine for Regression (SVR) , 2015 .

[15]  W. Klimesch,et al.  Upper alpha ERD and absolute power: their meaning for memory performance. , 2006, Progress in brain research.

[16]  Nigel H. Lovell,et al.  Estimating cognitive workload using wavelet entropy-based features during an arithmetic task , 2013, Comput. Biol. Medicine.

[17]  Siti Nurul Khotimah,et al.  Spectral and brain mapping analysis of EEG based on Pwelch in schizophrenic patients , 2016 .

[18]  C. Stam,et al.  Working Memory in Schizophrenia: An EEG Study Using Power Spectrum and Coherence Analysis to Estimate Cortical Activation and Network Behavior , 2008, Brain Topography.

[19]  Julian Elliott,et al.  Working Memory Deficits can be Overcome: Impacts of Training and Medication on Working Memory in Children with ADHD , 2010 .

[20]  Volkmar Weiss,et al.  The relationship between short-term memory capacity and EEG power spectral density , 2004, Biological Cybernetics.

[21]  José del R. Millán,et al.  Simultaneous Real-Time Detection of Motor Imagery and Error-Related Potentials for Improved BCI Accuracy , 2008 .

[22]  R. Sudirman,et al.  PERFORMANCE PREDICTION OF WORKING MEMORY RETENTION USING EVENT-RELATED POTENTIAL SIGNAL TOWARDS CHILDREN , 2016 .

[23]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[24]  Dezhong Yao,et al.  Why do we need to use a zero reference? Reference influences on the ERPs of audiovisual effects. , 2013, Psychophysiology.

[25]  Yingjie Tian,et al.  Support Vector Regression and Time Series Analysis for the Forecasting of Bayannur's Total Water Requirement , 2014, ITQM.

[26]  J. Bruhn,et al.  Shannon Entropy Applied to the Measurement of the Electroencephalographic Effects of Desflurane , 2001, Anesthesiology.

[27]  P. Sajda,et al.  Response error correction-a demonstration of improved human-machine performance using real-time EEG monitoring , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Bruce G. Pollock,et al.  Prediction of working memory performance in schizophrenia by plasma ratio of clozapine to N-desmethylclozapine. , 2015, The American journal of psychiatry.

[29]  R. Palaniappan,et al.  Classification of Mental Tasks Using Fixed and Adaptive Autoregressive Models of EEG Signals , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[30]  A. Prasad Vinod,et al.  A Comparative Study on the Effect of Audio and Visual Stimuli for Enhancing Attention and Memory in Brain Computer Interface System , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[31]  T. Klingberg,et al.  Increased prefrontal and parietal activity after training of working memory , 2004, Nature Neuroscience.

[32]  A. Baddeley.  Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[33]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[34]  G. Maris,et al.  Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy , 2012 .

[35]  Anton Nijholt,et al.  Emotional brain-computer interfaces , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[36]  A. Baddeley.  Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[37]  Christian Mühl,et al.  Connecting Brains and Bodies: Applying Physiological Computing to Support Social Interaction , 2015, Interact. Comput..

[38]  T. Klingberg.  Training and plasticity of working memory , 2010, Trends in Cognitive Sciences.

[39]  Alan D. Baddeley,et al.  Developments in the concept of working memory. , 1994 .

[40]  H. Forssberg,et al.  Changes in Cortical Dopamine D1 Receptor Binding Associated with Cognitive Training , 2009, NeuroImage.

[41]  Francisco Herrera,et al.  A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[42]  D. Farina,et al.  Multi-channel intramuscular and surface EMG decomposition by convolutive blind source separation , 2016, Journal of neural engineering.

[43]  H. Forssberg,et al.  Computerized training of working memory in children with ADHD--a randomized, controlled trial. , 2005, Journal of the American Academy of Child and Adolescent Psychiatry.

[44]  J. Palva,et al.  Neuronal synchrony reveals working memory networks and predicts individual memory capacity , 2010, Proceedings of the National Academy of Sciences.

[45]  Ron Kohavi,et al.  The Case against Accuracy Estimation for Comparing Induction Algorithms , 1998, ICML.

[46]  Gerard J. P. Van Breukelen,et al.  Psychometric Modeling of response speed and accuracy with mixed and conditional regression , 2005 .

[47]  Rui Zhang,et al.  Predicting Inter-session Performance of SMR-Based Brain–Computer Interface Using the Spectral Entropy of Resting-State EEG , 2015, Brain Topography.

[48]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[49]  John C. Schmitt,et al.  Empirical approaches to information processing: Speed-accuracy tradeoff functions or reaction time , 1977 .

[50]  Deanna M. Barch,et al.  When less is more: TPJ and default network deactivation during encoding predicts working memory performance , 2010, NeuroImage.

[51]  Tanja Schultz,et al.  Increased gamma band power during movement planning coincides with motor memory retrieval , 2016, NeuroImage.

[52]  A. Nobre,et al.  Oscillatory Brain State Predicts Variability in Working Memory , 2014, The Journal of Neuroscience.

[53]  Ludwig Kappos,et al.  Working memory training in patients with multiple sclerosis - comparison of two different training schedules. , 2009, Restorative neurology and neuroscience.

[54]  A. Nijholt,et al.  A survey of affective brain computer interfaces: principles, state-of-the-art, and challenges , 2014 .

[55]  Hugo Vereecke,et al.  Spectral Entropy as an Electroencephalographic Measure of Anesthetic Drug Effect: A Comparison with Bispectral Index and Processed Midlatency Auditory Evoked Response , 2004, Anesthesiology.

[56]  J. Bruhn,et al.  Approximate Entropy as an Electroencephalographic Measure of Anesthetic Drug Effect during Desflurane Anesthesia , 2000, Anesthesiology.

[57]  Thomas D. Gautheir.  Detecting Trends Using Spearman's Rank Correlation Coefficient , 2001 .

[58]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[59]  D. Yao,et al.  A method to standardize a reference of scalp EEG recordings to a point at infinity , 2001, Physiological measurement.

[60]  P. Sedgwick.  Spearman’s rank correlation coefficient , 2018, British Medical Journal.

[61]  Jinbo Bi,et al.  Machine learning identification of EEG features predicting working memory performance in schizophrenia and healthy adults , 2016, Neuropsychiatric electrophysiology.

[62]  Aki Vehtari,et al.  Erratum to: Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2017, Stat. Comput..

[63]  Charles X. Ling,et al.  Using AUC and accuracy in evaluating learning algorithms , 2005, IEEE Transactions on Knowledge and Data Engineering.

[64]  A. Nobre,et al.  Top-down modulation: bridging selective attention and working memory , 2012, Trends in Cognitive Sciences.

[65]  Atsuo Murata,et al.  An Attempt to Evaluate Mental Workload Using Wavelet Transform of EEG , 2005, Hum. Factors.

[66]  Luca T. Mainardi,et al.  Online Detection of P300 and Error Potentials in a BCI Speller , 2010, Comput. Intell. Neurosci..

[67]  H E Egeth,et al.  Response time and accuracy revisited: converging support for the interactive race model. , 1993, Journal of experimental psychology. Human perception and performance.