Classification of Post-COVID-19 Emotions with Residual-Based Separable Convolution Networks and EEG Signals

The COVID-19 epidemic has created highly unprocessed emotions that trigger stress, anxiety, or panic attacks. These attacks exhibit physical symptoms that may easily lead to misdiagnosis. Deep-learning (DL)-based classification approaches for emotion detection based on electroencephalography (EEG) signals are computationally costly. Nowadays, limiting memory potency, considerable training, and hyperparameter optimization are always needed for DL models. As a result, they are inappropriate for real-time applications, which require large computational resources to detect anxiety and stress through EEG signals. However, a two-dimensional residual separable convolution network (RCN) architecture can considerably enhance the efficiency of parameter use and calculation time. The primary aim of this study was to detect emotions in undergraduate students who had recently experienced COVID-19 by analyzing EEG signals. A novel separable convolution model that combines residual connection (RCN-L) and light gradient boosting machine (LightGBM) techniques was developed. To evaluate the performance, this paper used different statistical metrics. The RCN-L achieved an accuracy (ACC) of 0.9263, a sensitivity (SE) of 0.9246, a specificity (SP) of 0.9282, an F1-score of 0.9264, and an area under the curve (AUC) of 0.9263 when compared to other approaches. In the proposed RCN-L system, the network avoids the tedious detection and classification process for post-COVID-19 emotions while still achieving impressive network training performance and a significant reduction in learnable parameters. This paper also concludes that the emotions of students are highly impacted by COVID-19 scenarios.

[1]  Xiaowei Luo,et al.  Measuring and Computing Cognitive Statuses of Construction Workers Based on Electroencephalogram: A Critical Review , 2022, IEEE Transactions on Computational Social Systems.

[2]  S. Chitrakala,et al.  PTCERE: personality-trait mapping using cognitive-based emotion recognition from electroencephalogram signals , 2022, The Visual Computer.

[3]  T. Choi,et al.  Mining voices from self-expressed messages on social-media: Diagnostics of mental distress during COVID-19 , 2022, Decision Support Systems.

[4]  Nian Cai,et al.  A one-stage deep learning framework for automatic detection of safety harnesses in high-altitude operations , 2022, Signal, Image and Video Processing.

[5]  Di Wang,et al.  Corporate finance risk prediction based on LightGBM , 2022, Inf. Sci..

[6]  Ashutosh Kumar Singh,et al.  Learning DenseNet features from EEG based spectrograms for subject independent emotion recognition , 2022, Biomed. Signal Process. Control..

[7]  Enhai Liu,et al.  A real-time embedded drogue detection method based on lightweight convolution neural network for autonomous aerial refueling , 2022, Neural Computing and Applications.

[8]  J. Cha,et al.  Electroencephalographic alpha oscillation as first manifestation of brain restoration after resuscitation , 2022, Neurological Sciences.

[9]  T. Glasmachers,et al.  Enhancing the decoding accuracy of EEG signals by the introduction of anchored-STFT and adversarial data augmentation method , 2022, Scientific Reports.

[10]  Q. Abbas,et al.  Finger-vein presentation attack detection using depthwise separable convolution neural network , 2022, Expert Syst. Appl..

[11]  Wei Cheng,et al.  Combination predicting model of traffic congestion index in weekdays based on LightGBM-GRU , 2022, Scientific Reports.

[12]  Q. Abbas,et al.  Machine Learning Methods for Diagnosis of Eye-Related Diseases: A Systematic Review Study Based on Ophthalmic Imaging Modalities , 2022, Archives of Computational Methods in Engineering.

[13]  M. A. Abdou Literature review: efficient deep neural networks techniques for medical image analysis , 2022, Neural Computing and Applications.

[14]  Jie Zhang,et al.  EEG emotion recognition using multichannel weighted multiscale permutation entropy , 2022, Applied Intelligence.

[15]  R. Boostani,et al.  Continuous Scoring of Depression From EEG Signals via a Hybrid of Convolutional Neural Networks , 2022, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  J. Suri,et al.  Long-COVID diagnosis: From diagnostic to advanced AI-driven models , 2022, European Journal of Radiology.

[17]  Rakhi Chakraborty,et al.  A Deep Learning-Based Comparative Study to Track Mental Depression from EEG Data , 2022, Neuroscience Informatics.

[18]  Hatem Ibrahem,et al.  DTS-Net: Depth-to-Space Networks for Fast and Accurate Semantic Object Segmentation , 2022, Sensors.

[19]  Xingming Zhang,et al.  DS-CNN: A pre-trained Xception model based on depth-wise separable convolutional neural network for finger vein recognition , 2021, Expert Syst. Appl..

[20]  Ooi Chui Ping,et al.  Decision support system for major depression detection using spectrogram and convolution neural network with EEG signals , 2021, Expert Syst. J. Knowl. Eng..

[21]  Miguel A. Teruel,et al.  Diagnosis and prognosis of mental disorders by means of EEG and deep learning: a systematic mapping study , 2021, Artificial Intelligence Review.

[22]  A. Słowik,et al.  Metaheuristic Optimization Through Deep Learning Classification of燙OVID-19 in Chest X-Ray Images , 2022, Computers, Materials & Continua.

[23]  Licheng Jiao,et al.  A Lightweight Top-Down Multi-Person Pose Estimation Method Based on Symmetric Transformation and Global Matching , 2022, IEEE Access.

[24]  U. Tariq,et al.  IoT & AI Enabled Three-Phase Secure and Non-Invasive COVID 19 Diagnosis System , 2022, Computers, Materials & Continua.

[25]  Vibha Jain,et al.  Stacking Ensemble-Based Intelligent Machine Learning Model for Predicting Post-COVID-19 Complications , 2021, New Generation Computing.

[26]  Hafiz Husnain Raza Sherazi,et al.  Features of Mobile Apps for People with Autism in a Post COVID-19 Scenario: Current Status and Recommendations for Apps Using AI , 2021, Diagnostics.

[27]  Jung-Seok Choi,et al.  Identification of Major Psychiatric Disorders From Resting-State Electroencephalography Using a Machine Learning Approach , 2021, Frontiers in Psychiatry.

[28]  Miguel Angel Lopez-Gordo,et al.  EEG-based multi-level stress classification with and without smoothing filter , 2021, Biomed. Signal Process. Control..

[29]  N. Arunkumar,et al.  Automated ASD detection using hybrid deep lightweight features extracted from EEG signals , 2021, Comput. Biol. Medicine.

[30]  Ravi Subban,et al.  Computer aided decision support system for mitral valve diagnosis and classification using depthwise separable convolution neural network , 2021, Multimedia Tools and Applications.

[31]  Abdulkadir Sengur,et al.  Exploring Deep Learning Features for Automatic Classification of Human Emotion Using EEG Rhythms , 2020, IEEE Sensors Journal.

[32]  Dongxiao Gu,et al.  HFS‐LightGBM: A machine learning model based on hybrid feature selection for classifying ICU patient readmissions , 2020, Expert Syst. J. Knowl. Eng..

[33]  R. Thomas,et al.  COVID-19 and psychosis risk: Real or delusional concern? , 2020, Neuroscience Letters.

[34]  Vaishali M. Joshi,et al.  EEG based emotion detection using fourth order spectral moment and deep learning , 2021, Biomed. Signal Process. Control..

[35]  Md. Atiqur Rahman Ahad,et al.  Emotion Recognition From EEG Signal Focusing on Deep Learning and Shallow Learning Techniques , 2021, IEEE Access.

[36]  Pradeep Tomar,et al.  A LSTM based deep learning network for recognizing emotions using wireless brainwave driven system , 2021, Expert Syst. Appl..

[37]  Alex D. Leow,et al.  EEG Classification by Factoring in Sensor Spatial Configuration , 2021, IEEE Access.

[38]  Jassim M. Abdul-Jabbar,et al.  Deep learning for motor imagery EEG-based classification: A review , 2021, Biomed. Signal Process. Control..

[39]  Kongqiao Wang,et al.  EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network , 2020, Knowl. Based Syst..

[40]  Yu Song,et al.  EEG based emotion recognition using fusion feature extraction method , 2020, Multimedia Tools and Applications.

[41]  Jianhua Zhang,et al.  Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review , 2020, Inf. Fusion.

[42]  Atsunori Kanemura,et al.  Designing Lightweight Feature Descriptor Networks with Depthwise Separable Convolution , 2020, JSAI.

[43]  Erhan Ekmekcioglu,et al.  Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion , 2020, IEEE Access.

[44]  Logesh Ravi,et al.  A study on medical Internet of Things and Big Data in personalized healthcare system , 2018, Health Information Science and Systems.

[45]  Yang Wei,et al.  A real-time wearable emotion detection headband based on EEG measurement , 2017 .

[46]  Mahmoud I. Al-Kadi,et al.  Effectiveness of Wavelet Denoising on Electroencephalogram Signals , 2013 .

[47]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.