Arousal and Valence Classification Model Based on Long Short-Term Memory and DEAP Data for Mental Healthcare Management

Objectives Both the valence and arousal components of affect are important considerations when managing mental healthcare because they are associated with affective and physiological responses. Research on arousal and valence analysis, which uses images, texts, and physiological signals that employ deep learning, is actively underway; research investigating how to improve the recognition rate is needed. The goal of this research was to design a deep learning framework and model to classify arousal and valence, indicating positive and negative degrees of emotion as high or low. Methods The proposed arousal and valence classification model to analyze the affective state was tested using data from 40 channels provided by a dataset for emotion analysis using electrocardiography (EEG), physiological, and video signals (the DEAP dataset). Experiments were based on 10 selected featured central and peripheral nervous system data points, using long short-term memory (LSTM) as a deep learning method. Results The arousal and valence were classified and visualized on a two-dimensional coordinate plane. Profiles were designed depending on the number of hidden layers, nodes, and hyperparameters according to the error rate. The experimental results show an arousal and valence classification model accuracy of 74.65 and 78%, respectively. The proposed model performed better than previous other models. Conclusions The proposed model appears to be effective in analyzing arousal and valence; specifically, it is expected that affective analysis using physiological signals based on LSTM will be possible without manual feature extraction. In a future study, the classification model will be adopted in mental healthcare management systems.

[1]  Elisabeth André,et al.  Improving Automatic Emotion Recognition from Speech via Gender Differentiaion , 2006, LREC.

[2]  Chuan-Yu Chang,et al.  Based on Support Vector Regression for emotion recognition using physiological signals , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[3]  J. Russell A circumplex model of affect. , 1980 .

[4]  Jüri Allik,et al.  Age-related differences in emotion recognition ability: a cross-sectional study. , 2009, Emotion.

[5]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  C. Collet,et al.  Autonomic nervous system response patterns specificity to basic emotions. , 1997, Journal of the Autonomic Nervous System.

[7]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[8]  Xianxiang Chen,et al.  Respiration-based emotion recognition with deep learning , 2017, Comput. Ind..

[9]  Aamir Saeed Malik,et al.  A physiological signal-based method for early mental-stress detection , 2018, Biomed. Signal Process. Control..

[10]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[11]  M. Kempton,et al.  Virtual reality in the psychological treatment for mental health problems: An systematic review of recent evidence , 2016, Psychiatry Research.

[12]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[13]  M Murugappan,et al.  Physiological signals based human emotion Recognition: a review , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[14]  A. Damasio,et al.  Basic emotions are associated with distinct patterns of cardiorespiratory activity. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  Zhongquan Li,et al.  Emotion regulation difficulties and moral judgment in different domains: The mediation of emotional valence and arousal , 2017 .

[16]  武田 一哉,et al.  Recurrent Neural Networkに基づく日常生活行動認識 , 2016 .

[17]  Zhong Yin,et al.  Recognition of emotions using multimodal physiological signals and an ensemble deep learning model , 2017, Comput. Methods Programs Biomed..

[18]  John M. Horack,et al.  Application of virtual reality for crew mental health in extended-duration space missions , 2018 .

[19]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[20]  Suzanne Haeyen,et al.  Promoting mental health versus reducing mental illness in art therapy with patients with personality disorders: A quantitative study , 2017 .

[21]  Young-Sung Kim,et al.  Wearable Systems for Service based on Physiological Signals , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[22]  Dan Wang,et al.  Modeling Physiological Data with Deep Belief Networks. , 2013, International journal of information and education technology.