Mood classification through physiological parameters

Future smart agents, like robots, should produce personalized behaviours based on user emotions and moods to fit more in ordinary users’ activities. Besides, the emotions are also linked to human cognitive systems, thus their monitoring could be extremely useful in the case of neurodegenerative diseases such as dementia and Alzheimer. Literature works propose the use of music tracks and videos to stimulate emotions, and cameras to recorder the evoked reactions in human beings. However, these approaches may not be effective in everyday life, due to camera obstructions and different types of stimulation which can be related also with the interaction with other human beings. In this work, we investigate the Electrocardiogram, the ElectroDermal Activity and the Brain Activity signals as main informative channels, acquired through a wireless wearable sensor network. An experimental methodology was built to induce three different emotional states through social interaction. Collected data were classified with three supervised machine learning approaches with different kernels (Support Vector Machine, Decision Tree and k-nearest neighbour) considering the valence dimension and a combination of valence and arousal dimension evoked during the interaction. 34 healthy young participants were involved in the study and a total of 239 instances were analyzed. The supervised algorithms achieve an accuracy of 0.877 in the best case.

[1]  J. Russell A circumplex model of affect. , 1980 .

[2]  Mahmoud Torabinejad,et al.  Cytotoxicity and Antimicrobial Effects of a New Fast-Set MTA , 2017, BioMed research international.

[3]  Hatice Kose-Bagci,et al.  Improving human-robot interaction based on joint attention , 2016, Applied Intelligence.

[4]  Yang Lu,et al.  Industry 4.0: A survey on technologies, applications and open research issues , 2017, J. Ind. Inf. Integr..

[5]  M. Kindt,et al.  Masked fear words produce increased SCRs: an anomaly for Ohman's theory of pre-attentive processing in anxiety. , 2000, Psychophysiology.

[6]  Chunyan Miao,et al.  Personalized Emotion-Aware Video Streaming for the Elderly , 2018, HCI.

[7]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[8]  S Micera,et al.  Technology and Innovative Services , 2011, IEEE Pulse.

[9]  Sakiko Yoshikawa,et al.  Emotion Elicitation EffEct of films in a JapanEsE samplE , 2007 .

[10]  Elizabeth A. Croft,et al.  Cooperative gestures for industry: Exploring the efficacy of robot hand configurations in expression of instructional gestures for human–robot interaction , 2017, Int. J. Robotics Res..

[11]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[12]  Adriana Tapus,et al.  Contactless Physiological Data Analysis for User Quality of Life Improving by Using a Humanoid Social Robot , 2017, ICIAP.

[13]  Giulio Vidotto,et al.  CBA-2.0 Scale Primarie: Manuale. Una batteria a largo spettro per l’assessment psicologico , 1986 .

[14]  Tamás D. Gedeon,et al.  Objective measures, sensors and computational techniques for stress recognition and classification: A survey , 2012, Comput. Methods Programs Biomed..

[15]  E. Harmon-Jones,et al.  Social psychological methods in emotion elicitation , 2007 .

[16]  Jozef Juhar,et al.  Facial Expression Emotion Detection for Real-Time Embedded Systems , 2018 .

[17]  Hubert Konik,et al.  Framework for reliable, real-time facial expression recognition for low resolution images , 2013, Pattern Recognit. Lett..

[18]  A. Damasio The somatic marker hypothesis and the possible functions of the prefrontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[19]  Karsten Berns,et al.  Embodiment of Human Personality with EI-Robots by Mapping Behaviour Traits from Live-Model , 2016, RAAD.

[20]  Fu-Chien Kao,et al.  Brainwaves Analysis of Positive and Negative Emotions , 2015 .

[21]  Andrew Zisserman,et al.  Emotion Recognition in Speech using Cross-Modal Transfer in the Wild , 2018, ACM Multimedia.

[22]  Sebastian Glende,et al.  Increasing the Acceptance of Assistive Robots for Older People Through Marketing Strategies Based on Stakeholder Needs , 2016, Int. J. Soc. Robotics.

[23]  Long Hu,et al.  iRobot-Factory: An intelligent robot factory based on cognitive manufacturing and edge computing , 2019, Future Gener. Comput. Syst..

[24]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[25]  Filippo Cavallo,et al.  Physiological Sensor System for the Detection of Human Moods Towards Internet of Robotic Things Applications , 2018, SoMeT.

[26]  R. Hodgson,et al.  Obsessional-compulsive complaints. , 1977, Behaviour research and therapy.

[27]  Mohammad Firoozabadi,et al.  Recognition of Music-Induced Emotions Based on Heart-Brain Connectivity , 2017, 2017 24th National and 2nd International Iranian Conference on Biomedical Engineering (ICBME).

[28]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Ruoyu Du,et al.  Optimal Feature Selection and Deep Learning Ensembles Method for Emotion Recognition From Human Brain EEG Sensors , 2017, IEEE Access.

[30]  T. Dalgleish Basic Emotions , 2004 .

[31]  Filippo Cavallo,et al.  Physiological Wireless Sensor Network for the Detection of Human Moods to Enhance Human-Robot Interaction , 2018, ForItAAL.

[32]  W. Heller Neuropsychological mechanisms of individual differences in emotion, personality, and arousal. , 1993 .

[33]  R. Bevilacqua,et al.  Acceptance of Robot-Era system: results of robotic services in smart environments with older adults , 2018 .

[34]  James L McGaugh,et al.  Emotional arousal regulation of memory consolidation , 2018, Current Opinion in Behavioral Sciences.

[35]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[36]  Filippo Cavallo,et al.  A Survey of Behavioral Models for Social Robots , 2019, Robotics.

[37]  Chi Zhang,et al.  Emotion Recognition from EEG Signals Using Multidimensional Information in EMD Domain , 2017, BioMed research international.

[38]  Joseph E LeDoux Emotional networks and motor control: a fearful view. , 1996, Progress in brain research.

[39]  Paolo Dario,et al.  Emotion Modelling for Social Robotics Applications: A Review , 2018 .

[40]  Rebecca A Ferrer,et al.  Emotion, health decision making, and health behaviour , 2018, Psychology & health.

[41]  Kyandoghere Kyamakya,et al.  Improving Subject-independent Human Emotion Recognition Using Electrodermal Activity Sensors for Active and Assisted Living , 2018, PETRA.

[42]  Filippo Cavallo,et al.  Evaluation of an Integrated System of Wearable Physiological Sensors for Stress Monitoring in Working Environments by Using Biological Markers , 2018, IEEE Transactions on Biomedical Engineering.

[43]  W. Boucsein Electrodermal activity, 2nd ed. , 2012 .

[44]  Stefan Winkler,et al.  ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors , 2018, IEEE Transactions on Affective Computing.

[45]  Yue Wang,et al.  Subject-independent emotion recognition based on physiological signals: a three-stage decision method , 2017, BMC Medical Informatics and Decision Making.

[46]  Nicole C. Krämer,et al.  Great Expectations? Relation of Previous Experiences With Social Robots in Real Life or in the Media and Expectancies Based on Qualitative and Quantitative Assessment , 2019, Front. Psychol..

[47]  Karthik Mahesh Varadarajan,et al.  Emotional feedback for service robots using hapto-acoustic interface , 2015, 2015 Pattern Recognition Association of South Africa and Robotics and Mechatronics International Conference (PRASA-RobMech).

[48]  Damien Gallagher,et al.  Depression and Risk of Alzheimer Dementia: A Longitudinal Analysis to Determine Predictors of Increased Risk among Older Adults with Depression. , 2018, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[49]  Karim Sehaba,et al.  Adaptive artificial companions learning from users’ feedback , 2016, Adapt. Behav..

[50]  Min Chen,et al.  Smart Clothing: Connecting Human with Clouds and Big Data for Sustainable Health Monitoring , 2016, Mobile Networks and Applications.

[51]  Alberto Tellaeche,et al.  Natural multimodal communication for human–robot collaboration , 2017 .

[52]  Angelo Cangelosi,et al.  Robotic Services Acceptance in Smart Environments With Older Adults: User Satisfaction and Acceptability Study , 2018, Journal of medical Internet research.

[53]  Merel Kindt,et al.  Masked fear words produce increased SCRs: an anomaly for Ohman's theory of pre-attentive processing in anxiety. , 2000 .

[54]  Damijan Miklavcic,et al.  Note atlab-based tool for ECG and HRV analysis , 2014 .