Arousal Detection in Elderly People from Electrodermal Activity Using Musical Stimuli

The detection of emotions is fundamental in many areas related to health and well-being. This paper presents the identification of the level of arousal in older people by monitoring their electrodermal activity (EDA) through a commercial device. The objective was to recognize arousal changes to create future therapies that help them to improve their mood, contributing to reduce possible situations of depression and anxiety. To this end, some elderly people in the region of Murcia were exposed to listening to various musical genres (flamenco, Spanish folklore, Cuban genre and rock/jazz) that they heard in their youth. Using methods based on the process of deconvolution of the EDA signal, two different studies were carried out. The first, of a purely statistical nature, was based on the search for statistically significant differences for a series of temporal, morphological, statistical and frequency features of the processed signals. It was found that Flamenco and Spanish Folklore presented the highest number of statistically significant parameters. In the second study, a wide range of classifiers was used to analyze the possible correlations between the detection of the EDA-based arousal level compared to the participants’ responses to the level of arousal subjectively felt. In this case, it was obtained that the best classifiers are support vector machines, with 87% accuracy for flamenco and 83.1% for Spanish Folklore, followed by K-nearest neighbors with 81.4% and 81.5% for Flamenco and Spanish Folklore again. These results reinforce the notion of familiarity with a musical genre on emotional induction.

[1]  Senem Velipasalar,et al.  A More Complete Picture of Emotion Using Electrocardiogram and Electrodermal Activity to Complement Cognitive Data , 2016, HCI.

[2]  Francisco Herrera,et al.  Artificial intelligence within the interplay between natural and artificial computation: Advances in data science, trends and applications , 2020, Neurocomputing.

[3]  Antonio Fernández-Caballero,et al.  Neural Correlates of Phrase Quadrature Perception in Harmonic Rhythm: An EEG Study Using a Brain-Computer Interface , 2017, Int. J. Neural Syst..

[4]  Antonio Fernández-Caballero,et al.  Deep Support Vector Machines for the Identification of Stress Condition from Electrodermal Activity , 2020, Int. J. Neural Syst..

[5]  José Manuel Pastor,et al.  Arousal Level Classification in the Ageing Adult by Measuring Electrodermal Skin Conductivity , 2015, AmIHEALTH.

[6]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[7]  José Manuel Pastor,et al.  Film mood induction and emotion classification using physiological signals for health and wellness promotion in older adults living alone , 2020, Expert Syst. J. Knowl. Eng..

[8]  José Manuel Pastor,et al.  Electrodermal Activity Sensor for Classification of Calm/Distress Condition , 2017, Sensors.

[9]  Akane Sano,et al.  Automatic identification of artifacts in electrodermal activity data , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[10]  R. Zatorre,et al.  The Rewarding Aspects of Music Listening Are Related to Degree of Emotional Arousal , 2009, PloS one.

[11]  A. Gregory,et al.  Cross-Cultural Comparisons in the Affective Response to Music , 1996 .

[12]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[13]  Steven M. Demorest,et al.  Lost in Translation: An Enculturation Effect in Music Memory Performance , 2008 .

[14]  Fernando Silveira,et al.  Predicting audience responses to movie content from electro-dermal activity signals , 2013, UbiComp.

[15]  Pedro R. Almeida,et al.  Validation of Wireless Sensors for Psychophysiological Studies , 2019, Sensors.

[16]  Antonio Fernández-Caballero,et al.  A Framework for Recognizing and Regulating Emotions in the Elderly , 2014, IWAAL.

[17]  M. Dawson,et al.  The electrodermal system , 2007 .

[18]  Mohanasankar Sivaprakasam,et al.  Electrodermal Activity based Classification of Induced Stress in a Controlled Setting , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[19]  Cristiana Larizza,et al.  Deep Learning to Unveil Correlations between Urban Landscape and Population Health † , 2020, Sensors.

[20]  A. Serretti,et al.  The association between electrodermal activity (EDA), depression and suicidal behaviour: A systematic review and narrative synthesis , 2018, BMC Psychiatry.

[21]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[22]  R. Kopiez,et al.  The impact of song-specific age and affective qualities of popular songs on music-evoked autobiographical memories (MEAMs) , 2015 .

[23]  E. Brattico,et al.  Music and Emotions in the Brain: Familiarity Matters , 2011, PloS one.

[24]  Salma Elgayar,et al.  Emotion Detection from Text: Survey , 2017 .

[25]  Elena Navarro,et al.  Gerontechnologies - Current achievements and future trends , 2017, Expert Syst. J. Knowl. Eng..

[26]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[27]  Kyandoghere Kyamakya,et al.  Improving Subject-independent Human Emotion Recognition Using Electrodermal Activity Sensors for Active and Assisted Living , 2018, PETRA.

[28]  Filippo Cavallo,et al.  Mood classification through physiological parameters , 2019 .

[29]  Tony Jan,et al.  Determining the Optimal Restricted Driving Zone Using Genetic Algorithm in a Smart City , 2020, Sensors.

[30]  David J Rachlin,et al.  Encyclopedia of Behavioral Medicine , 2014 .

[31]  Lila Iznita Izhar,et al.  Classification of Neurological States from Biosensor Signals Based on Statistical Features , 2019, 2019 IEEE Student Conference on Research and Development (SCOReD).

[32]  Cristina E Davis,et al.  Wearable Sensor System to Monitor Physical Activity and the Physiological Effects of Heat Exposure , 2020, Sensors.

[33]  Shabir Ahmad,et al.  Towards a Remote Monitoring of Patient Vital Signs Based on IoT-Based Blockchain Integrity Management Platforms in Smart Hospitals , 2020, Sensors.

[34]  Jonathan D. Coutinho,et al.  Arousal Effects on Pupil Size, Heart Rate, and Skin Conductance in an Emotional Face Task , 2018, Front. Neurol..

[35]  Ying Wah Teh,et al.  A Novel Cost-Efficient Framework for Critical Heartbeat Task Scheduling Using the Internet of Medical Things in a Fog Cloud System , 2020, Sensors.

[36]  Jeen-Shing Wang,et al.  A k-nearest-neighbor classifier with heart rate variability feature-based transformation algorithm for driving stress recognition , 2013, Neurocomputing.

[37]  Antonio Fernández-Caballero,et al.  Elicitation of Emotions through Music: The Influence of Note Value , 2015, IWINAC.

[38]  J. Ricarte,et al.  Performance in Autobiographical Memory of Older Adults with Depression Symptoms , 2013 .

[39]  Rosalind W. Picard,et al.  Multiple Arousal Theory and Daily-Life Electrodermal Activity Asymmetry , 2016 .

[40]  Yun Liu,et al.  Psychological stress level detection based on electrodermal activity , 2018, Behavioural Brain Research.

[41]  Byoung-Jun Park,et al.  Emotion classification based on bio-signals emotion recognition using machine learning algorithms , 2014, 2014 International Conference on Information Science, Electronics and Electrical Engineering.

[42]  Joaquín María Piñeiro Blanca Instrumentalización política de la música desde el franquismo hasta la consolidación de la democracia en España , 2013 .

[43]  Antonio Fernández-Caballero,et al.  Influence of Tempo and Rhythmic Unit in Musical Emotion Regulation , 2016, Front. Comput. Neurosci..

[44]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[45]  Ronald Schroeter,et al.  From road distraction to safe driving: Evaluating the effects of boredom and gamification on driving behaviour, physiological arousal, and subjective experience , 2017, Comput. Hum. Behav..

[46]  I. Iglesias (Re)construyendo la identidad musical española: el jazz y el discurso cultural del franquismo durante la Segunda Guerra Mundial , 2010 .

[47]  Antonio Fernández-Caballero,et al.  Stress Identification from Electrodermal Activity by Support Vector Machines , 2019, IWINAC.

[48]  Amy Beth Warriner,et al.  Norms of valence, arousal, and dominance for 13,915 English lemmas , 2013, Behavior Research Methods.

[49]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[50]  P. Vink,et al.  Pleasure, Arousal, Dominance: Mehrabian and Russell revisited , 2014, Current Psychology.

[51]  J. Russell A circumplex model of affect. , 1980 .

[52]  T. Eerola,et al.  The Effect of Memory in Inducing Pleasant Emotions with Musical and Pictorial Stimuli , 2018, Scientific Reports.

[53]  Thomas F. Denson,et al.  Experimental Methods for Inducing Basic Emotions: A Qualitative Review , 2019 .

[54]  Juan Pedro Serrano,et al.  Life review therapy using autobiographical retrieval practice for older adults with depressive symptomatology. , 2004, Psychology and aging.

[55]  Aijun An,et al.  Unsupervised Emotion Detection from Text Using Semantic and Syntactic Relations , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[56]  Rachel L. Bailey Electrodermal Activity (EDA) , 2017 .

[57]  Hugo F Posada-Quintero,et al.  Innovations in Electrodermal Activity Data Collection and Signal Processing: A Systematic Review , 2020, Sensors.

[58]  E. Scilingo,et al.  Arousal and Valence Recognition of Affective Sounds Based on Electrodermal Activity , 2017, IEEE Sensors Journal.

[59]  Sascha Meudt,et al.  The uulmMAC Database—A Multimodal Affective Corpus for Affective Computing in Human-Computer Interaction , 2020, Sensors.

[60]  Antonio Fernández-Caballero,et al.  Neural Correlates of Phrase Rhythm: An EEG Study of Bipartite vs. Rondo Sonata Form , 2017, Front. Neuroinform..

[61]  Fernando Seoane,et al.  Activity Recognition Using Wearable Physiological Measurements: Selection of Features from a Comprehensive Literature Study , 2019, Sensors.

[62]  Mohsen Guizani,et al.  A Survey of Blockchain Enabled Cyber-Physical Systems , 2020, Sensors.

[63]  Hong Jin Jeon,et al.  Automatic detection of major depressive disorder using electrodermal activity , 2018, Scientific Reports.

[64]  Subhas Chandra Mukhopadhyay,et al.  Wearable and Autonomous Biomedical Devices and Systems for Smart Environment: Issues and Characterization , 2010 .

[65]  José Manuel Pastor,et al.  Smart environment architecture for emotion detection and regulation , 2016, J. Biomed. Informatics.

[66]  Jon D. Morris Observations: SAM: The Self-Assessment Manikin An Efficient Cross-Cultural Measurement Of Emotional Response 1 , 1995 .