Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection

Emotion, mood, and stress recognition (EMSR) has been studied in laboratory settings for decades. In particular, physiological signals are widely used to detect and classify affective states in lab conditions. However, physiological reactions to emotional stimuli have been found to differ in laboratory and natural settings. Thanks to recent technological progress (e.g., in wearables) the creation of EMSR systems for a large number of consumers during their everyday activities is increasingly possible. Therefore, datasets created in the wild are needed to insure the validity and the exploitability of EMSR models for real-life applications. In this paper, we initially present common techniques used in laboratory settings to induce emotions for the purpose of physiological dataset creation. Next, advantages and challenges of data collection in the wild are discussed. To assess the applicability of existing datasets to real-life applications, we propose a set of categories to guide and compare at a glance different methodologies used by researchers to collect such data. For this purpose, we also introduce a visual tool called Graphical Assessment of Real-life Application-Focused Emotional Dataset (GARAFED). In the last part of the paper, we apply the proposed tool to compare existing physiological datasets for EMSR in the wild and to show possible improvements and future directions of research. We wish for this paper and GARAFED to be used as guidelines for researchers and developers who aim at collecting affect-related data for real-life EMSR-based applications.

[1]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[2]  Pierluigi Casale,et al.  Towards Stress Detection in Real-Life Scenarios Using Wearable Sensors: Normalization Factor to Reduce Variability in Stress Physiology , 2016, eHealth 360°.

[3]  U. Ott,et al.  Using music to induce emotions: Influences of musical preference and absorption , 2008 .

[4]  Renan Vinicius Aranha,et al.  Adapting Software with Affective Computing: A Systematic Review , 2019, IEEE Transactions on Affective Computing.

[5]  Lilianne R. Mujica-Parodi,et al.  Ambulatory and Challenge-Associated Heart Rate Variability Measures Predict Cardiac Responses to Real-World Acute Emotional Stress , 2010, Biological Psychiatry.

[6]  M. Myrtek,et al.  Perception of emotions in everyday life: studies with patients and normals , 1996, Biological Psychology.

[7]  Antonios Liapis,et al.  PAGAN: Video Affect Annotation Made Easy , 2019, 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII).

[8]  P. Grossman The LifeShirt: a multi-function ambulatory system monitoring health, disease, and medical intervention in the real world. , 2004, Studies in health technology and informatics.

[9]  S. Vrana,et al.  The psychophysiology of disgust: differentiating negative emotional contexts with facial EMG. , 1993, Psychophysiology.

[10]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[11]  Fadel Adib,et al.  Emotion recognition using wireless signals , 2016, MobiCom.

[12]  D. Kahneman,et al.  Well-being : the foundations of hedonic psychology , 1999 .

[13]  Emre Ertin,et al.  cStress: towards a gold standard for continuous stress assessment in the mobile environment , 2015, UbiComp.

[14]  J. Suls,et al.  The effects of caffeine on ambulatory blood pressure, heart rate, and mood in coffee drinkers , 1996, Journal of Behavioral Medicine.

[15]  Guillaume Chanel,et al.  Aesthetic Highlight Detection in Movies Based on Synchronization of Spectators’ Reactions , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[16]  David Watson,et al.  Emotion, mood, and temperament: Similarities, differences--and a synthesis. , 2001 .

[17]  DevillersLaurence,et al.  2005 Special Issue , 2005 .

[18]  Michael Beigl,et al.  A wearable system for mood assessment considering smartphone features and data from mobile ECGs , 2016, UbiComp Adjunct.

[19]  Harvey Mellar,et al.  Investigating teacher stress when using technology , 2008, Comput. Educ..

[20]  K. Scherer,et al.  The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance , 2011, Behavior research methods.

[21]  R. Zatorre,et al.  Interactions Between the Nucleus Accumbens and Auditory Cortices Predict Music Reward Value , 2013, Science.

[22]  Frank H. Wilhelm,et al.  Continuous electronic data capture of physiology, behavior and experience in real life: towards ecological momentary assessment of emotion , 2006, Interact. Comput..

[23]  J. Russell A circumplex model of affect. , 1980 .

[24]  Guillaume Chanel,et al.  Recognizing Induced Emotions of Movie Audiences from Multimodal Information , 2019, IEEE Transactions on Affective Computing.

[25]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[26]  Rafael A. Calvo,et al.  Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[27]  Paul Johns,et al.  Food and Mood: Just-in-Time Support for Emotional Eating , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[28]  Toby Cole,et al.  Acting a Handbook of the Stanislavski Method , 1940 .

[29]  Jennifer A. Silvers,et al.  Cognitive reappraisal of emotion: a meta-analysis of human neuroimaging studies. , 2014, Cerebral cortex.

[30]  Jeffrey M Girard,et al.  CARMA: Software for continuous affect rating and media annotation. , 2014, Journal of open research software.

[31]  Radoslaw Niewiadomski,et al.  The role of respiration audio in multimodal analysis of movement qualities , 2019, Journal on Multimodal User Interfaces.

[32]  Matjaz Gams,et al.  Continuous stress detection using a wrist device: in laboratory and real life , 2016, UbiComp Adjunct.

[33]  Luigi Cinque,et al.  Self-induced emotions as alternative paradigm for driving brain–computer interfaces , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[34]  Karen Gasper,et al.  Affect as information , 2013 .

[35]  C. Gehin,et al.  EmoSense: An Ambulatory Device for the Assessment of ANS Activity—Application in the Objective Evaluation of Stress With the Blind , 2012, IEEE Sensors Journal.

[36]  Javier Hernandez,et al.  Call Center Stress Recognition with Person-Specific Models , 2011, ACII.

[37]  Christopher D. Manning,et al.  Advances in natural language processing , 2015, Science.

[38]  Vladimir J. Konečni,et al.  Does music induce emotion? A theoretical and methodological analysis. , 2008 .

[39]  Mahesh Sooriyabandara,et al.  HealthyOffice: Mood recognition at work using smartphones and wearable sensors , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[40]  E. Kensinger,et al.  Emotion's influence on memory for spatial and temporal context , 2011, Cognition & emotion.

[41]  A. David,et al.  Predictors of amygdala activation during the processing of emotional stimuli: A meta-analysis of 385 PET and fMRI studies , 2008, Brain Research Reviews.

[42]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[43]  Stevens S Smith,et al.  Ethical Aspects of Participating in Psychology Experiments: Effects of Anonymity on Evaluation, and Complaints of Distressed Subjects , 1983, Teaching of psychology.

[44]  Emre Ertin,et al.  Are we there yet?: feasibility of continuous stress assessment via wireless physiological sensors , 2014, BCB.

[45]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[46]  Misha Pavel,et al.  Evaluation of the accuracy and reliability for photoplethysmography based heart rate and beat-to-beat detection during daily activities , 2017 .

[47]  A. Jonsson,et al.  Heart Rate as a Marker of Stress in Ambulance Personnel: A Pilot Study of the Body's Response to the Ambulance Alarm , 2011, Prehospital and Disaster Medicine.

[48]  M. Balconi,et al.  What hemodynamic (fNIRS), electrophysiological (EEG) and autonomic integrated measures can tell us about emotional processing , 2015, Brain and Cognition.

[49]  Inbal Nahum-Shani,et al.  Finding Significant Stress Episodes in a Discontinuous Time Series of Rapidly Varying Mobile Sensor Data , 2016, CHI.

[50]  Adam Haar Horowitz,et al.  Combining Virtual Reality and Biofeedback to Foster Empathic Abilities in Humans , 2019, Front. Psychol..

[51]  A. Barreto,et al.  Stress Detection in Computer Users Based on Digital Signal Processing of Noninvasive Physiological Variables , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  G Rizzolatti,et al.  Mirroring the Social Aspects of Speech and Actions: The Role of the Insula , 2018, Cerebral cortex.

[53]  E. Geus,et al.  Ambulatory assessment of parasympathetic/sympathetic balance by impedance cardiography , 1996 .

[54]  Ilkka Korhonen,et al.  Relationship of Psychological and Physiological Variables in Long-Term Self-Monitored Data During Work Ability Rehabilitation Program , 2009, IEEE Transactions on Information Technology in Biomedicine.

[55]  Tuomas Eerola,et al.  Measuring music-induced emotion , 2011 .

[56]  Gerhard Tröster,et al.  Modeling arousal phases in daily living using wearable sensors , 2013, IEEE Transactions on Affective Computing.

[57]  M Myrtek,et al.  Stress and strain of blue and white collar workers during work and leisure time: results of psychophysiological and behavioral monitoring. , 1999, Applied ergonomics.

[58]  Joseph E LeDoux,et al.  Emotional networks in the brain , 2008 .

[59]  Zhenqi Li,et al.  A Review of Emotion Recognition Using Physiological Signals , 2018, Sensors.

[60]  Yi-Hsuan Yang,et al.  Developing a benchmark for emotional analysis of music , 2017, PloS one.

[61]  W. Tschacher,et al.  Ambulatory Assessment of Psychological and Physiological Stress on Workdays and Free Days Among Teachers. A Preliminary Study , 2020, Frontiers in Neuroscience.

[62]  Leiv Sandvik,et al.  Long-Term Stability of Cardiovascular and Catecholamine Responses to Stress Tests: An 18-Year Follow-Up Study , 2010, Hypertension.

[63]  B. Rooney,et al.  The apparent reality of movies and emotional arousal: A study using physiological and self-report measures , 2012 .

[64]  Paul Johns,et al.  BioCrystal: An Ambient Tool for Emotion and Communication , 2015, Int. J. Mob. Hum. Comput. Interact..

[65]  Daniel McDuff,et al.  Exploring Temporal Patterns in Classifying Frustrated and Delighted Smiles , 2012, IEEE Trans. Affect. Comput..

[66]  Hiroshi Ishii,et al.  ambienBeat: Wrist-worn Mobile Tactile Biofeedback for Heart Rate Rhythmic Regulation , 2020, Tangible and Embedded Interaction.

[67]  T. Eerola,et al.  A comparison of the discrete and dimensional models of emotion in music , 2011 .

[68]  M. Pasupathi Emotion regulation during social remembering: Differences between emotions elicited during an event and emotions elicited when talking about it , 2003, Memory.

[69]  W D Fenz,et al.  Gradients of Physiological Arousal in Parachutists as a Function of an Approaching Jump , 1967, Psychosomatic medicine.

[70]  G A Miller,et al.  Emotional imagery: conceptual structure and pattern of somato-visceral response. , 1980, Psychophysiology.

[71]  Kristof Van Laerhoven,et al.  Multi-target affect detection in the wild: an exploratory study , 2019, UbiComp.

[72]  Konstantina Zougkou,et al.  Preconscious Processing Biases Predict Emotional Reactivity to Stress , 2010, Biological Psychiatry.

[73]  Sidney K. D'Mello,et al.  Affect Elicitation for Affective Computing , 2015 .

[74]  Arindam Ghosh,et al.  Heal-T: An efficient PPG-based heart-rate and IBI estimation method during physical exercise , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[75]  P. Melillo,et al.  Nonlinear Heart Rate Variability features for real-life stress detection. Case study: students under stress due to university examination , 2011, Biomedical engineering online.

[76]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[77]  Clemens Kirschbaum,et al.  The Trier Social Stress Test for Groups (TSST-G): A new research tool for controlled simultaneous social stress exposure in a group format , 2011, Psychoneuroendocrinology.

[78]  Nilanjan Sarkar,et al.  Online stress detection using psychophysiological signals for implicit human-robot cooperation , 2002, Robotica.

[79]  J. Kostis,et al.  The Effect of Age on Heart Rate in Subjects Free of Heart Disease: Studies By Ambulatory Electrocardiography and Maximal Exercise Stress Test , 1982, Circulation.

[80]  Matjaz Gams,et al.  Monitoring stress with a wrist device using context , 2017, J. Biomed. Informatics.

[81]  Rajneesh Suri,et al.  Using fNIRS and EDA to Investigate the Effects of Messaging Related to a Dimensional Theory of Emotion , 2019, AHFE.

[82]  Yorgos Goletsis,et al.  Real-Time Driver's Stress Event Detection , 2012, IEEE Transactions on Intelligent Transportation Systems.

[83]  Eman M. G. Younis,et al.  Towards unravelling the relationship between on-body, environmental and emotion data using sensor information fusion approach , 2018, Inf. Fusion.

[84]  Leonardo S. Mattos,et al.  Effects of galvanic skin response feedback on user experience in gaze-controlled gaming: A pilot study , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[85]  Danaë Emma Beckford Stanton Fraser,et al.  Use of a non-human robot audience to induce stress reactivity in human participants , 2019, Comput. Hum. Behav..

[86]  Gerhard Tröster,et al.  Monitoring Stress Arousal in the Wild , 2013, IEEE Pervasive Computing.

[87]  Sandra Ohly,et al.  From the lab to the real-world: An investigation on the influence of human movement on Emotion Recognition using physiological signals , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[88]  E. Kreta,et al.  A review on sex differences in processing emotional signals , 2012 .

[89]  P Anastasiades,et al.  The relationship between heart rate and mood in real life. , 1990, Journal of psychosomatic research.

[90]  Daniel McDuff,et al.  AffectAura: an intelligent system for emotional memory , 2012, CHI.

[91]  Gonzalo Bailador,et al.  A Stress-Detection System Based on Physiological Signals and Fuzzy Logic , 2011, IEEE Transactions on Industrial Electronics.

[92]  F. Wilhelm,et al.  Emotions beyond the laboratory: Theoretical fundaments, study design, and analytic strategies for advanced ambulatory assessment , 2010, Biological Psychology.

[93]  Hazem M. Hajj,et al.  A survey of ground-truth in emotion data annotation , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications Workshops.

[94]  Edward L. Melanson,et al.  The effect of endurance training on resting heart rate variability in sedentary adult males , 2001, European Journal of Applied Physiology.

[95]  Darwin G. Caldwell,et al.  Brain-Controlled AR Feedback Design for User's Training in Surgical HRI , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[96]  Ko Keun Kim,et al.  Nonintrusive biological signal monitoring in a car to evaluate a driver's stress and health state. , 2009, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[97]  R. Zhou,et al.  A New Standardized Emotional Film Database for Asian Culture , 2017, Front. Psychol..

[98]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[99]  A. Angrilli,et al.  E-MOVIE - Experimental MOVies for Induction of Emotions in neuroscience: An innovative film database with normative data and sex differences , 2019, PloS one.

[100]  Friedhelm Schwenker,et al.  Multimodal Emotion Classification in Naturalistic User Behavior , 2011, HCI.

[101]  Ioannis Pitas,et al.  Multi-modal emotion-related data collection within a virtual earthquake emulator , 2008 .

[102]  Pierre-Majorique Léger,et al.  How Wild Is Too Wild: Lessons Learned and Recommendations for Ecological Validity in Physiological Computing Research , 2018, PhyCS.

[103]  Michael D. Robinson,et al.  Belief and feeling: evidence for an accessibility model of emotional self-report. , 2002, Psychological bulletin.

[104]  Katarzyna Wac,et al.  Ambulatory Assessment of Affect: Survey of Sensor Systems for Monitoring of Autonomic Nervous Systems Activation in Emotion , 2014, IEEE Transactions on Affective Computing.

[105]  K. Scherer,et al.  Cues and channels in emotion recognition. , 1986 .

[106]  T. Martin McGinnity,et al.  Beyond Mobile Apps: A Survey of Technologies for Mental Well-Being , 2019, IEEE Transactions on Affective Computing.

[107]  Giora Galili,et al.  Emotional Response and Changes in Heart Rate Variability Following Art-Making With Three Different Art Materials , 2018, Front. Psychol..

[108]  Sethuraman Panchanathan,et al.  Multimodal emotion recognition using deep learning architectures , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[109]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[110]  R. Zajonc,et al.  Feeling and facial efference: implications of the vascular theory of emotion. , 1989, Psychological review.

[111]  David I. Donaldson,et al.  Understanding Minds in Real-World Environments: Toward a Mobile Cognition Approach , 2017, Front. Hum. Neurosci..

[112]  Abeer Alsadoon,et al.  Evaluating the accuracy of wearable heart rate monitors , 2016, 2016 2nd International Conference on Advances in Computing, Communication, & Automation (ICACCA) (Fall).

[113]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[114]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[115]  J. Turner Human Emotions: A Sociological Theory , 2007 .

[116]  M. Murugappan,et al.  A review on stress inducement stimuli for assessing human stress using physiological signals , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[117]  M Murugappan,et al.  Physiological signals based human emotion Recognition: a review , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[118]  Hilla Peretz,et al.  Ju n 20 03 Schrödinger ’ s Cat : The rules of engagement , 2003 .

[119]  M. Skowron,et al.  Zooming in: Studying Collective Emotions with Interactive Affective Systems , 2017 .

[120]  Mark Matthews,et al.  MoodLight: Exploring Personal and Social Implications of Ambient Display of Biosensor Data , 2015, CSCW.

[121]  C. Ring,et al.  Secretory immunoglobulin A reactions to prolonged mental arithmetic stress: inter-session and intra-session reliability , 2002, Biological Psychology.

[122]  Imad Aad,et al.  The Mobile Data Challenge: Big Data for Mobile Computing Research , 2012 .

[123]  Jennifer Healey,et al.  Out of the Lab and into the Fray: Towards Modeling Emotion in Everyday Life , 2010, Pervasive.

[124]  Paulo J. G. Lisboa,et al.  A Lifelogging Platform Towards Detecting Negative Emotions in Everyday Life using Wearable Devices , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[125]  Radoslaw Niewiadomski,et al.  Low-intrusive recognition of expressive movement qualities , 2017, ICMI.

[126]  Chiara Bassano,et al.  A VR Game-based System for Multimodal Emotion Data Collection , 2019, MIG.

[127]  Georg Brügner,et al.  Emotions in everyday life: an ambulatory monitoring study with female students , 2005, Biological Psychology.

[128]  Ira J. Roseman Cognitive determinants of emotion: A structural theory. , 1984 .

[129]  M. Kret,et al.  A review on sex differences in processing emotional signals , 2012, Neuropsychologia.

[130]  Cem Ersoy,et al.  How Laboratory Experiments Can Be Exploited for Monitoring Stress in the Wild: A Bridge Between Laboratory and Daily Life , 2020, Sensors.

[131]  Mark T. Maybury,et al.  Multimedia Annotation, Querying, and Analysis in Anvil , 2011 .

[132]  Andrea Kleinsmith,et al.  Affective Body Expression Perception and Recognition: A Survey , 2013, IEEE Transactions on Affective Computing.

[133]  E. Harmon-Jones,et al.  Social psychological methods in emotion elicitation , 2007 .

[134]  Hongshik Ahn,et al.  Concurrent measurement of "real-world" stress and arousal in individuals with psychosis: assessing the feasibility and validity of a novel methodology. , 2010, Schizophrenia bulletin.

[135]  Radoslaw Niewiadomski,et al.  Automated Laughter Detection From Full-Body Movements , 2016, IEEE Transactions on Human-Machine Systems.

[136]  Multimodal Databases , 2009, Encyclopedia of Database Systems.

[137]  A. Schaefer,et al.  Please Scroll down for Article Cognition & Emotion Assessing the Effectiveness of a Large Database of Emotion-eliciting Films: a New Tool for Emotion Researchers , 2022 .

[138]  David Matsumoto,et al.  Culture and Emotion , 2012, The Handbook of Culture and Psychology.

[139]  Emre Ertin,et al.  Continuous inference of psychological stress from sensory measurements collected in the natural environment , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[140]  Friedhelm Schwenker,et al.  A dataset of continuous affect annotations and physiological signals for emotion analysis , 2018, Scientific Data.

[141]  J. Russell,et al.  Descriptive and Prescriptive Definitions of Emotion , 2010 .

[142]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[143]  Kristof Van Laerhoven,et al.  Labelling Affective States "in the Wild": Practical Guidelines and Lessons Learned , 2018, UbiComp/ISWC Adjunct.

[144]  Rosalind W. Picard Toward Agents that Recognize Emotion , 1998 .

[145]  Giacomo Rizzolatti,et al.  Expressing our internal states and understanding those of others , 2015, Proceedings of the National Academy of Sciences.

[146]  W. Tschacher,et al.  Physiological Correlates of Aesthetic Perception of Artworks in a Museum , 2012 .

[147]  Julian F. Thayer,et al.  Prolonged Non-metabolic Heart Rate Variability Reduction as a Physiological Marker of Psychological Stress in Daily Life , 2016, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[148]  Daniel R. Fesenmaier,et al.  Measuring Emotions in Real Time , 2015 .

[149]  Sylvie Charbonnier,et al.  Real-Time Monitoring of Passenger's Psychological Stress , 2019, Future Internet.

[150]  J. Berry,et al.  Basic processes and human development , 1997 .

[151]  M. Delargy,et al.  Locked-in syndrome , 2005, BMJ : British Medical Journal.

[152]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[153]  Radoslaw Niewiadomski,et al.  Appraisal theory-based mobile app for physiological data collection and labelling in the wild , 2019, UbiComp/ISWC Adjunct.

[154]  Efthymios Constantinides,et al.  Consumers' Cognitive, Emotional and Behavioral Responses towards Background Music: An EEG Study , 2019, WEBIST.

[155]  Todor Ganchev,et al.  CLAS: A Database for Cognitive Load, Affect and Stress Recognition , 2019, 2019 International Conference on Biomedical Innovations and Applications (BIA).

[156]  A. Muaremi,et al.  Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep , 2013, BioNanoScience.

[157]  Abhinav Dhall,et al.  Emotion recognition in the wild challenge 2013 , 2013, ICMI '13.

[158]  K. Kallinen,et al.  Emotion perceived and emotion felt: Same and different , 2006 .

[159]  Subramanian Ramanathan,et al.  DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses , 2015, IEEE Transactions on Affective Computing.

[160]  Hao Tang,et al.  deStress: Mobile and remote stress monitoring, alleviation, and management platform , 2012, GLOBECOM.

[161]  Boreom Lee,et al.  Improved elimination of motion artifacts from a photoplethysmographic signal using a Kalman smoother with simultaneous accelerometry , 2010, Physiological measurement.

[162]  Frank H Wilhelm,et al.  Using minute ventilation for ambulatory estimation of additional heart rate , 1998, Biological Psychology.

[163]  Emmanuel Dellandréa,et al.  Deep learning vs. kernel methods: Performance for emotion prediction in videos , 2015, ACII.

[164]  Fakhri Karray,et al.  Survey on speech emotion recognition: Features, classification schemes, and databases , 2011, Pattern Recognit..

[165]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[166]  Natalia Sidorova,et al.  Smart technologies for long-term stress monitoring at work , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[167]  Andrea Bonarini,et al.  Enjoyment recognition from physiological data in a car racing game , 2010, AFFINE '10.

[168]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[169]  Franz Gravenhorst,et al.  Monitoring the impact of stress on the sleep patterns of pilgrims using wearable sensors , 2014, IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[170]  Klaus David,et al.  Angry or Climbing Stairs? Towards Physiological Emotion Recognition in the Wild , 2019, 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[171]  Michael D. Robinson,et al.  Simulation, Scenarios, and Emotional Appraisal: Testing the Convergence of Real and Imagined Reactions to Emotional Stimuli , 2001 .

[172]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[173]  Lori Lamel,et al.  Challenges in real-life emotion annotation and machine learning based detection , 2005, Neural Networks.

[174]  Amy Voida,et al.  Towards personal stress informatics: comparing minimally invasive techniques for measuring daily stress in the wild , 2014, PervasiveHealth.

[175]  E. Harmon-Jones,et al.  State anger and prefrontal brain activity: evidence that insult-related relative left-prefrontal activation is associated with experienced anger and aggression. , 2001, Journal of personality and social psychology.