Characterization of affective states by pupillary dynamics and autonomic correlates

With the recent advent of new recording devices and an easier access to signal processing tools, researchers are increasingly exploring and studying the Pupil Dilation (PD) signal. Recently, numerous studies pointed out the relations between PD dynamics and psychophysiological states. Although it is well known that PD is controlled by the Autonomic Nervous System (ANS), and ANS responses are related to emotional events/stimuli, the relationship between emotional states and PD is still an open issue. The aim of this study is to define the statistical properties of the PD signal, to understand its relation with ANS correlates such as Heart Rate Variability (HRV) and respiration (RESP), and to explore if PD could provide information for the evaluation of the psychophysiological response of ANS to affective triggering events. ECG, RESP, and PD data from 13 normal subjects were recorded during a memory recall paradigm, and processed with spectral and cross-spectral analysis. Our results demonstrate that variability indices extracted from fast PD oscillations, not observable through standard cardiorespiratory identification in the frequency domain, would be able to discern psychophysiological responses elicited by basic emotional stimuli. A strong linear coupling was found between the variables, due to the influence of RESP on both PD and HRV within the High Frequency (HF) band, from 0.15 to 0.45 Hz. Most importantly, our results point at PD features as possible candidates for characterizing basic emotional stimuli.

[1]  L. Faes,et al.  Surrogate data approaches to assess the significance of directed coherence: Application to EEG activity propagation , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  J. Russell.  A circumplex model of affect. , 1980 .

[3]  H. Nagaraja,et al.  Heart rate variability: origins, methods, and interpretive caveats. , 1997, Psychophysiology.

[4]  T. Ziemke,et al.  The Feeling of Action Tendencies: On the Emotional Regulation of Goal-Directed Behavior , 2011, Front. Psychology.

[5]  E. Brown,et al.  Psychophysiological signals associated with affective states , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[6]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[7]  Minoru Nakayama,et al.  Frequency analysis of task evoked pupillary response and eye-movement , 2004, ETRA.

[8]  C. Collet,et al.  Autonomic nervous system response patterns specificity to basic emotions. , 1997, Journal of the Autonomic Nervous System.

[9]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[10]  S. Steinhauer,et al.  Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  R Barbieri,et al.  Closed- versus open-loop assessment of heart rate baroreflex. , 2001, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[12]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[13]  M. Hyyppä.  Descartes' error. Emotion, reason and the human brain , 1996 .

[14]  Chad L. Stephens,et al.  Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis , 2010, Biological Psychology.

[15]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[16]  C. Bond.  Personal Relevance is an Important Dimension for Visceral Reactivity in Emotional Imagery , 1998 .

[17]  Luca Citi,et al.  A Real-Time Automated Point-Process Method for the Detection and Correction of Erroneous and Ectopic Heartbeats , 2012, IEEE Transactions on Biomedical Engineering.

[18]  P. Borgdorff,et al.  Respiratory fluctuations in pupil size. , 1975, The American journal of physiology.

[19]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962 .

[20]  K Yana,et al.  Time-Varying Properties of Respiratory Fluctuations in Pupil Diameter of Human Eyes , 1994, Methods of Information in Medicine.

[21]  F. E. Grubbs.  Procedures for Detecting Outlying Observations in Samples , 1969 .

[22]  Enzo Pasquale Scilingo,et al.  Eye tracking and pupil size variation as response to affective stimuli: A preliminary study , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[23]  S Cerutti,et al.  Spontaneous fluctuations of human pupil reflect central autonomic rhythms. , 2000, Methods of information in medicine.

[24]  P. Ekman,et al.  Voluntary facial action generates emotion-specific autonomic nervous system activity. , 1990, Psychophysiology.

[25]  P. Young,et al.  Emotion and personality , 1963 .

[26]  C. Ellis,et al.  The pupillary light reflex in normal subjects. , 1981, The British journal of ophthalmology.

[27]  P G Katona,et al.  Respiratory sinus arrhythmia: noninvasive measure of parasympathetic cardiac control. , 1975, Journal of applied physiology.

[28]  A. Lacic.  [A new look]. , 1989, Pielegniarka i polozna.

[29]  A. Damasio.  Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[30]  G. P. King,et al.  Extracting qualitative dynamics from experimental data , 1986 .

[31]  W. James.  The Physical Basis of Emotion. , 1994 .

[32]  H. Akaike.  A new look at the statistical model identification , 1974 .

[33]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[34]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962, Psychological review.

[35]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[36]  A. Damasio,et al.  Basic emotions are associated with distinct patterns of cardiorespiratory activity. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[37]  I. Christie,et al.  Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[38]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[39]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[40]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[41]  Roberto Sassi,et al.  Analysis of Surface Atrial Signals: Time Series with Missing Data? , 2009, Annals of Biomedical Engineering.

[42]  W N Charman,et al.  Fluctuations in accommodation: a review , 1988, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[43]  E. Robinson,et al.  Recursive solution to the multichannel filtering problem , 1965 .

[44]  R. Vautard,et al.  Singular-spectrum analysis: a toolkit for short, noisy chaotic signals , 1992 .

[45]  C. Milne.  AUTONOMIC NERVOUS SYSTEM , 1957, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[46]  J. Beatty,et al.  The pupillary system. , 2000 .

[47]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[48]  W. Cannon.  The James-Lange theory of emotions: a critical examination and an alternative theory. By Walter B. Cannon, 1927. , 1927, The American journal of psychology.

[49]  L. Zetterberg.  Estimation of parameters for a linear difference equation with application to EEG analysis , 1969 .

[50]  Maurizio Mauria,et al.  Psychophysiological assessment of emotions , 2012 .

[51]  Andrea Caumo,et al.  Approximate entropy of respiratory patterns in panic disorder. , 2004, The American journal of psychiatry.

[52]  C. Koch,et al.  Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry , 2008, Proceedings of the National Academy of Sciences.

[53]  A. Hachoł,et al.  Time-frequency analysis of spontaneous fluctuation of the pupil size of the human eye , 2008 .

[54]  Luca Faes,et al.  Surrogate data analysis for assessing the significance of the coherence function , 2004, IEEE Transactions on Biomedical Engineering.

[55]  P. Ekman,et al.  Autonomic nervous system activity distinguishes among emotions. , 1983, Science.

[56]  R. Levenson,et al.  Autonomic specificity and emotion. , 2003 .

[57]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[58]  David H. Schoellhamer,et al.  Singular spectrum analysis for time series with missing data , 2001 .