Towards a novel generation of haptic and robotic interfaces: Integrating affective physiology in human-robot interaction

Haptic interfaces are special robots that interact with people to convey touch-related information. In addition to such a discriminative aspect, touch is also a highly emotion-related sense. However, while a lot of effort has been spent to investigate the perceptual mechanisms of discriminative touch and to suitably replicate them through haptic systems in human robot interaction (HRI), there is still a lot of work to do in order to take into account also the emotional aspects of tactual experience (i.e., the so-called affective haptics), for a more naturalistic human-robot communication. In this paper, we report evidences on how a haptic device designed to convey caress-like stimuli can influence physiological measures related to the autonomous nervous system (ANS), which is intimately connected to evoked emotions in humans. Specifically, a discriminant role of electrodermal response and heart rate variability can be associated to two different caressing velocities, which can also be linked to two different levels of pleasantness. Finally, we discuss how the results from this study could be profitably employed and generalized to pave the path towards a novel generation of robotic devices for HRI.

[1]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[2]  P. Venables,et al.  Publication recommendations for electrodermal measurements. , 1981 .

[3]  Matthew J. Hertenstein Touch: Its Communicative Functions in Infancy , 2002, Human Development.

[4]  C. Oddo,et al.  Physical Factors Influencing Pleasant Touch during Passive Fingertip Stimulation , 2014, PloS one.

[5]  U. Rajendra Acharya,et al.  Heart rate variability: a review , 2006, Medical and Biological Engineering and Computing.

[6]  Rafael Canetti,et al.  Correlations between frequency-domain HRV indices and lagged Poincaré plot width in healthy and diabetic subjects , 2007, Physiological measurement.

[7]  Luca Citi,et al.  Electrodermal activity processing: A convex optimization approach , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[9]  W. Boucsein Electrodermal activity, 2nd ed. , 2012 .

[10]  G. Ben-Shakhar,et al.  Publication recommendations for electrodermal measurements. , 1981, Psychophysiology.

[11]  Tobias Grossmann,et al.  Physiological and Behavioral Responses Reveal 9-Month-Old Infants’ Sensitivity to Pleasant Touch , 2014, Psychological science.

[12]  Saeed Rahati Quchani,et al.  Analysis of lagged Poincaré plots in heart rate signals during meditation , 2011, Digit. Signal Process..

[13]  Enzo Pasquale Scilingo,et al.  On the deconvolution analysis of electrodermal activity in bipolar patients , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Vernon B. Mountcastle,et al.  The sensory hand : neural mechanisms of somatic sensation , 2005 .

[15]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[16]  Karon E. MacLean,et al.  The Role of Affective Touch in Human-Robot Interaction: Human Intent and Expectations in Touching the Haptic Creature , 2012, Int. J. Soc. Robotics.

[17]  Matteo Bianchi,et al.  Gender-specific velocity recognition of caress-like stimuli through nonlinear analysis of Heart Rate Variability , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  M. Benedek,et al.  Decomposition of skin conductance data by means of nonnegative deconvolution , 2010, Psychophysiology.

[19]  Luca Citi,et al.  Revealing Real-Time Emotional Responses: a Personalized Assessment based on Heartbeat Dynamics , 2014, Scientific Reports.

[20]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[21]  A. Porta,et al.  Symbolic Dynamics of Heart Rate Variability: A Probe to Investigate Cardiac Autonomic Modulation , 2005, Circulation.

[22]  Martin P. Paulus,et al.  The effect of age on neural processing of pleasant soft touch stimuli , 2014, Front. Behav. Neurosci..

[23]  Urban Wiklund,et al.  Touch massage: a pilot study of a complex intervention. , 2013, Nursing in critical care.

[24]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[25]  Alberto Porta,et al.  Symbolic analysis detects alterations of cardiac autonomic modulation in congestive heart failure rats , 2009, Autonomic Neuroscience.

[26]  Marimuthu Palaniswami,et al.  Do existing measures of Poincare plot geometry reflect nonlinear features of heart rate variability? , 2001, IEEE Transactions on Biomedical Engineering.

[27]  J. Wessberg,et al.  Discriminative and Affective Touch: Sensing and Feeling , 2014, Neuron.

[28]  Enzo Pasquale Scilingo,et al.  Oscillations of Heart Rate and Respiration Synchronize During Affective Visual Stimulation , 2012, IEEE Transactions on Information Technology in Biomedicine.

[29]  Dzmitry Tsetserukou,et al.  HaptiHug: A Novel Haptic Display for Communication of Hug over a Distance , 2010, EuroHaptics.

[30]  Matteo Bianchi,et al.  Design and preliminary affective characterization of a novel fabric-based tactile display , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[31]  Luca Citi,et al.  cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing , 2016, IEEE Transactions on Biomedical Engineering.

[32]  D. Bach,et al.  A matching pursuit algorithm for inferring tonic sympathetic arousal from spontaneous skin conductance fluctuations , 2015, Psychophysiology.

[33]  Monica Bordegoni,et al.  Can the feel of the haptic interaction modify a user's emotional state? , 2013, 2013 World Haptics Conference (WHC).

[34]  H. Rüddel,et al.  Spectral analysis of heart rate variability under mental stress. , 1989, Journal of hypertension. Supplement : official journal of the International Society of Hypertension.

[35]  Matteo Bianchi,et al.  Electrodermal activity analysis during affective haptic elicitation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  G. Essick,et al.  Quantitative assessment of pleasant touch , 2010, Neuroscience & Biobehavioral Reviews.

[37]  Siddhartha S. Srinivasa,et al.  Shared Autonomy via Hindsight Optimization , 2015, Robotics: Science and Systems.

[38]  J. Wessberg,et al.  Pleasantness of touch in human glabrous and hairy skin: Order effects on affective ratings , 2011, Brain Research.

[39]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[40]  M. Dawson,et al.  The electrodermal system , 2007 .