The Role of Haptic Stimuli on Affective Reading: a Pilot Study

The affective role of touch has opened new perspectives in human-machine interaction. This paper presents an emotion recognition algorithm to investigate the role of tactile stimuli conveyed through a wearable haptic system during affective reading. To this end, a group of 32 healthy volunteers underwent an emotional stimulation by reading affective texts, with and without the concurrent presence of pleasant haptic stimuli. Throughout the experiment, autonomic nervous system dynamics was quantified through heart rate variability (HRV) and electrodermal activity (EDA) analyses. EDA and HRV features were then used as input of a SVM-RFE learning algorithm for an automatic recognition of neutral and arousing texts. The affective recognition of the reading was performed in the presence or absence of the haptic stimulation. Results show that the affective perception induced by the neutral and arousing reading were discriminated with a significantly improved accuracy (+14.5%) when a caress-like haptic stimulus was conveyed to the user.

[1]  Matthew J. Hertenstein.  Touch: Its Communicative Functions in Infancy , 2002, Human Development.

[2]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[3]  M. Benedek,et al.  Decomposition of skin conductance data by means of nonnegative deconvolution , 2010, Psychophysiology.

[4]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[5]  Björn W. Schuller,et al.  Automatic recognition of physiological parameters in the human voice: Heart rate and skin conductance , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  E. Scilingo,et al.  Arousal and Valence Recognition of Affective Sounds Based on Electrodermal Activity , 2017, IEEE Sensors Journal.

[7]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[8]  T. Baumgartner,et al.  From emotion perception to emotion experience: emotions evoked by pictures and classical music. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  Luca Citi,et al.  cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing , 2016, IEEE Transactions on Biomedical Engineering.

[10]  Matteo Bianchi,et al.  On the Role of Affective Properties in Hedonic and Discriminant Haptic Systems , 2017, Int. J. Soc. Robotics.

[11]  Graham Clarke,et al.  A user-independent real-time emotion recognition system for software agents in domestic environments , 2007, Eng. Appl. Artif. Intell..

[12]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[13]  Matteo Bianchi,et al.  EEG oscillations during caress-like affective haptic elicitation. , 2018, Psychophysiology.

[14]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[15]  David Zhang,et al.  Feature selection and analysis on correlated gas sensor data with recursive feature elimination , 2015 .

[16]  Luca Citi,et al.  Force–Velocity Assessment of Caress-Like Stimuli Through the Electrodermal Activity Processing: Advantages of a Convex Optimization Approach , 2017, IEEE Transactions on Human-Machine Systems.

[17]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[18]  Andrea Lockerd Thomaz,et al.  An Investigation of Responses to Robot-Initiated Touch in a Nursing Context , 2014, Int. J. Soc. Robotics.

[19]  Vincent Hayward,et al.  Physical Factors Influencing Pleasant Touch during Tactile Exploration , 2013, PloS one.

[20]  Matteo Bianchi,et al.  Brain Dynamics Induced by Pleasant/Unpleasant Tactile Stimuli Conveyed by Different Fabrics , 2019, IEEE Journal of Biomedical and Health Informatics.

[21]  Sunghwan Mac Kim,et al.  EMOTIONS IN TEXT: DIMENSIONAL AND CATEGORICAL MODELS , 2013, Comput. Intell..

[22]  Simona Casini,et al.  Design and realization of the CUFF - clenching upper-limb force feedback wearable device for distributed mechano-tactile stimulation of normal and tangential skin forces , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  G. Valenza,et al.  Inhomogeneous Point-Processes to Instantaneously Assess Affective Haptic Perception through Heartbeat Dynamics Information , 2016, Scientific Reports.

[24]  Kewei Chen,et al.  Neural correlates of heart rate variability during emotion , 2009, NeuroImage.

[25]  J. Gratch,et al.  The Affective Computing Approach to Affect Measurement , 2018 .

[26]  Jelena Mladenovic,et al.  Considering Gut Biofeedback for Emotion Regulation , 2018, UbiComp/ISWC Adjunct.

[27]  E. Rolls.  The affective and cognitive processing of touch, oral texture, and temperature in the brain , 2010, Neuroscience & Biobehavioral Reviews.

[28]  Manuel G. Catalano,et al.  Simplifying Telerobotics: Wearability and Teleimpedance Improves Human-Robot Interactions in Teleoperation , 2018, IEEE Robotics & Automation Magazine.