The Impact of Thermal Cues on Affective Responses to Emotionally Resonant Vibrations

This paper investigates how presenting emotionally resonant vibrotactile stimuli at cool, neutral and warm temperature levels impacts mean ratings for emotional resonance and affective response. Affective vibrotactile stimuli can elicit pleasant or calming responses, making them applicable for emotion regulation. Evoking real-world sensations via emotional resonance can widen their affective range and improve their effectiveness, and allow them to enhance immersive multimodal experiences. Thermotactile cues have been shown to affect emotional responses, but have not been combined with emotionally resonant vibrations to see how they change responses to such cues. This study (n=20) assessed the impact of 3 temperature levels (24℃, 30℃, and 34℃) on 15 emotionally resonant vibrotactile cues and observed if emotionally resonant stimuli exceeded the affective range non-resonant vibrotactile stimuli. The findings suggest that presenting specific resonant vibrations at temperatures that are appropriate for the sensation they evoke can improve emotional resonance and vice versa. In addition, temperature had a positive effect on affective response and emotionally resonant vibrations were found to have a wider affective range than traditional vibrotactile cues. These findings support using emotionally resonant vibrations and thermal cues to elicit desirable emotional responses in emotion regulation and immersive media applications.

[1]  P. Maes,et al.  EmbER: A System for Transfer of Interoceptive Sensations to Improve Social Perception , 2022, Conference on Designing Interactive Systems.

[2]  Frank E. Pollick,et al.  User Preferences for Calming Affective Haptic Stimuli in Social Settings , 2021, ICMI.

[3]  T. McDaniel,et al.  Emotional Response to Vibrothermal Stimuli , 2021, Applied Sciences.

[4]  N. Miki,et al.  The effect of haptic stimulation simulating heartbeats on the regulation of physiological responses and prosocial behavior under stress: The influence of interoceptive accuracy , 2021, Biological Psychology.

[5]  Corina Sas,et al.  Exploring Personalized Vibrotactile and Thermal Patterns for Affect Regulation , 2021, Conference on Designing Interactive Systems.

[6]  Jonathan Rossiter,et al.  FeelMusic: Enriching Our Emotive Experience of Music through Audio-Tactile Mappings , 2021, Multimodal Technol. Interact..

[7]  Stephen Brewster,et al.  Eliciting Emotion with Vibrotactile Stimuli Evocative of Real-World Sensations , 2020, ICMI.

[8]  Lee Skrypchuk,et al.  Purring Wheel: Thermal and Vibrotactile Notifications on the Steering Wheel , 2020, ICMI.

[9]  Janella N Hudson,et al.  Robotic Pet Use Among Community-Dwelling Older Adults , 2020, The journals of gerontology. Series B, Psychological sciences and social sciences.

[10]  Monica Perusquía-Hernández,et al.  Robot Mirroring: Promoting Empathy with an Artificial Agent by Reflecting the User’s Physiological Affective States , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[11]  Hong Z. Tan,et al.  palmScape: Calm and Pleasant Vibrotactile Signals , 2020, HCI.

[12]  Keith Marzullo,et al.  Evaluating a Personalizable, Inconspicuous Vibrotactile(PIV) Breathing Pacer for In-the-Moment Affect Regulation , 2020, CHI.

[13]  Kyung Yun Choi,et al.  ambienBeat: Wrist-worn Mobile Tactile Biofeedback for Heart Rate Rhythmic Regulation , 2020, TEI.

[14]  Malte F. Jung,et al.  BoostMeUp: Improving Cognitive Performance in the Moment by Unobtrusively Regulating Emotions with a Smartwatch , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[15]  Mina Shibasaki,et al.  Haptic Remembrance Book Series , 2019, CHI Extended Abstracts.

[16]  O. Korolkova,et al.  Emotions associated with different textures during touch , 2019, Consciousness and Cognition.

[17]  Ali Israr,et al.  A social haptic device to create continuous lateral motion using sequential normal indentation , 2018, 2018 IEEE Haptics Symposium (HAPTICS).

[18]  Seungmoon Choi,et al.  Emotional responses of vibrotactile-thermal stimuli: Effects of constant-temperature thermal stimuli , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[19]  Friederike Eyssel,et al.  Intensifying Emotional Reactions via Tactile Gestures in Immersive Films , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[20]  M. Tsakiris,et al.  The calming effect of a new wearable device during the anticipation of public speech , 2017, Scientific Reports.

[21]  Katherine Isbister,et al.  HapLand: A Scalable Robust Emotion Regulation Haptic System Testbed , 2017, CHI Extended Abstracts.

[22]  Stephen A. Brewster,et al.  Multi-moji: Combining Thermal, Vibrotactile & Visual Stimuli to Expand the Affective Range of Feedback , 2017, CHI.

[23]  Jordan Tewell,et al.  The Heat is On: A Temperature Display for Conveying Affective Feedback , 2017, CHI.

[24]  Stephen A. Brewster,et al.  Multimodal affective feedback: combining thermal, vibrotactile, audio and visual signals , 2016, ICMI.

[25]  Eve E. Hoggan,et al.  Reach out and touch me: effects of four distinct haptic technologies on affective touch in virtual reality , 2016, ICMI.

[26]  Jussi Rantala,et al.  Good vibes: the impact of haptic patterns on stress levels , 2016, MindTrek.

[27]  Aduén Darriba Frederiks,et al.  Simulating Affective Touch: Using a Vibrotactile Array to Generate Pleasant Stroking Sensations , 2016, EuroHaptics.

[28]  Lynne Baillie,et al.  The Effect of Thermal Stimuli on the Emotional Perception of Images , 2016, CHI.

[29]  Stephen A. Brewster,et al.  Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion , 2016, CHI.

[30]  Seungmoon Choi,et al.  Emotional responses of tactile icons: Effects of amplitude, frequency, duration, and envelope , 2015, 2015 IEEE World Haptics Conference (WHC).

[31]  Stephen A. Brewster,et al.  In the Heat of the Moment: Subjective Interpretations of Thermal Feedback During Interaction , 2015, CHI.

[32]  Sriram Subramanian,et al.  Emotions Mediated Through Mid-Air Haptics , 2015, CHI.

[33]  Ali Israr,et al.  Feel Effects , 2014, ACM Trans. Appl. Percept..

[34]  Roope Raisamo,et al.  Cold or Hot? How Thermal Stimuli Are Related to Human Emotional System? , 2013, HAID.

[35]  Martin Halvey,et al.  "Baby it's cold outside": the influence of ambient temperature and humidity on thermal feedback , 2012, CHI.

[36]  Roope Raisamo,et al.  Emotional responses to thermal stimuli , 2011, ICMI '11.

[37]  Brent A Bauer,et al.  Effect of the combination of music and nature sounds on pain and anxiety in cardiac surgical patients: a randomized study. , 2011, Alternative therapies in health and medicine.

[38]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[39]  Deltcho Valtchanov,et al.  Restorative Effects of Virtual Nature Settings , 2010, Cyberpsychology Behav. Soc. Netw..

[40]  Takanori Shibata,et al.  Investigation on people living with Paro at home , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[41]  Suguru Higashino,et al.  "Hiya-Atsu" media: augmenting digital media with temperature , 2009, CHI Extended Abstracts.

[42]  Y. Arai,et al.  Intra‐operative natural sound decreases salivary amylase activity of patients undergoing inguinal hernia repair under epidural anesthesia , 2008, Acta anaesthesiologica Scandinavica.

[43]  Roope Raisamo,et al.  Emotional and behavioral responses to haptic stimulation , 2008, CHI.

[44]  L. Handscomb,et al.  Use of bedside sound generators by patients with tinnitus-related sleeping difficulty: which sounds are preferred and why? , 2006, Acta oto-laryngologica. Supplementum.

[45]  A Asada,et al.  Relaxing intraoperative natural sound blunts haemodynamic change at the emergence from propofol general anaesthesia and increases the acceptability of anaesthesia to the patient , 2003, Acta anaesthesiologica Scandinavica.

[46]  Terry L. Maple,et al.  The Effects of Ecologically‐Relevant Sounds on Zoo Visitors , 1993 .

[47]  J. Russell A circumplex model of affect. , 1980 .

[48]  Matteo Bianchi,et al.  On the Role of Affective Properties in Hedonic and Discriminant Haptic Systems , 2017, Int. J. Soc. Robotics.

[49]  Steve Yohanan,et al.  The Haptic Creature : social human-robot interaction through affective touch , 2012 .