Feeling the Temperature of the Room

Thermal signals have been explored in HCI for emotion-elicitation and enhancing two-person communication, showing that temperature invokes social and emotional signals in individuals. Yet, extending these findings to group communication is missing. We investigated how thermal signals can be used to communicate group affective states in a hybrid meeting scenario to help people feel connected over a distance. We conducted a lab study (N=20 participants) and explored wrist-worn thermal feedback to communicate audience emotions. Our results show that thermal feedback is an effective method of conveying audience engagement without increasing workload and can help a presenter feel more in tune with the audience. We outline design implications for real-world wearable social thermal feedback systems for both virtual and in-person communication that support group affect communication and social connectedness. Thermal feedback has the potential to connect people across distances and facilitate more effective and dynamic communication in multiple contexts.

[1]  J. V. van Dijk Zooming in on embodied social sensemaking: Mapping the design space in the context of videoconferencing , 2022, Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction.

[2]  Jintu Fan,et al.  Development of wearable air-conditioned mask for personal thermal management , 2021, Building and Environment.

[3]  Corina Sas,et al.  Exploring Personalized Vibrotactile and Thermal Patterns for Affect Regulation , 2021, Conference on Designing Interactive Systems.

[4]  Bruce H. Thomas,et al.  Bringing the Jury to the Scene of the Crime: Memory and Decision-Making in a Simulated Crime Scene , 2021, CHI.

[5]  Daniel McDuff,et al.  AffectiveSpotlight: Facilitating the Communication of Affective Responses from Audience Members during Online Presentations , 2021, CHI.

[6]  Jonna Häkkilä,et al.  Perceptions of human shadow manipulation as an ambient display , 2020, PerDis.

[7]  Abdallah El Ali,et al.  ThermalWear: Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with Affect , 2020, CHI.

[8]  Luis Cavazos Quero,et al.  Exploring Thermal Interaction for Visual Art Color Appreciation for the Visually Impaired People , 2020, 2020 International Conference on Electronics, Information, and Communication (ICEIC).

[9]  Daniela Elisabeth Ströckl,et al.  Hedonic and Pragmatic Qualities of AAL Pilot Region Technologies: Evaluation with the AttrakDiff Survey , 2020, ICT4AWE.

[10]  Kening Zhu,et al.  Thermo-haptic Earable Display for the Hearing and Visually Impaired , 2019, ASSETS.

[11]  Astrid Maria Louise Kappers,et al.  Thermal Perception and Thermal Devices Used on Body Parts Other Than Hand or Face , 2019, IEEE Transactions on Haptics.

[12]  Kening Zhu,et al.  A sense of ice and fire: Exploring thermal feedback with multiple thermoelectric-cooling elements on a smart ring , 2019, Int. J. Hum. Comput. Stud..

[13]  Kenton O'Hara,et al.  Hybrid Meetings in the Modern Workplace: Stories of Success and Failure , 2019, CRIWG/CollabTech.

[14]  Weidong Huang,et al.  Sharing Emotion by Displaying a Partner Near the Gaze Point in a Telepresence System , 2019, 2019 23rd International Conference in Information Visualization – Part II.

[15]  Corina Sas,et al.  Towards Affective Chronometry: Exploring Smart Materials and Actuators for Real-time Representations of Changes in Arousal , 2019, Conference on Designing Interactive Systems.

[16]  Albrecht Schmidt,et al.  Designing Thermal Feedback for Notifying Users About Stress , 2019, Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare - Demos and Posters.

[17]  Fillia Makedon,et al.  A wearable system for unobtrusive mood detection , 2019, PETRA.

[18]  O. Wolf,et al.  An oral presentation causes stress and memory impairments , 2019, Psychoneuroendocrinology.

[19]  Albrecht Schmidt,et al.  Stressed by Design?: The Problems of Transferring Interaction Design from Workstations to Mobile Interfaces , 2019, PervasiveHealth.

[20]  Robert Richer,et al.  An Overview of the Feasibility of Permanent, Real-Time, Unobtrusive Stress Measurement with Current Wearables , 2019, PervasiveHealth.

[21]  Giulio Jacucci,et al.  Explicating "Implicit Interaction": An Examination of the Concept and Challenges for Research , 2019, CHI.

[22]  Elena Di Lascio,et al.  Using Unobtrusive Wearable Sensors to Measure the Physiological Synchrony Between Presenters and Audience Members , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[23]  Tetsuo Kurahashi,et al.  TherModule: Wearable and Modular Thermal Feedback System based on a Wireless Platform , 2019, AH.

[24]  Alois Ferscha,et al.  EyeControl: Towards Unconstrained Eye Tracking in Industrial Environments , 2018, SUI.

[25]  Elena Di Lascio,et al.  Unobtrusive Assessment of Students' Emotional Engagement during Lectures Using Electrodermal Activity Sensors , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[26]  Albrecht Schmidt,et al.  RainSense: exploring the concept of a sense for weather awareness , 2018, MobileHCI Adjunct.

[27]  Wolfgang Rosenstiel,et al.  The art of pervasive eye tracking: unconstrained eye tracking in the Austrian Gallery Belvedere , 2018, PETMEI@ETRA.

[28]  Niels Henze,et al.  A Design Space for Audience Sensing and Feedback Systems , 2018, CHI Extended Abstracts.

[29]  Jun Rekimoto,et al.  Sync Class: Visualization System for In-Class Student Synchronization , 2018, AH.

[30]  Jordan Tewell,et al.  Augmenting communication technologies with non-primary sensory modalities , 2018 .

[31]  Sławomir Postek,et al.  From metaphorical information overflow and overload to real stress: Theoretical background, empirical findings, and applications , 2017 .

[32]  Hui Zhang,et al.  Augmenting Smart Buildings and Autonomous Vehicles with Wearable Thermal Technology , 2017, HCI.

[33]  Lynne Baillie,et al.  Using Thermal Stimuli to Enhance Photo-Sharing in Social Media , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[34]  Arindam Dey,et al.  Empathic Mixed Reality: Sharing What You Feel and Interacting with What You See , 2017, 2017 International Symposium on Ubiquitous Virtual Reality (ISUVR).

[35]  Niels Henze,et al.  EngageMeter: A System for Implicit Audience Engagement Sensing Using Electroencephalography , 2017, CHI.

[36]  Jordan Tewell,et al.  The Heat is On: A Temperature Display for Conveying Affective Feedback , 2017, CHI.

[37]  Alexander Travis Adams,et al.  EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions , 2016, UbiComp.

[38]  Stephen A. Brewster,et al.  Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion , 2016, CHI.

[39]  Saskia Bakker,et al.  Introduction:framing peripheral interaction , 2016 .

[40]  Gwenn Englebienne,et al.  How Was It?: Exploiting Smartphone Sensing to Measure Implicit Audience Responses to Live Performances , 2015, ACM Multimedia.

[41]  Ian Oakley,et al.  Hot & tight: exploring thermo and squeeze cues recognition on wrist wearables , 2015, SEMWEB.

[42]  Vivian Genaro Motti,et al.  An overview of wearable applications for healthcare: requirements and challenges , 2015, UbiComp/ISWC Adjunct.

[43]  A. Bachrach,et al.  Audience entrainment during live contemporary dance performance: physiological and cognitive measures , 2015, Front. Hum. Neurosci..

[44]  Stephen A. Brewster,et al.  In the Heat of the Moment: Subjective Interpretations of Thermal Feedback During Interaction , 2015, CHI.

[45]  Hugo D. Critchley,et al.  You Turn Me Cold: Evidence for Temperature Contagion , 2014, PloS one.

[46]  Rosalind W. Picard,et al.  Empatica E3 — A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition , 2014, 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH).

[47]  John R. Kender,et al.  Correlating Speaker Gestures in Political Debates with Audience Engagement Measured via EEG , 2014, ACM Multimedia.

[48]  H. Ijzerman,et al.  Perceptual symbols of creativity: coldness elicits referential, warmth elicits relational creativity. , 2014, Acta psychologica.

[49]  Andreas Bulling,et al.  Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction , 2014, UbiComp Adjunct.

[50]  Sebastian Löhmann,et al.  Everyday peripheral tasks vs. digital peripheral tasks , 2014, CHI Extended Abstracts.

[51]  Carmen C. Y. Poon,et al.  Unobtrusive Sensing and Wearable Devices for Health Informatics , 2014, IEEE Transactions on Biomedical Engineering.

[52]  Geoff Hulten,et al.  Measuring the engagement level of TV viewers , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[53]  Valentin Zacharias,et al.  Live interest meter: learning from quantified feedback in mass lectures , 2013, LAK '13.

[54]  Saskia Bakker Design for peripheral interaction , 2013 .

[55]  Gwenn Englebienne,et al.  Mining for motivation: using a single wearable accelerometer to detect people's interests , 2012, IMMPD '12.

[56]  Martin Halvey,et al.  Thermal icons: evaluating structured thermal feedback for mobile interaction , 2012, Mobile HCI.

[57]  Marcello Gallucci,et al.  Cold-blooded loneliness: social exclusion leads to lower skin temperatures. , 2012, Acta psychologica.

[58]  Doris Hausen,et al.  Peripheral interaction: facilitating interaction with secondary tasks , 2012, TEI.

[59]  Celine Latulipe,et al.  Love, hate, arousal and engagement: exploring audience responses to performing arts , 2011, CHI.

[60]  Martin Halvey,et al.  Some like it hot: thermal feedback for mobile devices , 2011, CHI.

[61]  Joseph A. Bulbulia,et al.  Synchronized arousal between performers and related spectators in a fire-walking ritual , 2011, Proceedings of the National Academy of Sciences.

[62]  J. Gross,et al.  The temporal dynamics of emotion regulation: An EEG study of distraction and reappraisal , 2011, Biological Psychology.

[63]  Gün R. Semin,et al.  Temperature perceptions as a ground for social proximity , 2010 .

[64]  Frank Asbrock,et al.  Stereotypes of social groups in Germany in terms of warmth and competence. , 2010 .

[65]  Simona Sacchi,et al.  The Effects of Status on Perceived Warmth and Competence Malleability of the Relationship Between Status and Stereotype Content , 2010 .

[66]  Wonjun Lee,et al.  Thermo-message: exploring the potential of heat as a modality of peripheral expression , 2010, CHI Extended Abstracts.

[67]  Javier Jaimovich,et al.  Contagion of Physiological Correlates of Emotion between Performer and Audience: An Exploratory Study , 2010, B-Interface.

[68]  Woohun Lee,et al.  Designing unobtrusive interfaces with minimal presence , 2009, CHI Extended Abstracts.

[69]  J. Bargh,et al.  Experiencing Physical Warmth Promotes Interpersonal Warmth , 2008, Science.

[70]  Wendy Ju,et al.  The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious , 2008, Design Issues.

[71]  Clifford A. Smith,et al.  A short-form of the Personal Report of Confidence as a Speaker , 2008 .

[72]  Adam Danielsson,et al.  A thermal information display for mobile applications , 2007, Mobile HCI.

[73]  Mats Eklöf,et al.  Prevalence of perceived stress, symptoms of depression and sleep disturbances in relation to information and communication technology (ICT) use among young adults - an explorative prospective study , 2007, Comput. Hum. Behav..

[74]  Catherine J. Stevens,et al.  Methods for measuring audience reactions , 2007 .

[75]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[76]  L. Barsalou,et al.  Embodiment in Attitudes, Social Perception, and Emotion , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[77]  Lars-Göran Nilsson,et al.  The novelty effect: support for the Novelty-Encoding Hypothesis. , 2005, Scandinavian journal of psychology.

[78]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[79]  Kazushi Nishimoto,et al.  Lovelet: a heartwarming communication tool for intimate people by constantly conveying situation data , 2004, CHI EA '04.

[80]  Michael Burmester,et al.  AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität , 2003, MuC.

[81]  Jun Rekimoto,et al.  GestureWrist and GesturePad: unobtrusive wearable interaction devices , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[82]  G. Lakoff,et al.  Philosophy in the flesh : the embodied mind and its challenge to Western thought , 1999 .

[83]  John Seely Brown,et al.  The coming age of calm technolgy , 1997 .

[84]  Peter J. Denning,et al.  Beyond calculation - the next fifty years of computing , 1997 .

[85]  Michael W. Eysenck,et al.  Distraction and cognitive performance. , 1989 .

[86]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[87]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[88]  J. V. Bradley Complete Counterbalancing of Immediate Sequential Effects in a Latin Square Design , 1958 .

[89]  S. Asch Forming impressions of personality. , 1946, Journal of abnormal psychology.