ThermAirGlove: A Pneumatic Glove for Thermal Perception and Material Identification in Virtual Reality

We present ThermAirGlove (TAGlove), a pneumatic glove which provides thermal feedback for users, to support the haptic experience of grabbing objects of different temperatures and materials in virtual reality (VR). The system consists of a glove with five inflatable airbags on the fingers and the palm, two temperature chambers (one hot and one cold), and the closed-loop pneumatic thermal control system. Our technical experiments showed that the highest temperature-changing speed of TAGlove system was 2.75°C/s for cooling, and the pneumatic-control mechanism could generate the thermal cues of different materials (e.g., foam, glass, copper, etc.). The user-perception experiments showed that the TAGlove system could provide five distinct levels of thermal sensation (ranging from very cool to very warm). The user-perception experiments also showed that the TAGlove could support users’ material identification among foam, glass, and copper with the average accuracy of 87.2%, with no significant difference compared to perceiving the real physical objects. The user studies on VR experience showed that using TAGlove in immersive VR could significantly improve users’ experience of presence compared to the situations without any temperature or material simulation.

[1]  Jordan Tewell,et al.  The Heat is On: A Temperature Display for Conveying Affective Feedback , 2017, CHI.

[2]  Masamichi Sakaguchi,et al.  Development of High-Speed Thermal Display Using Water Flow , 2014, HCI.

[3]  Eyal Ofek,et al.  CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality , 2018, CHI.

[4]  Shuichi Ino,et al.  A tactile display for presenting quality of materials by changing the temperature of skin surface , 1993, Proceedings of 1993 2nd IEEE International Workshop on Robot and Human Communication.

[5]  Sean Follmer,et al.  Wolverine: A Wearable Haptic Interface for Grasping in VR , 2016, UIST.

[6]  Adam Danielsson,et al.  A thermal information display for mobile applications , 2007, Mobile HCI.

[7]  Ellen Yi-Luen Do,et al.  Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience , 2018, CHI.

[8]  Glyn Lawson,et al.  The Heat is On: Exploring User Behaviour in a Multisensory Virtual Environment for Fire Evacuation , 2019, CHI.

[9]  Hsin-Ni Ho,et al.  Material recognition based on thermal cues: Mechanisms and applications , 2017, Temperature.

[10]  Wei Peng,et al.  ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays , 2017, CHI.

[11]  Kening Zhu,et al.  A sense of ice and fire: Exploring thermal feedback with multiple thermoelectric-cooling elements on a smart ring , 2019, Int. J. Hum. Comput. Stud..

[12]  Da-Yuan Huang,et al.  PuPoP: Pop-up Prop on Palm for Virtual Reality , 2018, UIST.

[13]  Kening Zhu,et al.  HapTwist: creating interactive haptic proxies in virtual reality using low-cost twistable artefacts , 2018, SIGGRAPH 2018.

[14]  Alex Olwal,et al.  Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality , 2017, UIST.

[15]  J. Lienhard.  A heat transfer textbook , 1981 .

[16]  Lynette A. Jones,et al.  Material discrimination and thermal perception , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[17]  Edward Cutrell,et al.  "Yours is better!": participant response bias in HCI , 2012, CHI.

[18]  Antonio Krüger,et al.  Drag:on: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift , 2019, CHI.

[19]  Gi-Hun Yang,et al.  Use of Simulated Thermal Cues for Material Discrimination and Identification with a Multi-Fingered Display , 2008, PRESENCE: Teleoperators and Virtual Environments.

[20]  J.C. Perry,et al.  Upper-Limb Powered Exoskeleton Design , 2007, IEEE/ASME Transactions on Mechatronics.

[21]  Martin Halvey,et al.  The effect of clothing on thermal feedback perception , 2011, ICMI '11.

[22]  L.A. Jones,et al.  Material identification using real and simulated thermal cues , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Takuji Narumi,et al.  Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model , 2019, CHI.

[24]  Hsin-Ni Ho,et al.  Modeling the thermal responses of the skin surface during hand-object interactions. , 2008, Journal of biomechanical engineering.

[25]  Kouta Minamizawa,et al.  LiquidReality: Wetness Sensations on the Face for Virtual Reality , 2018, EuroHaptics.

[26]  Hsin-Ni Ho,et al.  Contribution of thermal cues to material discrimination and localization , 2006, Perception & psychophysics.

[27]  Ellen Yi-Luen Do,et al.  Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions , 2017, CHI.

[28]  Darwin G. Caldwell,et al.  Enhanced tactile feedback (tele-taction) using a multi-functional sensory system , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[29]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[30]  Andreas Butz,et al.  Reproducing materials of virtual elements on touchscreens using supplemental thermal feedback , 2012, ICMI '12.

[31]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[32]  Martin Halvey,et al.  Some like it hot: thermal feedback for mobile devices , 2011, CHI.

[33]  Martin Halvey,et al.  "Baby it's cold outside": the influence of ambient temperature and humidity on thermal feedback , 2012, CHI.

[34]  Antonio Frisoli,et al.  A High Performance Thermal Control for Simulation of Different Materials in a Fingertip Haptic Device , 2018, EuroHaptics.

[35]  M. Mon-Williams,et al.  Feedback and motor skill acquisition using a haptic dental simulator , 2017, European journal of dental education : official journal of the Association for Dental Education in Europe.

[36]  Kouta Minamizawa,et al.  ThermalBracelet: Exploring Thermal Haptic Feedback Around the Wrist , 2019, CHI.

[37]  Kouta Minamizawa,et al.  Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics , 2017, SIGGRAPH Posters.

[38]  Bin Zheng,et al.  Prevailing Trends in Haptic Feedback Simulation for Minimally Invasive Surgery , 2016, Surgical innovation.

[39]  Osamu Oshiro,et al.  Non-contact Cold Thermal Display by Controlling Low-temperature Air Flow Generated with Vortex Tube , 2019, 2019 IEEE World Haptics Conference (WHC).

[40]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[41]  Takuji Narumi,et al.  PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions , 2019, CHI.

[42]  Tovi Grossman,et al.  HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow , 2018, UIST.

[43]  Lynette A. Jones,et al.  Creating Thermal Icons—A Model-Based Approach , 2018, ACM Trans. Appl. Percept..

[44]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.

[45]  Jordan Tewell,et al.  Heat-Nav: Using Temperature Changes as Navigation Cues , 2017, CHI.

[46]  Martin Halvey,et al.  Thermal icons: evaluating structured thermal feedback for mobile interaction , 2012, Mobile HCI.

[47]  Kening Zhu,et al.  Thermo-haptic Earable Display for the Hearing and Visually Impaired , 2019, ASSETS.

[48]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[49]  Takashi Maeno,et al.  Presentation of Sudden Temperature Change Using Spatially Divided Warm and Cool Stimuli , 2012, EuroHaptics.

[50]  Katsunari Sato,et al.  Augmentation of Thermal Sensation on Finger Pad Using Stimuli for Finger Side , 2016, EuroHaptics.

[51]  Lynette A. Jones,et al.  The psychophysics of temperature perception and thermal-interface design , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.