Encoded and Crossmodal Thermal Stimulation through a Fingertip-Sized Haptic Display

Haptic displays aim at artificially creating tactile sensations by applying tactile features to the user’s skin. Although thermal perception is a haptic modality it has received scant attention possibly because humans process thermal properties of objects slower than other tactile properties. Yet, thermal feedback is important for material discrimination and has been used to convey thermally-encoded information in environments in which vibrotactile feedback might be masked by noise and/or movements. Moreover, the well-reported influence of temperature over tactile processing makes thermal displays good candidates for the development of crossmodal haptic interfaces, in which temperature is used to manipulate other sensations. Here, we present a thermal display able to render four individually-controlled temperatures at the user’s fingertip along with its technical characterization and psychophysical evaluation. Device performance was assessed in terms of accuracy and repeatability. In the psychophysical evaluation, we first show that the device can render perceivable temperature gradients at the level of the fingertip, thereby extending the concept of thermally-encoded information to fingertip-sized thermal displays. Secondly, we show that increasing temperature improves stiffness precision. Results show that neglected features of thermal feedback, i.e. encoded and crossmodal thermal stimulation, can be provided by fingertip-sized thermal displays to improve haptic manipulations.

[1]  J C Stevens,et al.  How skin and object temperature influence touch sensation , 1982, Perception & psychophysics.

[2]  George Havenith,et al.  Why wet feels wet? A neurophysiological model of human cutaneous wetness sensitivity. , 2014, Journal of neurophysiology.

[3]  S J Bolanowski,et al.  Temperature and criterion effects in a somatosensory subsystem: a neurophysiological and psychophysical study. , 1982, Journal of neurophysiology.

[4]  Y. Zotterman,et al.  The response of mechanoreceptors to thermal stimulation , 1951, The Journal of physiology.

[5]  Bill Becker,et al.  Thermal feedback in virtual reality and telerobotic systems , 1994 .

[6]  P. Matthews,et al.  Texture perception and afferent coding distorted by cooling the human ulnar nerve , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  Lynette A. Jones,et al.  Development and evaluation of a thermal display for material identification and discrimination , 2007, TAP.

[8]  D. Kenshalo,et al.  The temperature sensitivity of the Type I slowly adapting mechanoreceptors in cats and monkeys , 1972, The Journal of physiology.

[9]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[10]  Sungchul Kang,et al.  Compact Tactile Display for Fingertips with Multiple Vibrotactile Actuator and Thermoelectric Module , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[11]  J C Stevens,et al.  Temperature and the two-point threshold. , 1989, Somatosensory & motor research.

[12]  P. Cahusac,et al.  A pharmacological study of slowly adapting mechanoreceptors responsive to cold thermal stimulation , 2007, Neuroscience.

[13]  Y. Mahomed,et al.  Effects of hypothermia on short latency somatosensory evoked potentials in humans. , 1990, Electroencephalography and clinical neurophysiology.

[14]  J C Stevens,et al.  Temperature-touch interaction: Weber's phenomenon revisited. , 1978, Sensory processes.

[15]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[16]  Hsin-Ni Ho,et al.  Modeling the thermal responses of the skin surface during hand-object interactions. , 2008, Journal of biomechanical engineering.

[17]  Astrid M. L. Kappers,et al.  Cues for Haptic Perception of Compliance , 2009, IEEE Transactions on Haptics.

[18]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[19]  K.E. MaClean,et al.  Smart tangible displays in the everyday world: a haptic door knob , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[20]  G Havenith,et al.  Warm temperature stimulus suppresses the perception of skin wetness during initial contact with a wet surface , 2015, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[21]  M. Srinivasan,et al.  Tactual discrimination of softness. , 1995, Journal of neurophysiology.

[22]  S J Lederman,et al.  The effect of skin temperature on the perception of roughness. , 1979, Sensory processes.

[23]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[24]  Dale A. Lawrence,et al.  Performance trade-offs for hand controller design , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[25]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.

[26]  Günther Schmidt,et al.  Display of Holistic Haptic Sensations by Combined Tactile and Kinesthetic Feedback , 2004, Presence: Teleoperators & Virtual Environments.

[27]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[28]  Massimo Bergamasco,et al.  Thermal Feedback in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[29]  Matthew K. Belmonte,et al.  Permutation testing made practical for functional magnetic resonance image analysis , 2001, IEEE Transactions on Medical Imaging.

[30]  Alessandro Soranzo,et al.  MLP: A MATLAB toolbox for rapid and reliable auditory threshold estimation , 2009, Behavior research methods.

[31]  Matteo Bianchi,et al.  Design and control of an air-jet lump display , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[32]  S. Bolanowski,et al.  The effects of skin temperature on the psychophysical responses to vibration on glabrous and hairy skin. , 1986, The Journal of the Acoustical Society of America.

[33]  Akio Yamamoto,et al.  Towards multimodal haptics for teleoperation: Design of a tactile thermal display , 2012, 2012 12th IEEE International Workshop on Advanced Motion Control (AMC).

[34]  Manuel Ferre Haptics: Perception, Devices and Scenarios, 6th International Conference, EuroHaptics 2008, Madrid, Spain, June 10-13, 2008, Proceedings , 2008, EuroHaptics.

[35]  M Nordin,et al.  Peripheral neural correlates of cutaneous anaesthesia induced by skin cooling in man. , 1987, Acta physiologica Scandinavica.

[36]  Akio Yamamoto,et al.  Control of thermal tactile display based on prediction of contact temperature , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[37]  Keehoon Kim,et al.  On the Design of Miniature Haptic Devices for Upper Extremity Prosthetics , 2010, IEEE/ASME Transactions on Mechatronics.

[38]  J C Stevens,et al.  Temperature can sharpen tactile acuity , 1982, Perception & psychophysics.

[39]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[40]  Kathleen H. Sienko,et al.  Directional postural responses induced by vibrotactile stimulations applied to the torso , 2012, Experimental Brain Research.

[41]  Abderrahmane Kheddar,et al.  Learning-Based Thermal Rendering in Telepresence , 2008, EuroHaptics.

[42]  Martin Halvey,et al.  Thermal Feedback Identification in a Mobile Environment , 2013, HAID.

[43]  Shuichi Ino,et al.  A tactile display for presenting quality of materials by changing the temperature of skin surface , 1993, Proceedings of 1993 2nd IEEE International Workshop on Robot and Human Communication.

[44]  Gi-Hun Yang,et al.  Spatial acuity and summation on the hand: The role of thermal cues in material discrimination , 2009, Attention, perception & psychophysics.

[45]  Catherine R Lowrey,et al.  Cooling reduces the cutaneous afferent firing response to vibratory stimuli in glabrous skin of the human foot sole. , 2013, Journal of neurophysiology.

[46]  G Hempelmann,et al.  Effects of hypothermia on somatosensory evoked responses in man. , 1987, British journal of anaesthesia.

[47]  G. B. Wetherill,et al.  SEQUENTIAL ESTIMATION OF POINTS ON A PSYCHOMETRIC FUNCTION. , 1965, The British journal of mathematical and statistical psychology.

[48]  D. Kenshalo,et al.  Spatial summation on the forehead, forearm, and back produced by radiant and conducted heat. , 1967, Journal of comparative and physiological psychology.

[49]  Barbara Harazin,et al.  Effect of changes in finger skin temperature on vibrotactile perception threshold. , 2007, International journal of occupational medicine and environmental health.

[50]  A. Kappers,et al.  Thermosensory reversal effect quantified. , 2008, Acta psychologica.

[51]  George Havenith,et al.  The role of decreasing contact temperatures and skin cooling in the perception of skin wetness , 2013, Neuroscience Letters.

[52]  A. Kappers,et al.  Tactile perception of thermal diffusivity , 2009, Attention, perception & psychophysics.

[53]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[54]  Øyvind Stavdahl,et al.  Design and Performance of a Prototype Tactile Shape Display for Minimally Invasive Surgery , 2008 .