Material Recognition via Heat Transfer Given Ambiguous Initial Conditions

Humans and robots can recognize materials with distinct thermal effusivities by making physical contact and observing temperatures during heat transfer. This works well with room temperature materials and humans and robots at human body temperatures. Past research has shown that cooling or heating a material can result in temperatures that are similar to contact with another material. To thoroughly investigate this perceptual ambiguity, we designed a psychophysical experiment in which a participant discriminates between two materials given ambiguous initial conditions. We conducted a study with 32 human participants and a robot. Humans and the robot confused the materials. We also found that robots can overcome this ambiguity using two temperature sensors with different temperatures prior to contact. We support this conclusion based on a mathematical proof using a heat transfer model and empirical results in which a robot achieved 100% accuracy compared to 5% human accuracy. Our results also indicate that robots can use subtle cues to distinguish thermally ambiguous materials with a single temperature sensor. Overall, our work provides insights into challenging conditions for material recognition via heat transfer, and suggests methods by which robots can overcome these challenges to outperform humans.

[1]  K. Offord,et al.  Description of “Minnesota Thermal Disks” and normal values of cutaneous thermal discrimination in man , 1974, Neurology.

[2]  Koh Hosoda,et al.  Robust material discrimination by a soft anthropomorphic finger with tactile and thermal sense , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Charles C. Kemp,et al.  Material Recognition from Heat Transfer given Varying Initial Conditions and Short-Duration Contact , 2015, Robotics: Science and Systems.

[4]  Abderrahmane Kheddar,et al.  Theoretical and experimental study of a heat transfer model for thermal feedback in virtual environments , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  B. O'Shaughnessy The sense of touch , 1989 .

[6]  Hsin-Ni Ho,et al.  Contribution of thermal cues to material discrimination and localization , 2006, Perception & psychophysics.

[7]  W. B. Tiest Tactual perception of material properties , 2010, Vision Research.

[8]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.

[9]  B. Green,et al.  Temperature perception and nociception. , 2004, Journal of neurobiology.

[10]  W. M. Bergmann Tiest,et al.  An Experimentally Verified Model of the Perceived 'Coldness' of Objects , 2007, WHC.

[11]  Judy Czylok A SENSE OF TOUCH , 1979, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[12]  S. S. Stevens,et al.  Warmth and cold: dynamics of sensory intensity. , 1960, Journal of experimental psychology.

[13]  Y. Çengel Heat and Mass Transfer: Fundamentals and Applications , 2000 .

[14]  Q. Mcnemar Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[15]  I. Shimoyama,et al.  Material discrimination by heat flow sensing , 2009, TRANSDUCERS 2009 - 2009 International Solid-State Sensors, Actuators and Microsystems Conference.

[16]  Trevor Darrell,et al.  Robotic learning of haptic adjectives through physical interaction , 2015, Robotics Auton. Syst..

[17]  T. Martin McGinnity,et al.  Material classification based on thermal properties — A robot and human evaluation , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[18]  Akio Yamamoto,et al.  Control of thermal tactile display based on prediction of contact temperature , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  C. Dunnett,et al.  Significance testing to establish equivalence between treatments, with special reference to data in the form of 2X2 tables. , 1977, Biometrics.

[20]  Charles C. Kemp,et al.  Data-driven thermal recognition of contact with people and objects , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[21]  Leslie D. Montgomery,et al.  Effect of ambient temperature on the thermal profile of the human forearm, hand, and fingers , 2006, Annals of Biomedical Engineering.

[22]  A. Kappers,et al.  Tactile perception of thermal diffusivity , 2009, Attention, perception & psychophysics.

[23]  K. M. Dallenbach,et al.  The Experience of Heat , 1927 .

[24]  Shuichi Ino,et al.  A tactile display for presenting quality of materials by changing the temperature of skin surface , 1993, Proceedings of 1993 2nd IEEE International Workshop on Robot and Human Communication.

[25]  Advait Jain,et al.  Reaching in clutter with whole-arm tactile sensing , 2013, Int. J. Robotics Res..

[26]  Tetsuya Yamada,et al.  Measurement of Thermal Effusivity of Human Skin Using the Photoacoustic Method , 2010 .

[27]  Donald J. Schuirmann A comparison of the Two One-Sided Tests Procedure and the Power Approach for assessing the equivalence of average bioavailability , 1987, Journal of Pharmacokinetics and Biopharmaceutics.

[28]  A Donner,et al.  Application of the McNemar test to non-independent matched pair data. , 1991, Statistics in medicine.

[29]  Charles C. Kemp,et al.  Multimodal Tactile Perception of Objects in a Real Home , 2018, IEEE Robotics and Automation Letters.

[30]  Hsin-Ni Ho,et al.  Material recognition based on thermal cues: Mechanisms and applications , 2017, Temperature.

[31]  Deukwoo Kwon,et al.  Non‐inferiority tests for clustered matched‐pair data , 2009, Statistics in medicine.

[32]  Jun-mo Nam,et al.  Power and sample size requirements for non-inferiority in studies comparing two matched proportions where the events are correlated , 2011, Comput. Stat. Data Anal..

[33]  Charles C. Kemp,et al.  A force and thermal sensing skin for robots in human environments , 2017, Robotics Auton. Syst..

[34]  J. C. Stevens,et al.  Temperature sensitivity of the body surface over the life span. , 1998, Somatosensory & motor research.

[35]  Astrid M L Kappers,et al.  Thermosensory reversal effect quantified. , 2008, Acta psychologica.

[36]  D. Sessler,et al.  Skin-surface temperature gradients correlate with fingertip blood flow in humans. , 1990, Anesthesiology.

[37]  Günther Schmidt,et al.  Multi-fingered tactile feedback from virtual and remote environments , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[38]  N A Obuchowski,et al.  On the comparison of correlated proportions for clustered data. , 1998, Statistics in medicine.

[39]  Danfei Xu,et al.  Tactile identification of objects using Bayesian exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[40]  Gi-Hun Yang,et al.  Use of Simulated Thermal Cues for Material Discrimination and Identification with a Multi-Fingered Display , 2008, PRESENCE: Teleoperators and Virtual Environments.

[41]  Gerald E. Loeb,et al.  Bayesian Exploration for Intelligent Identification of Textures , 2012, Front. Neurorobot..

[42]  R. Duclaux [Cutaneous thermoreceptors]. , 1977, Journal de physiologie.

[43]  John Cohen The World of Touch , 1952, Nature.

[44]  Gi-Hun Yang,et al.  Spatial acuity and summation on the hand: The role of thermal cues in material discrimination , 2009, Attention, perception & psychophysics.

[45]  L.A. Jones,et al.  Material identification using real and simulated thermal cues , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[46]  M F Tritsch,et al.  The veridical perception of object temperature with varying skin temperature , 1988, Perception & psychophysics.

[47]  Sung-Hoon Kim,et al.  Flexible Multimodal Tactile Sensing System for Object Identification , 2006, 2006 5th IEEE Conference on Sensors.

[48]  Lynette A. Jones,et al.  Material discrimination and thermal perception , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..