Material Classification Using Active Temperature Controllable Robotic Gripper

Recognition techniques allow robots to make proper planning and control strategies to manipulate various objects. Object recognition is more reliable when made by combining several percepts, e.g., vision and haptics. One of the distinguishing features of each object’s material is its heat properties, and classification can exploit heat transfer, similarly to human thermal sensation. Thermal-based recognition has the advantage of obtaining contact surface information in realtime by simply capturing temperature change using a tiny and cheap sensor. However, heat transfer between a robot surface and a contact object is strongly affected by the initial temperature and environmental conditions. A given object’s material cannot be recognized when its temperature is the same as the robotic grippertip. We present a material classification system using active temperature controllable robotic gripper to induce heat flow. Subsequently, our system can recognize materials independently from their ambient temperature. The robotic gripper surface can be regulated to any temperature that differentiates it from the touched object’s surface. We conducted some experiments by integrating the temperature control system with the Academic SCARA Robot, classifying them based on a long short-term memory (LSTM) using temperature data obtained from grasping target objects.

[1]  Masahiro Fujita,et al.  What are the important technologies for bin picking? Technology analysis of robots in competitions based on a set of performance metrics , 2019, Adv. Robotics.

[2]  Hsin-Ni Ho,et al.  Material recognition based on thermal cues: Mechanisms and applications , 2017, Temperature.

[3]  Abderrahmane Kheddar,et al.  Thermal Display for Telepresence Based on Neural Identification and Heat Flux Control , 2009, PRESENCE: Teleoperators and Virtual Environments.

[4]  Akio Yamamoto,et al.  Control of thermal tactile display based on prediction of contact temperature , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  Edward H. Adelson,et al.  Active Clothing Material Perception Using Tactile Sensing and Deep Learning , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Koh Hosoda,et al.  Robust material discrimination by a soft anthropomorphic finger with tactile and thermal sense , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Shogo Okamoto,et al.  Hierarchical Modeling of Individual Tactile, Emotional, and Preferential Responses to Leathers using Bayesian Structural Equation Modeling , 2021, 2021 IEEE/SICE International Symposium on System Integration (SII).

[8]  I. Shimoyama,et al.  Material discrimination by heat flow sensing , 2009, TRANSDUCERS 2009 - 2009 International Solid-State Sensors, Actuators and Microsystems Conference.

[9]  Trevor Darrell,et al.  Robotic learning of haptic adjectives through physical interaction , 2015, Robotics Auton. Syst..

[10]  T. Martin McGinnity,et al.  Material classification based on thermal properties — A robot and human evaluation , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[11]  Danfei Xu,et al.  Tactile identification of objects using Bayesian exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[12]  Abderrahmane Kheddar,et al.  Soft robotic shell with active thermal display , 2021, Scientific Reports.

[13]  Charles C. Kemp,et al.  Material Recognition via Heat Transfer Given Ambiguous Initial Conditions , 2020, IEEE Transactions on Haptics.

[14]  Charles C. Kemp,et al.  Data-driven thermal recognition of contact with people and objects , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[15]  Charles C. Kemp,et al.  Multimodal Tactile Perception of Objects in a Real Home , 2018, IEEE Robotics and Automation Letters.

[16]  Abderrahmane Kheddar,et al.  A Soft Robotic Cover with Dual Thermal Display and Sensing Capabilities. , 2020 .

[17]  Sung-Hoon Kim,et al.  Flexible Multimodal Tactile Sensing System for Object Identification , 2006, 2006 5th IEEE Conference on Sensors.

[18]  Gareth J. Monkman,et al.  Thermal tactile sensing , 1993, IEEE Trans. Robotics Autom..

[19]  Kuniyuki Takahashi,et al.  Deep Visuo-Tactile Learning: Estimation of Tactile Properties from Images , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[20]  John M. Hollerbach,et al.  An integrated tactile and thermal sensor , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[21]  R. Andrew Russell,et al.  Thermal sensor for object shape and material constitution , 1988, Robotica.

[22]  J. M. Coulson,et al.  Heat Transfer , 2018, Heat Transfer in Food Cooling Applications.

[23]  Gi-Hun Yang,et al.  Spatial acuity and summation on the hand: The role of thermal cues in material discrimination , 2009, Attention, perception & psychophysics.

[24]  Charles C. Kemp,et al.  Material Recognition from Heat Transfer given Varying Initial Conditions and Short-Duration Contact , 2015, Robotics: Science and Systems.

[25]  Jeremy A. Fishel,et al.  Signal processing and fabrication of a biomimetic tactile sensor array with thermal, force and microvibration modalities , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).