Thermal Display for Telepresence Based on Neural Identification and Heat Flux Control

We present a new approach for thermal rendering in telepresence which improves transparency; it aims at reaching, as closely as possible, what is experienced in similar direct touch conditions. Our method is based on a neural networks learning classifier that allows generating appropriate thermal values (i.e., time trajectories) used as desired inputs of two independent controllers: the one controlling a bio-inspired remote thermal sensing device (i.e., an artificial finger), and the other one controlling the user's thermal display. To do so, two databases are built from real measurements recorded during direct contact between the operator's finger and different materials. One database is used for training a classifier to be used in online identification of the material being remotely explored; the other is used to generate desired thermal trajectories for the previously evoked control loops. The learning bloc is based on principal component analysis and a feed-forward neural network. Experimental tests validating our method in different scenarios have been carried out; the obtained results are discussed.

[1]  Abderrahmane Kheddar,et al.  A touch rendering device in a virtual environment with kinesthetic and thermal feedback , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[2]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[3]  J. R. Culham,et al.  Review of Thermal Conductance Models for Joints Incorporating Enhancement Materials , 2003 .

[4]  Lynette A. Jones,et al.  Infrared Thermal Measurement System for Evaluating Model-Based Thermal Displays , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[5]  Abderrahmane Kheddar,et al.  Thermal bilateral coupling in teleoperators , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  A. Kheddar,et al.  Thermoelectric Modules: Recursive non-linear ARMA modeling, Identification and Robust Control , 2007, IECON 2007 - 33rd Annual Conference of the IEEE Industrial Electronics Society.

[7]  C. Lévi-Strauss,et al.  Experimental investigation , 2013 .

[8]  Hsin-Ni Ho,et al.  Contribution of thermal cues to material discrimination and localization , 2006, Perception & psychophysics.

[9]  M. Michael Yovanovich,et al.  Thermal Contact Correlations , 1981 .

[10]  Abderrahmane Kheddar,et al.  Teleoperation based on the hidden robot concept , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[11]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[12]  Gareth J. Monkman,et al.  Thermal tactile sensing , 1993, IEEE Trans. Robotics Autom..

[13]  S. Lineykin,et al.  Modeling and analysis of thermoelectric modules , 2005, APEC 2005.

[14]  L.A. Jones,et al.  Material identification using real and simulated thermal cues , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Didier Defer,et al.  The characterization of thermophysical properties by thermal impedance measurements taken under random stimuli taking sensor-induced disturbance into account , 1998 .

[16]  A. Abdel-azim.  Fundamentals of Heat and Mass Transfer , 2011 .

[17]  Dale A. Lawrence.  Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[18]  Lynette A. Jones,et al.  The psychophysics of temperature perception and thermal-interface design , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[19]  R. Andrew Russell,et al.  Thermal sensor for object shape and material constitution , 1988, Robotica.

[20]  Lynette A. Jones,et al.  Thermal Model for Hand-Object Interactions , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[21]  Darwin G. Caldwell,et al.  A high power/weight dexterous manipulator using 'Sensory Glove' based motion control and tactile feedback , 1995 .

[22]  A. Kheddar,et al.  Thermal feedback model for virtual reality , 2003, MHS2003. Proceedings of 2003 International Symposium on Micromechatronics and Human Science (IEEE Cat. No.03TH8717).

[23]  Lie Xu,et al.  An experimental investigation of thermal contact conductance of stainless steel at low temperatures , 2005 .

[24]  R. Andrew Russell,et al.  A Robot Sensor for Measuring Thermal Properties of Gripped Objects , 1985, IEEE Transactions on Instrumentation and Measurement.

[25]  M. Yovanovich,et al.  Calculating interface resistance , 2004 .

[26]  P. Khatri,et al.  "Dry-to-the-touch" thermal grease , 2001, Proceedings International Symposium on Advanced Packaging Materials Processes, Properties and Interfaces (IEEE Cat. No.01TH8562).

[27]  Abderrahmane Kheddar,et al.  Learning-Based Thermal Rendering in Telepresence , 2008, EuroHaptics.

[28]  Akio Yamamoto,et al.  1P1-N-102 Thermal Tactile Presentation Based on Prediction of Contact Surface Temperature : On-Site Parameters Identification of Individual Finger(Tactile and Force Sense 2,Mega-Integration in Robotics and Mechatronics to Assist Our Daily Lives) , 2005 .

[29]  Frank P. Incropera,et al.  Fundamentals of Heat and Mass Transfer , 1981 .

[30]  Lynette A. Jones,et al.  Material discrimination and thermal perception , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[31]  Akio Yamamoto,et al.  Control of thermal tactile display based on prediction of contact temperature , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[32]  Abderrahmane Kheddar,et al.  A multi-level haptic rendering concept , 2004 .

[33]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.