Thermal comfort measurement using thermal-depth images for robotic monitoring

Abstract This paper describes an application of thermal-depth images to human thermal comfort measurement. A mobile monitoring of the elderly and residents of care houses is one of the promising applications of mobile assistive robots. Monitoring if a person feels comfortable is an important task of such robots. We rely on an established comfort measure in the architecture domain, namely, predicted mean vote (PMV). PMV is calculated mainly by six factors and one of which is the clothing insulation or clo-value. Clo-values are usually measured by a thermal mannequin, a specially-designed apparatus for the purpose. We apply human recognition techniques in thermal-depth images to efficiently measure clo-values, thereby enabling on-line assessment of thermal comfort. We evaluate the method and develop a mobile robot system for experimental testing.

[1]  Jun Miura,et al.  Mobile monitoring of physical states of indoor environments for personal support , 2015, 2015 IEEE/SICE International Symposium on System Integration (SII).

[2]  Kyung-Soo Kim,et al.  Estimating Clothing Thermal Insulation Using an Infrared Camera , 2016, Sensors.

[3]  Masamichi Shimosaka,et al.  Behavior prediction from trajectories in a house by estimating transition model using stay points , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[5]  Bjarne W. Olesen,et al.  Evaluation methods for indoor environmental quality assessment according to EN15251 , 2012 .

[6]  Christoph van Treeck,et al.  Real-Time Assessment of Human Thermal Comfort Using Image Recognition in Conjunction with a Detailed Numerical Human Model , 2017 .

[7]  Samuel Soldan,et al.  3D Thermal Imaging: Fusion of Thermography and Depth Cameras , 2014 .

[8]  Hiroshi Ishiguro,et al.  Estimation of Thermal Comfort by Measuring Clo Value without Contact , 2011, MVA.

[9]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  B. Więcek,et al.  An integrated thermal and visual camera system for 3D reconstruction , 2012 .

[11]  A. T. Almeida,et al.  Environmental monitoring with mobile robots , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Chen Wu,et al.  Multiview activity recognition in smart homes with spatio-temporal features , 2010, ICDSC '10.

[13]  Ali Abdul Khaliq,et al.  Towards real-world gas distribution mapping and leak localization using a mobile robot with 3d and remote gas sensing capabilities , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Juhi Ranjan,et al.  ThermalSense: determining dynamic thermal comfort preferences using thermographic imaging , 2016, UbiComp.

[15]  新一 田辺,et al.  サーマルマネキンを用いた立位・座位人体各部位の放射・対流熱伝達率の測定 , 1997 .

[16]  Kristian Fabbri,et al.  Thermal comfort evaluation in kindergarten: PMV and PPD measurement through datalogger and questionnaire , 2013 .

[17]  Moritz Tenorth,et al.  Learning probability distributions over partially-ordered human everyday activities , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Mohan M. Trivedi,et al.  Activity monitoring and summarization for an intelligent meeting room , 2000, Proceedings Workshop on Human Motion.

[19]  Jun Miura,et al.  Use of Thermal Point Cloud for Thermal Comfort Measurement and Human Pose Estimation in Robotic Monitoring , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[20]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Hema Swetha Koppula,et al.  Learning human activities and object affordances from RGB-D videos , 2012, Int. J. Robotics Res..

[22]  Refrigerating ASHRAE handbook of fundamentals , 1967 .

[23]  Avideh Zakhor,et al.  Automatic Generation of 3 D Thermal Maps of Building Interiors , 2014 .