3D Temperature Distribution Model Based on Thermal Infrared Image

This paper aims to study the construction of 3D temperature distribution reconstruction system based on binocular vision technology. Initially, a traditional calibration method cannot be directly used, because the thermal infrared camera is only sensitive to temperature. Therefore, the thermal infrared camera is calibrated separately. Belief propagation algorithm is also investigated and its smooth model is improved in terms of stereo matching to optimize mismatching rate. Finally, the 3D temperature distribution model is built based on the matching of 3D point cloud and 2D thermal infrared information. Experimental results show that the method can accurately construct the 3D temperature distribution model and has strong robustness.

[1]  Jan Kautz,et al.  PMBP: PatchMatch Belief Propagation for Correspondence Field Estimation , 2014, International Journal of Computer Vision.

[2]  I. Grubisic,et al.  4D thermal imaging system for medical applications , 2011 .

[3]  Aymen Ben Azouz,et al.  Development of a teat sensing system for robotic milking by combining thermal imaging and stereovision technique , 2015, Comput. Electron. Agric..

[4]  William T. Freeman,et al.  Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Liu Zong-ming,et al.  Levenberg-Marquardt algorithm based nonlinear optimization of camera calibration for relative measurement , 2015, 2015 34th Chinese Control Conference (CCC).

[6]  Joris J.J. Dirckx,et al.  Determining directional emissivity: Numerical estimation and experimental validation by using infrared thermography , 2016 .

[7]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Tong Jia,et al.  Scene Depth Perception Based on Omnidirectional Structured Light , 2016, IEEE Transactions on Image Processing.

[9]  Zhang Xinghua.  A stereo matching algorithm based on belief propagation , 2010 .

[10]  Shaoli Liu,et al.  An absolute phase technique for 3D profile measurement using four-step structured light pattern , 2012 .

[11]  Jing Xu,et al.  An omnidirectional 3D sensor with line laser scanning , 2016 .

[12]  Andreas Nüchter,et al.  Thermal 3D Mapping of Building Façades , 2012, IAS.

[13]  Lifeng Sun,et al.  Cross-Scale Cost Aggregation for Stereo Matching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Shuai Zhang,et al.  3D temperature distribution model based on vision method , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[15]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jiebo Luo,et al.  Self-Supervised Online Metric Learning With Low Rank Constraint for Scene Categorization , 2013, IEEE Transactions on Image Processing.

[17]  Bart Ribbens,et al.  4D Active and passive thermography measurement system using a KUKA KR16 robot and time-of-flight imaging , 2016 .

[18]  Samuel Soldan,et al.  3D Thermal Imaging: Fusion of Thermography and Depth Cameras , 2014 .

[19]  HU Zhi-xiong.  Linear and Nonlinear Solving Methods of Camera Intrinsic Parameters Based on Zhang’s Algorithm , 2013 .

[20]  Ioannis Stamos,et al.  Automatic 3D to 2D registration for the photorealistic rendering of urban scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  T. Luhmann,et al.  GEOMETRIC CALIBRATION OF THERMOGRAPHIC CAMERAS , 2013 .

[22]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Ivan Grubisic,et al.  Active 3D scanning based 3D thermography system and medical applications , 2011, 2011 Proceedings of the 34th International Convention MIPRO.

[24]  George Wolberg,et al.  Multiview Geometry for Texture Mapping 2D Images Onto 3D Range Data , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  Uwe Stilla,et al.  Fusion von Time-of-Flight-Entfernungsdaten und thermalen IR-Bildern , 2014 .

[26]  Diego González-Aguilera,et al.  Novel approach to 3D thermography and energy efficiency evaluation , 2012 .

[27]  C. Pichot,et al.  Microwave imaging-complex permittivity reconstruction with a Levenberg-Marquardt method , 1997 .