Optical superimposition of infrared thermography through video projection

Abstract This paper presents a novel infrared thermography visualization technique where a sequence of captured thermal images is optically and simultaneously superimposed onto the target object via video projection in real time. In conventional thermography visualization, observers have to frequently move their eyes from the object to a 2D screen where a thermal image is displayed. In contrast, the heat distribution of the object’s surface emerges directly onto its physical surface in the proposed method. As a result, the observer can intuitively understand the object’s heat information just by looking at it in the real space. This paper explains the methods of geometric registration and radiometric compensation of the captured thermal image, which are required before video projection. Furthermore, several projection results are shown to validate the intuitiveness and usefulness of the proposed visualization method.

[1]  Takeshi Naemura,et al.  Thermo-key: human region segmentation from video , 2004, IEEE Computer Graphics and Applications.

[2]  K. Sato,et al.  Range imaging system utilizing nematic liquid crystal mask , 1987 .

[3]  Herbert Kaplan,et al.  Practical Applications of Infrared Thermal Sensing and Imaging Equipment , 1993 .

[4]  Yoichi Sato,et al.  Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system , 2001, TCHI.

[5]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[6]  Gordon Wetzstein,et al.  The visual computing of projector-camera systems , 2008, SIGGRAPH '08.

[7]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[8]  T. Yoshida,et al.  A Virtual Color Reconstruction System for Real Heritage with Light Projection , 2003 .

[9]  T. L. Williams,et al.  Applications of Thermal Imaging , 1988 .

[10]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Gunnar Lovhoiden,et al.  Prototype vein contrast enhancer , 2004, SPIE BiOS.

[13]  Kosuke Sato,et al.  Heat sensation in image creation with thermal vision , 2005, ACE '05.

[14]  Ivan Poupyrev,et al.  Experiments with Face-To-Face Collaborative AR Interfaces , 2002, Virtual Reality.

[15]  Shree K. Nayar,et al.  A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments , 2005, CVPR.