BUILDING FACADE OBJECT DETECTION FROM TERRESTRIAL THERMAL INFRARED IMAGE SEQUENCES COMBINING DIFFERENT VIEWS

This paper discusses the automatic texturing of building facades from thermal infrared image sequences. A fully automatic method is presented to refine GPS based positions estimating relative orientations of the image sequences including a given building model in a bundle adjustment process. The resulting refined orientation parameters are used to extract partial facade textures from all images and all sequences. The resulting partial textures of every sequence are combined to get complete facade textures in the thermal infrared domain. Textures from different image sequences are combined for object detection and extraction. These sequences are acquired either at different times for different radiometric thermal behavior of facade objects or with different viewing directions for objects located before or behind the facade plane.

[1]  Richard I. Hartley,et al.  Lines and Points in Three Views and the Trifocal Tensor , 1997, International Journal of Computer Vision.

[2]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Pedro Arias,et al.  Calibration and verification of thermographic cameras for geometric measurements , 2011 .

[4]  Bill Triggs,et al.  Camera pose and calibration from 4 or 5 known 3D points , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Heiko Hirschmüller,et al.  Dense 3D Reconstruction from Wide Baseline Image Sets , 2011, Theoretical Foundations of Computer Vision.

[6]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[7]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[8]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  James R. Bergen,et al.  Visual odometry for ground vehicle applications , 2006, J. Field Robotics.

[10]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[11]  Uwe Stilla,et al.  Line based Matching of Uncertain 3D Building Models with IR Image Sequences for Precise Texture Extraction , 2012 .

[12]  L. Zhi,et al.  A Complete Linear 4-Point Algorithm for Camera Pose Determination 1 ) , 2003 .

[13]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  Robert M. Haralick,et al.  Review and analysis of solutions of the three point perspective pose estimation problem , 1994, International Journal of Computer Vision.

[16]  Constantinos A. Balaras,et al.  Infrared thermography for building diagnostics , 2002 .

[17]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Luc Van Gool,et al.  Surviving Dominant Planes in Uncalibrated Structure and Motion Recovery , 2002, ECCV.

[19]  H. C. Longuet-Higgins.  The reconstruction of a plane surface from two perspective projections , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[20]  Frederik Schaffalitzky,et al.  How hard is 3-view triangulation really? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[21]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[22]  Uwe Stilla,et al.  Gestalt Grouping on Façade Textures from IR Image Sequences: Comparing Different Production Systems , 2012 .

[23]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[24]  Uwe Stilla,et al.  TOWARDS PEOPLE DETECTION FROM FUSED TIME-OF-FLIGHT AND THERMAL INFRARED IMAGES , 2014 .

[25]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[26]  J. Chris McGlone,et al.  Manual of photogrammetry , 2004 .

[27]  Helmut Mayer.  3D Reconstruction and Visualization of Urban Scenes from Uncalibrated Wide-Baseline Image Sequences , 2008 .

[28]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[30]  Ruigang Yang,et al.  Multi-resolution real-time stereo on commodity graphics hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..