Automatic Generation of 3 D Thermal Maps of Building Interiors

Most existing approaches to characterizing thermal properties of buildings and heat emissions from their elements rely on manual inspection and as such are slow, and labor intensive. This is often a daunting task, which requires several days of on-site inspection. In this paper, we propose a fully automatic approach to construct a 3D thermal point cloud of the building interior reflecting the geometry including walls, floors, and ceilings, as well as structures such as furniture, lights, windows, and plug loads. Our approach is based on a wearable ambulatory backpack comprising multiple sensors such as Light Detection And Ranging (LiDAR) scanners, and Infrared and optical cameras. As the operator wearing the backpack walks through the building, the LiDAR scans are collected and processed in order to compute the 3D geometry of the building. Furthermore, the Infrared cameras are calibrated intrinsically and extrinsically such that the captured images are registered to the captured geometry. Thus, the temperature data in the Infrared images is associated with the geometry resulting in a “thermal 3D point cloud”. The same process can be repeated using optical imagery resulting in a “visible 3D point cloud”. By visualizing the two point clouds simultaneously in interactive rendering tools, we can virtually walk through the thermal and optical 3D point clouds, toggle between them, identify and annotate, “hot” regions, objects, plug loads, thermal and moisture leaks, and document their location with fine spatial granularity in the 3D point clouds.

[1]  Avideh Zakhor,et al.  Indoor Localization Algorithms for a Human-Operated Backpack System , 2010 .

[2]  Avideh Zakhor,et al.  Watertight As-Built Architectural Floor Plans Generated from Laser Range Data , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[3]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Pedro Arias,et al.  AUTOMATIC PROCEDURE FOR THE REGISTRATION OF THERMOGRAPHIC IMAGES WITH POINT CLOUDS , 2012 .

[5]  Automatic Identification of Window Regions on Indoor Point Clouds Using Lasers and Cameras Anonymous WACV submission , 2022 .

[6]  In-So Kweon,et al.  Capturing Village-level Heritages with a Hand-held Camera-Laser Fusion Sensor , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[7]  John J. Leonard,et al.  Sensor fusion for flexible human-portable building-scale mapping , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  E. Mills Building commissioning: a golden opportunity for reducing energy costs and greenhouse gas emissions in the United States , 2010 .

[9]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[10]  Christian Früh,et al.  Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images , 2005, International Journal of Computer Vision.

[11]  Avideh Zakhor,et al.  Indoor localization and visualization using a human-operated backpack system , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Ran Liu,et al.  Outlier Robust ICP for Minimizing Fractional RMSD , 2006, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[14]  Automated texture mapping of 3D city models with oblique aerial imagery , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[15]  Avideh Zakhor,et al.  Image augmented laser scan matching for indoor dead reckoning , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Joel A. Hesch,et al.  A Direct Least-Squares (DLS) method for PnP , 2011, 2011 International Conference on Computer Vision.

[17]  Avideh Zakhor,et al.  Automatic loop closure detection using multiple cameras for 3D indoor localization , 2012, Electronic Imaging.

[18]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Avideh Zakhor,et al.  Indoor Localization Algorithms for an Ambulatory Human Operated 3D Mobile Mapping System , 2013, Remote. Sens..

[20]  Avideh Zakhor,et al.  Planar 3D modeling of building interiors from point cloud data , 2012, 2012 19th IEEE International Conference on Image Processing.

[21]  Thorsten Joachims,et al.  Semantic Labeling of 3D Point Clouds for Indoor Scenes , 2011, NIPS.

[22]  Avideh Zakhor,et al.  Texture mapping 3 D planar models of indoor environments with noisy camera poses , 2013 .

[23]  Avideh Zakhor,et al.  Watertight Planar Surface Meshing of Indoor Point-Clouds with Voxel Carving , 2013, 2013 International Conference on 3D Vision.

[24]  Avideh Zakhor,et al.  Floor plan generation and room labeling of indoor environments from laser range data , 2015, 2014 International Conference on Computer Graphics Theory and Applications (GRAPP).