3D SURFACE GENERATION FROM AERIAL THERMAL IMAGERY

Aerial thermal imagery has been recently applied to quantitative analysis of several scenes. For the mapping purpose based on aerial thermal imagery, high accuracy photogrammetric process is necessary. However, due to low geometric resolution and low contrast of thermal imaging sensors, there are some challenges in precise 3D measurement of objects. In this paper the potential of thermal video in 3D surface generation is evaluated. In the pre-processing step, thermal camera is geometrically calibrated using a calibration grid based on emissivity differences between the background and the targets. Then, Digital Surface Model (DSM) generation from thermal video imagery is performed in four steps. Initially, frames are extracted from video, then tie points are generated by Scale-Invariant Feature Transform (SIFT) algorithm. Bundle adjustment is then applied and the camera position and orientation parameters are determined. Finally, multi-resolution dense image matching algorithm is used to create 3D point cloud of the scene. Potential of the proposed method is evaluated based on thermal imaging cover an industrial area. The thermal camera has 640×480 Uncooled Focal Plane Array (UFPA) sensor, equipped with a 25 mm lens which mounted in the Unmanned Aerial Vehicle (UAV). The obtained results show the comparable accuracy of 3D model generated based on thermal images with respect to DSM generated from visible images, however thermal based DSM is somehow smoother with lower level of texture. Comparing the generated DSM with the 9 measured GCPs in the area shows the Root Mean Square Error (RMSE) value is smaller than 5 decimetres in both X and Y directions and 1.6 meters for the Z direction.

[1]  Pierre Karrasch,et al.  GENERATION OF MULTITEMPORAL THERMAL ORTHOPHOTOS FROM UAV DATA , 2013 .

[2]  A. Mouget,et al.  PHOTOGRAMMETRIC ARCHAEOLOGICAL SURVEY WITH UAV , 2014 .

[3]  Pablo J. Zarco-Tejada,et al.  Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[4]  B. Vollheim,et al.  Infrared cameras in airborne remote sensing: IR-Imagery for photogrammetric processing at German Aerospace Center DLR, Berlin , 2012 .

[5]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[6]  Martina L. Hobi,et al.  Accuracy Assessment of Digital Surface Models Based on WorldView-2 and ADS80 Stereo Remote Sensing Data , 2012, Sensors.

[7]  Clive S. Fraser,et al.  Digital camera self-calibration , 1997 .

[8]  Ingemar J. Cox,et al.  A maximum-flow formulation of the N-camera stereo correspondence problem , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  M. Pierrot Deseilligny,et al.  APERO, AN OPEN SOURCE BUNDLE ADJUSMENT SOFTWARE FOR AUTOMATIC CALIBRATION AND ORIENTATION OF SET OF IMAGES , 2012 .

[10]  Sridha Sridharan,et al.  A Mask-Based Approach for the Geometric Calibration of Thermal-Infrared Cameras , 2012, IEEE Transactions on Instrumentation and Measurement.

[11]  Lucía Díaz-Vilariño,et al.  Aerial oblique thermographic imagery for the generation of building 3D models to complement Geographic Information Systems , 2014 .

[12]  Tor Arne Johansen,et al.  Automatic detection, classification and tracking of objects in the ocean surface from UAVs using a thermal camera , 2015, 2015 IEEE Aerospace Conference.