Practical Digital Terrain Model Extraction Using Image Inpainting Techniques

In some applications such as construction planning and land surveying, an accurate digital terrain model (DTM) is essential. However, in urban and sub-urban areas, the terrain may be covered by trees and man-made structures. Although digital surface model (DSM) obtained by radar or LiDAR can provide a general idea of the terrain, the presence of trees, buildings, etc. conceals the actual terrain elevation. Normally, the process of extracting DTM involves a land cover classification followed by a trimming step that removes the elevation due to trees and buildings. In this chapter, we assume the land cover types have been classified and we focus on the use of image inpainting algorithms for DTM generation. That is, for buildings and trees, we remove those pixels from the DSM and then apply inpainting techniques to reconstruct the terrain pixels in those areas. A dataset with DSM and hyperspectral data near the U. Houston area was used in our study. The DTM from United States Geological Survey (USGS) was used as the ground truth. Objective evaluation results indicate that some inpainting methods perform better than others.

[1]  Chiman Kwan,et al.  A joint sparsity approach to tunnel activity monitoring using high resolution satellite images , 2017, 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON).

[2]  Nasser M. Nasrabadi Kernel-Based Spectral Matched Signal Detectors for Hyperspectral Target Detection , 2007, PReMI.

[3]  Chiman Kwan,et al.  Demosaicing enhancement using pixel-level fusion , 2018, Signal Image Video Process..

[4]  Chiman Kwan,et al.  Application of Support Vector Machines to Vapor Detection and Classification for Environmental Monitoring of Spacecraft , 2006, ISNN.

[5]  Hairong Qi,et al.  DOES multispectral / hyperspectral pansharpening improve the performance of anomaly detection? , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[6]  Dimitrios Skarlatos,et al.  Deep learning model for accurate vegetation classification using RGB image only , 2020, Defense + Commercial Sensing.

[7]  Hairong Qi,et al.  Identify anomaly componentbysparsity and low rank , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[8]  Wuming Zhang,et al.  An Easy-to-Use Airborne LiDAR Data Filtering Method Based on Cloth Simulation , 2016, Remote. Sens..

[9]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Dimitrios Skarlatos,et al.  VEGETATION REMOVAL FROM UAV DERIVED DSMS, USING COMBINATION OF RGB AND NIR IMAGERY , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[11]  R. Green,et al.  An introduction to the NASA Hyperspectral InfraRed Imager (HyspIRI) mission and preparatory activities , 2015 .

[12]  Chiman Kwan,et al.  Tree, Shrub, and Grass Classification Using Only RGB Images , 2020, Remote Sensing.

[13]  Thomas S. Huang,et al.  Generative Image Inpainting with Contextual Attention , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Heesung Kwon,et al.  Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Antonio J. Plaza,et al.  Improving Land Cover Classification Using Extended Multi-Attribute Profiles (EMAP) Enhanced Color, Near Infrared, and LiDAR Data , 2020, Remote. Sens..

[16]  Luc Van Gool,et al.  Transforming Image Completion , 2011, BMVC.

[17]  Chiman Kwan,et al.  Hyperspectral image super-resolution: a hybrid color mapping approach , 2016 .

[18]  Antonio J. Plaza,et al.  Fusion of Hyperspectral and LiDAR Remote Sensing Data Using Multiple Feature Learning , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Antonio J. Plaza,et al.  Performance of Change Detection Algorithms Using Heterogeneous Images and Extended Multi-attribute Profiles (EMAPs) , 2019, Remote. Sens..

[20]  Nasser M. Nasrabadi,et al.  Automated Hyperspectral Cueing for Civilian Search and Rescue , 2009, Proceedings of the IEEE.

[21]  Chiman Kwan,et al.  A Joint Sparsity Approach to Soil Detection Using Expanded Bands of WV-2 Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[22]  Thomas Wiegand,et al.  Towards efficient intra prediction based on image inpainting methods , 2010, 28th Picture Coding Symposium.

[23]  Chiman Kwan,et al.  Application of Deep Belief Network to Land Cover Classification Using Hyperspectral Images , 2017, ISNN.

[24]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Multispectral Images Using Kernel Feature Space Representation , 2014, IEEE Geoscience and Remote Sensing Letters.

[25]  Lorenzo Bruzzone,et al.  Extended profiles with morphological attribute filters for the analysis of hyperspectral data , 2010 .

[26]  Jon Atli Benediktsson,et al.  Spectral unmixing of multispectral satellite images with dimensionality expansion using morphological profiles , 2012, Optics & Photonics - Optical Engineering + Applications.

[27]  Chiman Kwan,et al.  Resolution enhancement for hyperspectral images: A super-resolution and fusion approach , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Qian Du,et al.  Hyperspectral Band Selection: A Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[29]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[30]  Dimitrios Skarlatos,et al.  Performance comparison of different inpainting algorithms for accurate DTM generation , 2020, Defense + Commercial Sensing.

[31]  Chiman Kwan,et al.  Improved target detection for hyperspectral images using hybrid in-scene calibration , 2017 .

[32]  Jing Wang,et al.  A novel approach for spectral unmixing, classification, and concentration estimation of chemical and biological agents , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Chiman Kwan,et al.  High performance image completion using sparsity based algorithms , 2018, Commercial + Scientific Sensing and Imaging.

[34]  Chiman Kwan,et al.  A Novel Cluster Kernel RX Algorithm for Anomaly and Change Detection Using Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.