Performance comparison of different inpainting algorithms for accurate DTM generation

To accurately extract digital terrain model (DTM), it is necessary to remove heights due to vegetation such as trees and shrubs and other manmade structures such as buildings, bridges, etc. from the digital surface model (DSM). The resulting DTM can then be used for construction planning, land surveying, etc. Normally, the process of extracting DTM involves two steps. First, accurate land cover classification is required. Second, an image inpainting process is needed to fill in the missing pixels due to trees, buildings, bridges, etc. In this paper, we focus on the second step of using image inpainting algorithms for terrain reconstruction. In particular, we evaluate seven conventional and deep learning based inpainting algorithms in the literature using two datasets. Both objective and subjective comparisons were carried out. It was observed that some algorithms yielded slightly better performance than others.

[1]  Thomas S. Huang,et al.  Generative Image Inpainting with Contextual Attention , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Thomas Wiegand,et al.  Towards efficient intra prediction based on image inpainting methods , 2010, 28th Picture Coding Symposium.

[3]  Chiman Kwan,et al.  Resolution enhancement for hyperspectral images: A super-resolution and fusion approach , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Chiman Kwan,et al.  High performance image completion using sparsity based algorithms , 2018, Commercial + Scientific Sensing and Imaging.

[5]  Chiman Kwan,et al.  Perceptually lossless compression of Mastcam images with error recovery , 2019, Defense + Commercial Sensing.

[6]  Chiman Kwan,et al.  Hybrid Sensor Network Data Compression with Error Resiliency , 2018, 2018 Data Compression Conference.

[7]  Michael J. Black,et al.  Field of experts , 2011 .

[8]  Joachim Weickert,et al.  Turning Diffusion-Based Image Colorization Into Efficient Color Compression , 2017, IEEE Transactions on Image Processing.

[9]  Chiman Kwan,et al.  Perceptually Lossless Video Compression with Error Concealment , 2018, ICVISP.

[10]  Chiman Kwan,et al.  Blind Quality Assessment of Fused WorldView-3 Images by Using the Combinations of Pansharpening and Hypersharpening Paradigms , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Antonio J. Plaza,et al.  Performance of Change Detection Algorithms Using Heterogeneous Images and Extended Multi-attribute Profiles (EMAPs) , 2019, Remote. Sens..

[12]  Dimitrios Skarlatos,et al.  VEGETATION REMOVAL FROM UAV DERIVED DSMS, USING COMBINATION OF RGB AND NIR IMAGERY , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[13]  Chiman Kwan,et al.  Demosaicing enhancement using pixel-level fusion , 2018, Signal Image Video Process..

[14]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[15]  J. Bednar,et al.  Alpha-trimmed means and their relationship to median filters , 1984 .

[16]  Chiman Kwan,et al.  Perceptually Lossless Image Compression with Error Recovery , 2018, ICVISP.

[17]  Chiman Kwan,et al.  Missing Link Prediction in Social Networks , 2018, ISNN.

[18]  Joachim Weickert,et al.  Diffusion-Based Inpainting for Coding Remote-Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[19]  Chiman Kwan,et al.  Perceptually Lossless Compression with Error Concealment for Periscope and Sonar Videos , 2019 .

[20]  Chiman Kwan,et al.  High Performance Video Codec with Error Concealment , 2018, 2018 Data Compression Conference.