RSPCN: Super-Resolution of Digital Elevation Model Based on Recursive Sub-Pixel Convolutional Neural Networks

The digital elevation model (DEM) is known as one kind of the most significant fundamental geographical data models. The theory, method and application of DEM are hot research issues in geography, especially in geomorphology, hydrology, soil and other related fields. In this paper, we improve the efficient sub-pixel convolutional neural networks (ESPCN) and propose recursive sub-pixel convolutional neural networks (RSPCN) to generate higher-resolution DEMs (HRDEMs) from low-resolution DEMs (LRDEMs). Firstly, the structure of RSPCN is described in detail based on recursion theory. This paper explores the effects of different training datasets, with the self-adaptive learning rate Adam algorithm optimizing the model. Furthermore, the adding-“zero” boundary method is introduced into the RSPCN algorithm as a data preprocessing method, which improves the RSPCN method’s accuracy and convergence. Extensive experiments are conducted to train the method till optimality. Finally, comparisons are made with other traditional interpolation methods, such as bicubic, nearest-neighbor and bilinear methods. The results show that our method has obvious improvements in both accuracy and robustness and further illustrate the feasibility of deep learning methods in the DEM data processing area.

[1]  Wang Yu Application of B Spline and Smoothing Spline on Interpolating the DEM Based on Rectangular Grid , 2000 .

[2]  K. T. Leung,et al.  Super-resolution reconstruction based on linear interpolation of wavelet coefficients , 2007, Multidimens. Syst. Signal Process..

[3]  Chen Zixuan,et al.  Nonlocal similarity based DEM super resolution , 2015 .

[4]  Huili Ren,et al.  3D Seabed Terrain Establishment Based on Moving Fractal Interpolation , 2014, 2014 Seventh International Joint Conference on Computational Sciences and Optimization.

[5]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[6]  Deepu Rajan,et al.  Generalized interpolation and its application in super-resolution imaging , 2001, Image Vis. Comput..

[7]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[8]  Antonio Chica Calaf,et al.  Terrain super-resolution through aerial imagery and fully convolutional networks , 2018 .

[9]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[10]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[11]  R. L. Hardy Multiquadric equations of topography and other irregular surfaces , 1971 .

[12]  Bengt-Erik Bengtsson,et al.  Construction of isarithms and isarithmic maps by computers , 1964 .

[13]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[14]  D. Shepard A two-dimensional interpolation function for irregularly-spaced data , 1968, ACM National Conference.

[15]  Xiao-Li Meng,et al.  The Art of Data Augmentation , 2001 .

[16]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Van der Walt,et al.  Super-resolution imaging , 2018, Mathematical and Computational Methods in Photonics and Phononics.

[18]  Gonzalo Pajares,et al.  Noniterative Interpolation-Based Super-Resolution Minimizing Aliasing in the Reconstructed Image , 2008, IEEE Transactions on Image Processing.

[19]  R. Franke Scattered data interpolation: tests of some methods , 1982 .

[20]  Aggelos K. Katsaggelos,et al.  Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images , 1995, Proceedings., International Conference on Image Processing.

[21]  D. Krige A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .

[22]  Garrett Birkhoff,et al.  Smooth Surface Interpolation , 1960 .

[23]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[24]  Jichun Li,et al.  A simple efficient algorithm for interpolation between different grids in both 2D and 3D , 2002, Math. Comput. Simul..

[25]  Avinash Sharma,et al.  AFN: Attentional Feedback Network based 3D Terrain Super-Resolution , 2020, ACCV.

[26]  Nicole M. Gasparini,et al.  An object-oriented framework for distributed hydrologic and geomorphic modeling using triangulated irregular networks , 2001 .

[27]  David Capel Image Mosaicing and Super-Resolution (Cphc/Bcs Distinguished Dissertations.) , 2004 .

[28]  Liangpei Zhang,et al.  Fusion of multi-scale DEMs using a regularized super-resolution method , 2015, Int. J. Geogr. Inf. Sci..

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[31]  T. A. Foley Interpolation and approximation of 3-D and 4-D scattered data , 1987 .

[32]  Christopher M. Gold,et al.  TIN meets CAD--extending the TIN concept in GIS , 2004, Future Gener. Comput. Syst..

[33]  Avinash Sharma,et al.  Feedback Neural Network based Super-resolution of DEM for generating high fidelity features , 2020, ArXiv.

[34]  C. D. Boor,et al.  Bicubic Spline Interpolation , 1962 .

[35]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[36]  Perry Forsythe,et al.  Evaluation of Terrestrial and Mobile Scanner Technologies for Part-Built Information Modeling , 2018, Journal of Construction Engineering and Management.

[37]  Airborne LiDAR for DEM generation: some critical issues , 2008 .

[38]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Weiqi Wang,et al.  A fundamental theorem for eco-environmental surface modelling and its applications , 2020, Science China Earth Sciences.

[40]  John J. Bartholdi,et al.  The vertex-adjacency dual of a triangulated irregular network has a Hamiltonian cycle , 2004, Oper. Res. Lett..

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Wang Chun,et al.  The Model of Terrain Features Preserved in Grid DEM , 2009 .

[43]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[44]  Yue Tianxiang,et al.  Progress in earth surface modeling , 2011, National Remote Sensing Bulletin.

[45]  Xing Shuai Xu Qing Li Jian-sheng Tan Bing A Research on SPOT5 Supermode Image Processing , 2011 .

[46]  Jin Li,et al.  Spatial interpolation methods applied in the environmental sciences: A review , 2014, Environ. Model. Softw..

[47]  N. K. Bose,et al.  High resolution image formation from low resolution frames using Delaunay triangulation , 2002, IEEE Trans. Image Process..

[48]  Xu Zekai,et al.  Convolutional Neural Network Based dem Super Resolution , 2016 .

[49]  Michal Irani,et al.  Super resolution from image sequences , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[50]  Zhai Lin-pei Kind of super-resolution method of CCD image based on wavelet and bicubic interpolation , 2009 .

[51]  Jianzhou Wang,et al.  Cuckoo search-designated fractal interpolation functions with winner combination for estimating missing values in time series , 2016 .

[52]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[53]  Shmuel Rippa,et al.  An algorithm for selecting a good value for the parameter c in radial basis function interpolation , 1999, Adv. Comput. Math..

[54]  Liangpei Zhang,et al.  A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution , 2007, IEEE Transactions on Image Processing.

[55]  Xiaoye Liu,et al.  Airborne LiDAR for DEM generation: some critical issues , 2008 .

[56]  N. Lam Spatial Interpolation Methods: A Review , 1983 .

[57]  Yang Peng,et al.  Super-resolution reconstruction of a digital elevation model based on a deep residual network , 2020 .

[58]  Jay Gao,et al.  Construction of Regular Grid DEMs from Digitized Contour Lines: A Comparative Study of Three Interpolators , 2001, Ann. GIS.

[59]  Manuel A. Aguilar,et al.  Effects of Terrain Morphology, Sampling Density, and Interpolation Methods on Grid DEM Accuracy , 2005 .

[60]  Li Peng,et al.  Adaptive Norm Selection for Regularized Image Restoration and Super-Resolution , 2016, IEEE Transactions on Cybernetics.

[61]  Jian Liu,et al.  Superresolution remote sensing image processing algorithm based on wavelet transform and interpolation , 2003, SPIE Asia-Pacific Remote Sensing.

[62]  Khizar Hayat,et al.  Super-Resolution via Deep Learning , 2017, Digit. Signal Process..

[63]  Thomas S. Huang,et al.  Multiframe image restoration and registration , 1984 .

[64]  Truong Q. Nguyen,et al.  Image Superresolution Using Support Vector Regression , 2007, IEEE Transactions on Image Processing.

[65]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Wei Wang,et al.  Super-Resolution Reconstruction of High-Resolution Satellite ZY-3 TLC Images , 2017, Sensors.

[67]  R. Uthayakumar,et al.  Fractal interpolation on the Koch Curve , 2010, Comput. Math. Appl..

[68]  Tianxiang Yue,et al.  A new method of surface modeling and its application to DEM construction , 2007 .

[69]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[70]  Zhenhong Du,et al.  Achieving Higher Resolution Lake Area from Remote Sensing Images Through an Unsupervised Deep Learning Super-Resolution Method , 2020, Remote. Sens..

[71]  Franky Albert Noël Declercq,et al.  Interpolation Methods for Scattered Sample Data: Accuracy, Spatial Patterns, Processing Time , 1996 .

[72]  Tianxiang Yue,et al.  A method of DEM construction and related error analysis , 2010, Comput. Geosci..

[73]  New technique for selecting the vertices for a TIN and a comparison of TINs and DEMs over a variety of surfaces , 1991 .

[74]  Stephen Spittle,et al.  LoGSRN: Deep Super Resolution Network for Digital Elevation Model* , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[75]  Brooke E. Marston,et al.  Elevation models for reproducible evaluation of terrain representation , 2021 .