Exploring the Influence of Input Feature Space on CNN‐Based Geomorphic Feature Extraction From Digital Terrain Data

Many studies of Earth surface processes and landscape evolution rely on having accurate and extensive data sets of surficial geologic units and landforms. Automated extraction of geomorphic features using deep learning provides an objective way to consistently map landforms over large spatial extents. However, there is no consensus on the optimal input feature space for such analyses. We explore the impact of input feature space for extracting geomorphic features from land surface parameters (LSPs) derived from digital terrain models (DTMs) using convolutional neural network (CNN)‐based semantic segmentation deep learning. We compare four input feature space configurations: (a) a three‐layer composite consisting of a topographic position index (TPI) calculated using a 50 m radius circular window, square root of topographic slope, and TPI calculated using an annulus with a 2 m inner radius and 10 m outer radius, (b) a single illuminating position hillshade, (c) a multidirectional hillshade, and (d) a slopeshade. We test each feature space input using three deep learning algorithms and four use cases: two with natural features and two with anthropogenic features. The three‐layer composite generally provided lower overall losses for the training samples, a higher F1‐score for the withheld validation data, and better performance for generalizing to withheld testing data from a new geographic extent. Results suggest that CNN‐based deep learning for mapping geomorphic features or landforms from LSPs is sensitive to input feature space. Given the large number of LSPs that can be derived from DTM data and the variety of geomorphic mapping tasks that can be undertaken using CNN‐based methods, we argue that additional research focused on feature space considerations is needed and suggest future research directions. We also suggest that the three‐layer composite implemented here can offer better performance in comparison to using hillshades or other common terrain visualization surfaces and is, thus, worth considering for different mapping and feature extraction tasks.

[1]  M. Goodchild,et al.  Scale in Remote Sensing and GIS , 2023 .

[2]  D. Argialas,et al.  Automatic Identification of Marine Geomorphologic Features Using Convolutional Neural Networks in seafloor Digital Elevation Models: Segmentation of DEM for Marine Geomorphologic Feature Mapping with Deep Learning Algorithms , 2022, SETN.

[3]  O. Korup,et al.  Deep learning reveals one of Earth's largest landslide terrain in Patagonia , 2022, Earth and Planetary Science Letters.

[4]  M. Wilmking,et al.  Do small landforms have large effects? A review on the legacies of pre-industrial charcoal burning , 2022, Geomorphology.

[5]  Qihao Weng,et al.  Desert landform detection and mapping using a semi-automated object-based image analysis approach , 2022, Journal of Arid Environments.

[6]  Aaron E. Maxwell,et al.  Land-surface parameters for spatial predictive mapping and modeling , 2022, Earth-Science Reviews.

[7]  G. J. Maas,et al.  Comparing geomorphological maps made manually and by deep learning , 2021, Earth Surface Processes and Landforms.

[8]  Chandi Witharana,et al.  Mapping Relict Charcoal Hearths in New England Using Deep Convolutional Neural Networks and LiDAR Data , 2021, Remote. Sens..

[9]  Ben Moseley,et al.  Peering into lunar permanently shadowed regions with deep learning , 2021, Nature Communications.

[10]  Hong-chun Zhu,et al.  Deep learning of DEM image texture for landform classification in the Shandong area, China , 2021, Frontiers of Earth Science.

[11]  Norbert Pfeifer,et al.  Object‐based large‐scale terrain classification combined with segmentation optimization and terrain features: A case study in China , 2021, Trans. GIS.

[12]  J. Tegowski,et al.  Exploration of Glacial Landforms by Object-Based Image Analysis and Spectral Parameters of Digital Elevation Model , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Timothy A. Warner,et al.  Accuracy Assessment in Convolutional Neural Network-Based Deep Learning Remote Sensing Studies - Part 1: Literature Review , 2021, Remote. Sens..

[14]  Jianwei Ma,et al.  Deep Learning for Geophysics: Current and Future Trends , 2021, Reviews of Geophysics.

[15]  Loveneesh Rana,et al.  Extreme Low-Light Environment-Driven Image Denoising over Permanently Shadowed Lunar Regions with a Physical Noise Model , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  S. Saha,et al.  Modeling gully erosion susceptibility in Phuentsholing, Bhutan using deep learning and basic machine learning algorithms , 2021, Environmental Earth Sciences.

[17]  Omid Ghorbanzadeh,et al.  Evaluation of deep learning algorithms for national scale landslide susceptibility mapping of Iran , 2021, Geoscience Frontiers.

[18]  S. Golzari,et al.  Using the Boruta algorithm and deep learning models for mapping land susceptibility to atmospheric dust emissions in Iran , 2021 .

[19]  Alexandre Guyot,et al.  Combined Detection and Segmentation of Archeological Structures from LiDAR Data Using a Deep Learning Approach , 2021 .

[20]  T. Blaschke,et al.  An object based image analysis applied for volcanic and glacial landforms mapping in Sahand Mountain, Iran , 2020 .

[21]  T. Bolch,et al.  Automated detection of rock glaciers using deep learning and object-based image analysis , 2020 .

[22]  Peter A. Burrough,et al.  Natural Objects with Indeterminate Boundaries , 2020 .

[23]  Claudia Kuenzer,et al.  Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review - Part II: Applications , 2020, Remote. Sens..

[24]  Humphrey Shi,et al.  Deep Learning for 3D Point Cloud Understanding: A Survey , 2020, ArXiv.

[25]  Alaa Tharwat,et al.  Classification assessment methods , 2020, Applied Computing and Informatics.

[26]  S. Franklin Interpretation and use of geomorphometry in remote sensing: a guide and review of integrated applications , 2020 .

[27]  Homayoun Najjaran,et al.  Deep Learning Sensor Fusion for Autonomous Vehicle Perception and Localization: A Review , 2020, Sensors.

[28]  Timothy A. Warner,et al.  Thematic Classification Accuracy Assessment with Inherently Uncertain Boundaries: An Argument for Center-Weighted Accuracy Assessment Metrics , 2020, Remote. Sens..

[29]  Thorsten Hoeser,et al.  Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review-Part I: Evolution and Recent Trends , 2020, Remote. Sens..

[30]  Benjamin M. Jones,et al.  Transferability of the Deep Learning Mask R-CNN Model for Automated Mapping of Ice-Wedge Polygons in High-Resolution Satellite and UAV Images , 2020, Remote. Sens..

[31]  Roberto Pierdicca,et al.  Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage , 2020, Remote. Sens..

[32]  Josef Strobl,et al.  Deep learning-based approach for landform classification from integrated data sources of digital elevation model and imagery , 2020, Geomorphology.

[33]  Aaron E. Maxwell,et al.  Mapping the Topographic Features of Mining-Related Valley Fills Using Mask R-CNN Deep Learning and Digital Elevation Data , 2020, Remote. Sens..

[34]  Andrea Manconi,et al.  Mapping Landslides on EO Data: Performance of Deep Learning Models vs. Traditional Machine Learning Models , 2020, Remote. Sens..

[35]  Jianming Liang,et al.  UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[36]  Zheng Chen,et al.  A Review of Deep Learning-Based Semantic Segmentation for Point Cloud , 2019, IEEE Access.

[37]  Gong Cheng,et al.  Multi-modal deep learning for landform recognition , 2019 .

[38]  Neeraj Kumar,et al.  Deep learning models for traffic flow prediction in autonomous vehicles: A review, solutions, and challenges , 2019, Veh. Commun..

[39]  Conrad M Albrecht,et al.  Learning and Recognizing Archeological Features from LiDAR Data , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[40]  Alexandre M.J.C. Wadoux,et al.  Using deep learning for multivariate mapping of soil with quantified uncertainty , 2019, Geoderma.

[41]  Yuhao Wang,et al.  A deep learning algorithm using a fully connected sparse autoencoder neural network for landslide susceptibility prediction , 2019, Landslides.

[42]  Lei Ma,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[43]  Budiman Minasny,et al.  Pedology and digital soil mapping (DSM) , 2019, European Journal of Soil Science.

[44]  A. Zhu,et al.  Bank gully extraction from DEMs utilizing the geomorphologic features of a loess hilly area in China , 2019, Frontiers of Earth Science.

[45]  Anders U. Waldeland,et al.  Using deep neural networks on airborne laser scanning data: Results from a case study of semi‐automatic mapping of archaeological topography on Arran, Scotland , 2018, Archaeological Prospection.

[46]  Berkman Sahiner,et al.  Deep learning in medical imaging and radiation therapy. , 2018, Medical physics.

[47]  Naimul Mefraz Khan,et al.  A Novel Focal Tversky Loss Function With Improved Attention U-Net for Lesion Segmentation , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[48]  R. MacMillan,et al.  Multi-scale digital soil mapping with deep learning , 2018, Scientific Reports.

[49]  Alexandr A. Kalinin,et al.  Albumentations: fast and flexible image augmentations , 2018, Inf..

[50]  Weixing Zhang,et al.  Deep Convolutional Neural Networks for Automated Characterization of Arctic Ice-Wedge Polygons in Very High Spatial Resolution Aerial Imagery , 2018, Remote. Sens..

[51]  Budiman Minasny,et al.  Using deep learning for digital soil mapping , 2018, SOIL.

[52]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[53]  Timothy A. Warner,et al.  Implementation of machine-learning classification in remote sensing: an applied review , 2018 .

[54]  Alexandre Guyot,et al.  Detecting Neolithic Burial Mounds from LiDAR-Derived Elevation Data Using a Multi-Scale Approach and Machine Learning Techniques , 2018, Remote. Sens..

[55]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[56]  Geoffrey J. Hay,et al.  Geographic object-based image analysis (GEOBIA): emerging trends and future opportunities , 2018 .

[57]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[58]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[59]  Andrei Dornik,et al.  Classification of Soil Types Using Geographic Object-Based Image Analysis and Random Forests , 2017, Pedosphere.

[60]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[61]  Mryka Hall-Beyer,et al.  Practical guidelines for choosing GLCM textures to use in landscape classification tasks over a range of moderate spatial scales , 2017 .

[62]  Giulia Sofia,et al.  Frontiers in Geomorphometry and Earth Surface Dynamics: Possibilities, Limitations and Perspectives , 2016 .

[63]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[64]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[66]  Budiman Minasny,et al.  Digital soil mapping: A brief history and some lessons , 2016 .

[67]  G. Pedersen,et al.  Semi-automatic classification of glaciovolcanic landforms: An object-based mapping approach based on geomorphometry , 2016 .

[68]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[69]  M. Zortea,et al.  Automatic detection of mound structures in airborne laser scanning data , 2015 .

[70]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[71]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[72]  William E. Carter,et al.  Archaeological prospection of north Eastern Honduras with airborne mapping LiDAR , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[73]  Stephen V. Stehman,et al.  Estimating area and map accuracy for stratified random sampling when the strata are different from the map classes , 2014 .

[74]  P. Tarolli High-resolution topography for understanding Earth surface processes: Opportunities and challenges , 2014 .

[75]  R A Diaz-Varela,et al.  Automatic identification of agricultural terraces through object-oriented analysis of very high resolution DSMs and multispectral imagery obtained from an unmanned aerial vehicle. , 2014, Journal of environmental management.

[76]  Giulia Sofia,et al.  High‐resolution topography and anthropogenic feature extraction: testing geomorphometric parameters in floodplains , 2014 .

[77]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[78]  Bing Zhang,et al.  A Review of Remote Sensing Image Classification Techniques: the Role of Spatio-contextual Information , 2014 .

[79]  S. Stehman Estimating area from an accuracy assessment error matrix , 2013 .

[80]  Thomas Blaschke,et al.  An Object-Based Workflow to Extract Landforms at Multiple Scales From Two Distinct Data Types , 2013, IEEE Geoscience and Remote Sensing Letters.

[81]  L. Drăguţ,et al.  Object-based landform delineation and classification from DEMs for archaeological predictive mapping , 2012 .

[82]  I. Evans Geomorphometry and landform mapping: What is a landform? , 2012 .

[83]  S. Walsh,et al.  Geospatial technologies and digital geomorphological mapping: Concepts, issues and research , 2012 .

[84]  André Stumpf,et al.  Object-oriented mapping of landslides using Random Forests , 2011 .

[85]  Timothy A. Warner,et al.  Kernel-Based Texture in Remote Sensing Image Classification , 2011 .

[86]  Mandy J. Munro-Stasiuk,et al.  An object-oriented approach to automated landform mapping: A case study of drumlins , 2011, Comput. Geosci..

[87]  D. A. Word,et al.  Structural and functional characteristics of natural and constructed channels draining a reclaimed mountaintop removal and valley fill coal mine , 2010, Journal of the North American Benthological Society.

[88]  G. Tucker,et al.  Modelling landscape evolution , 2010 .

[89]  Kosmas Pavlopoulos,et al.  Mapping Geomorphological Environments , 2009 .

[90]  Giles M. Foody,et al.  Harshness in image classification accuracy assessment , 2008 .

[91]  I. Evans,et al.  Elementary forms for land surface segmentation: The theoretical basis of terrain analysis and geomorphological mapping , 2008 .

[92]  Robert B McMaster,et al.  Introduction: Scale and Geographic Inquiry , 2008 .

[93]  T. Blaschke,et al.  Automated classification of landform elements using object-based image analysis , 2006 .

[94]  Arie C. Seijmonsbergen,et al.  A new symbol and GIS based detailed geomorphological mapping system: renewal of a scientific discipline for understanding landscape development , 2006 .

[95]  Gyozo Jordan,et al.  Application of wavelet analysis to the study of spatial pattern of morphotectonic lineaments in digital terrain models. A case study , 2005 .

[96]  Robert B McMaster,et al.  Scale and Geographic Inquiry , 2004 .

[97]  Thomas H Meyer,et al.  Terrain Analysis: Principles and Applications , 2001 .

[98]  J. Blaszczyński,et al.  LANDFORM CHARACTERIZATION WITH GEOGRAPHIC INFORMATION SYSTEMS , 1997 .

[99]  J. Flageollet The time dimension in the study of mass movements , 1996 .

[100]  Robert W. Blair,et al.  Geomorphology from space: A global overview of regional landforms , 1987 .

[101]  J. C. Doornkamp,et al.  Large scale geomorphological mapping and Highway engineering design , 1975, Quarterly Journal of Engineering Geology.

[102]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[103]  Timothy A. Warner,et al.  Accuracy Assessment in Convolutional Neural Network-Based Deep Learning Remote Sensing Studies - Part 2: Recommendations and Best Practices , 2021, Remote. Sens..

[104]  Vijayan K. Asari,et al.  GlacierNet: A Deep-Learning Approach for Debris-Covered Glacier Mapping , 2020, IEEE Access.

[105]  Jasjit S Suri,et al.  State-of-the-art review on deep learning in medical imaging. , 2019, Frontiers in bioscience.

[106]  Ute Beyer,et al.  Remote Sensing And Image Interpretation , 2016 .

[107]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[108]  Eric W. Constance,et al.  The 3D Elevation Program initiative: a call for action , 2014 .

[109]  Herman Theodoor Verstappen,et al.  Old and New Trends in Geomorphological and Landform Mapping , 2011 .

[110]  Domenico Guida,et al.  Nature and Aims of Geomorphological Mapping , 2011 .

[111]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[112]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[113]  Geoffrey J. Hay,et al.  Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline , 2008 .

[114]  Philippe Lagacherie,et al.  Digital Soil Mapping: A State of the Art , 2008 .

[115]  Robert M. Haralick,et al.  Combined spectral and spatial processing of ERTS imagery data , 1974 .