Fully automatic spatiotemporal segmentation of 3D LiDAR time series for the extraction of natural surface changes

Abstract Geographic observation benefits from the increasing availability of time series of 3D geospatial data, which allow analysis of change processes at high temporal detail and over extensive periods. In this context, the demand for advanced methods to detect and extract topographic surface changes from these 4D geospatial data emerges. Changes in natural scenes occur with varying magnitude, duration, spatial extent, and change rate, and the timing of their occurrence is not known. Standard pairwise change detection requires the selection of fixed analysis periods and the specification of magnitude thresholds to determine accumulation or erosion forms. In settings with continuous surface morphology and dynamic changes to the surface due to material transport, such change forms are typically temporary and may be missed or aggregated if they occur with spatial and/or temporal overlap. This is overcome with the extraction of 4D objects-by-change (4D-OBCs). These objects are obtained by firstly detecting surface changes in the temporal domain at locations in the scene. Subsequently, they are spatially delineated by considering the full history of surface change during region growing from the seed location of a detected change. To perform this spatiotemporal segmentation systematically for entire 3D time series, we develop a fully automatic approach of seed detection and selection, combined with locally adaptive thresholding for region growing of individual objects with varying change properties. We apply our workflow to a five-months hourly time series of around 3,000 terrestrial laser scanning point clouds acquired for coastal monitoring at a sandy beach in The Netherlands. This provides 2,021 4D-OBCs as extracted accumulation or erosion forms. Results are validated through majority agreement of six expert analysts, who evaluate the segmentation performance at sample locations throughout the scene. Accordingly, our method extracts surface changes with an error of omission of 4.7% and an error of commission of 16.6%. We examine the results and provide considerations how postprocessing of segments can further improve the change analysis workflow. The developed approach thereby provides a powerful tool for automatic change analysis in 4D geospatial data, namely to detect and delineate natural surface changes across space and time.

[1]  Gottfried Mandlburger,et al.  Beyond 3-D: The New Spectrum of Lidar Applications for Earth and Ecological Sciences , 2016 .

[2]  B. Bauer,et al.  Scale-dependent perspectives on the geomorphology and evolution of beach-dune systems , 2017 .

[3]  B. Höfle,et al.  Measurement of rock glacier surface change over different timescales using terrestrial laser scanning point clouds , 2021, Earth Surface Dynamics.

[4]  D. Lague,et al.  Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z) , 2013, 1302.1183.

[5]  Michael Lehning,et al.  Spatial and temporal variability of snow depth and ablation rates in a small mountain catchment , 2010 .

[6]  Bernhard Höfle,et al.  4D objects-by-change: Spatiotemporal segmentation of geomorphic surface change from LiDAR time series , 2020 .

[7]  C. Fey,et al.  A compilation of multitemporal TLS snow depth distribution maps at the Weisssee snow research site (Kaunertal, Austria) , 2019, Water Resources Research.

[8]  R. Lindenbergh,et al.  Coastscan: Continuous monitoring of coastal change using terrestrial laser scanning , 2017 .

[9]  Zhe Zhu,et al.  Mapping forest change using stacked generalization: An ensemble approach , 2018 .

[10]  R. Lindenbergh,et al.  Coastal change patterns from time series clustering of permanent laser scan data , 2020, Earth Surface Dynamics.

[11]  Martin Rutzinger,et al.  MULTITEMPORAL ANALYSIS OF OBJECTS IN 3D POINT CLOUDS FOR LANDSLIDE MONITORING , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[12]  H. Mara,et al.  HIGH-FREQUENCY 3D GEOMORPHIC OBSERVATION USING HOURLY TERRESTRIAL LASER SCANNING DATA OF A SANDY BEACH , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[13]  T. Glade,et al.  The “Salcher” landslide observatory—experimental long-term monitoring in the Flysch Zone of Lower Austria , 2019, Bulletin of Engineering Geology and the Environment.

[14]  Jan Pfeiffer,et al.  Derivation of Three-Dimensional Displacement Vectors from Multi-Temporal Long-Range Terrestrial Laser Scanning at the Reissenschuh Landslide (Tyrol, Austria) , 2018, Remote. Sens..

[15]  Characterizing beach intertidal bar systems using multi‐annual LiDAR data , 2019, Earth Surface Processes and Landforms.

[16]  P. Hartzell,et al.  Continuous Coastal Monitoring with an Automated Terrestrial Lidar Scanner , 2019, Journal of Marine Science and Engineering.

[17]  N. Pfeifer,et al.  Water surface mapping from airborne laser scanning using signal intensity and elevation data , 2009 .

[18]  Stefano Fabbri,et al.  Geomorphological analysis and classification of foredune ridges based on Terrestrial Laser Scanning (TLS) technology , 2017 .

[19]  E. Chuvieco,et al.  Mapping burned areas from Landsat TM/ETM+ data with a two-phase algorithm: Balancing omission and commission errors , 2011 .

[20]  B. Höfle,et al.  Multi‐temporal 3D point cloud‐based quantification and analysis of geomorphological activity at an alpine rock glacier using airborne and terrestrial LiDAR , 2019, Permafrost and Periglacial Processes.

[21]  Zhe Zhu,et al.  Cloud detection algorithm comparison and validation for operational Landsat data products , 2017 .

[22]  Stéphane Jaillet,et al.  Multi-Annual Kinematics of an Active Rock Glacier Quantified from Very High-Resolution DEMs: An Application-Case in the French Alps , 2018, Remote. Sens..

[23]  S. J. Oude Elberink,et al.  Object‐based classification of terrestrial laser scanning point clouds for landslide monitoring , 2017 .

[24]  D. Girardeau-Montaut,et al.  CHANGE DETECTION ON POINTS CLOUD DATA ACQUIRED W ITH A GROUND LASER SCANNER , 2005 .

[25]  Yukun Lin,et al.  A New Time Series Change Detection Method for Landsat Land use and Land Cover Change , 2019, 2019 10th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp).

[26]  M. Hodgson,et al.  Geomorphic change detection using historic maps and DEM differencing: The temporal dimension of geospatial analysis , 2012 .

[27]  Bernhard Höfle,et al.  3D micro-mapping: Towards assessing the quality of crowdsourcing to support 3D point cloud analysis , 2018 .

[28]  A. Abellán,et al.  Detection and spatial prediction of rockfalls by means of terrestrial laser scanner monitoring , 2010 .

[29]  Richard J. Hardy,et al.  Optimising 4-D surface change detection: an approach for capturing rockfall magnitude–frequency , 2018 .

[30]  Brian Gray,et al.  Development and Optimization of an Automated Fixed-Location Time Lapse Photogrammetric Rock Slope Monitoring System , 2019, Remote. Sens..

[31]  Jiaojiao Tian,et al.  3D change detection – Approaches and applications , 2016 .

[32]  D. Petley,et al.  Patterns of precursory rockfall prior to slope failure , 2007 .

[33]  B. Höfle,et al.  Multitemporal terrestrial laser scanning point clouds for thaw subsidence observation at Arctic permafrost monitoring sites , 2020, Earth Surface Processes and Landforms.

[34]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[35]  Qiusheng Wu,et al.  An object-based conceptual framework and computational method for representing and analyzing coastal morphological changes , 2010, Int. J. Geogr. Inf. Sci..

[36]  Anette Eltner,et al.  Time lapse structure‐from‐motion photogrammetry for continuous geomorphic monitoring , 2017 .

[37]  M. Jaboyedoff,et al.  Characterization and monitoring of the Åknes rockslide using terrestrial laser scanning , 2009 .

[38]  D. J. Hutchinson,et al.  Automated Terrestrial Laser Scanning with Near Real-Time Change Detection – Monitoring of the Séchilienne Landslide , 2017 .