Sorted pulse data (SPD) library. Part I: A generic file format for LiDAR data from pulsed laser systems in terrestrial environments

The management and spatial-temporal integration of LiDAR data from different sensors and platforms has been impeded by a lack of generic open source tools and standards. This paper presents a new generic file format description (sorted pulse data; SPD) for the storage and processing of airborne and terrestrial LiDAR data. The format is designed specifically to support both traditional discrete return and waveform data, using a pulse (rather than point) based data model. The SPD format also supports 2D spatial indexing of the pulses, where pulses can be referenced using cartesian, spherical, polar or scan geometry coordinate systems and projections. These indexes can be used to significantly speed up data processing whilst allowing the data to be appropriately projected and are particularly useful when analysing and interpreting TLS data. The format is defined within a HDF5 file, which provides a number of benefits including broad support across a wide range of platforms and architectures and support for file compression. An implementation of the format is available within the open source sorted pulse data software library (SPDLib; http://www.spdlib.org). Highlights? A new open file format for the storage and processing of LiDAR. ? Specific support for the storage of waveform and discrete return data. ? Development of a pulsed based structure with simplifies many situations. ? Explicit inclusion of a spatial index which supports multiple projections.

[1]  C. Mallet,et al.  Terrain surfaces and 3-D landcover classification from small footprint full-waveform lidar data: application to badlands , 2009 .

[2]  Andrew Thomas Hudak,et al.  A Multiscale Curvature Algorithm for Classifying Discrete Return LiDAR in Forested Environments , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[3]  W. Wagner,et al.  Gaussian decomposition and calibration of a novel small-footprint full-waveform digitising airborne laser scanner , 2006 .

[4]  Uwe Stilla,et al.  Iterative processing of laser scanning data by full waveform analysis , 2008 .

[5]  Gottfried Mandlburger,et al.  THE OPALS DATA MANAGER - EFFICIENT DATA MANAGEMENT FOR PROCESSING LARGE AIRBORNE LASER SCANNING PROJECTS , 2012 .

[6]  Emmanuel P. Baltsavias,et al.  Airborne laser scanning: basic relations and formulas , 1999 .

[7]  Peter Scarth,et al.  Prediction and validation of foliage projective cover from Landsat-5 TM and Landsat-7 ETM+ imagery , 2009 .

[8]  A. Neuenschwander,et al.  Evaluation of waveform deconvolution and decomposition retrieval algorithms for ICESat/GLAS data , 2008 .

[9]  N. Coops,et al.  Estimating canopy structure of Douglas-fir forest stands from discrete-return LiDAR , 2007, Trees.

[10]  Frédéric Bretar,et al.  Full-waveform topographic lidar : State-of-the-art , 2009 .

[11]  Anna Hughes.  NewsBriefs: ASPRS Seeks Support for Landsat (American Society for Photogrammetry and Remote Sensing) , 2003 .

[12]  I. Burke,et al.  Estimating stand structure using discrete-return lidar: an example from low density, fire prone ponderosa pine forests , 2005 .

[13]  Ross A. Hill,et al.  Mapping woodland species composition and structure using airborne spectral and LiDAR data , 2005 .

[14]  Roland Brandl,et al.  Assessing biodiversity by remote sensing in mountainous terrain: the potential of LiDAR to predict forest beetle assemblages , 2009 .

[15]  J. Hyyppä,et al.  Airborne Laser Scanning , 2009 .

[16]  Keqi Zhang,et al.  Identification of gaps in mangrove forests with airborne LIDAR , 2008 .

[17]  Timothy J. Malthus,et al.  A Multispectral Canopy LiDAR Demonstrator Project , 2011, IEEE Geoscience and Remote Sensing Letters.

[18]  Jon Louis Bentley,et al.  Quad trees a data structure for retrieval on composite keys , 1974, Acta Informatica.

[19]  Norbert Pfeifer,et al.  ORIENTATION AND PROCESSING OF AIRBORNE LASER SCANNING DATA (OPALS) - CONCEPT AND FIRST RESULTS OF A COMPREHENSIVE ALS SOFTWARE , 2009 .

[20]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[21]  Alex C. Lee,et al.  A LiDAR-derived canopy density model for tree stem and crown mapping in Australian forests , 2007 .

[22]  Philip Lewis,et al.  Simulating the impact of discrete-return lidar system and survey characteristics over young conifer and broadleaf forests , 2010 .

[23]  S. Durrieu,et al.  Advanced full-waveform lidar data echo detection: Assessing quality of derived terrain and tree height models in an alpine coniferous forest , 2009 .

[24]  Hans-Gerd Maas,et al.  Automatic forest inventory parameter determination from terrestrial laser scanner data , 2008 .

[25]  William Puech,et al.  FullAnalyze: A Research tool for handling, processing and analyzing full-waveform lidar data , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[26]  M. Nilsson.  Estimation of tree heights and stand volume using an airborne lidar system , 1996 .

[27]  Nicholas C. Coops,et al.  Evaluating error associated with lidar-derived DEM interpolation , 2009, Comput. Geosci..

[28]  C. Woodcock,et al.  Estimating forest LAI profiles and structural parameters using a ground-based laser called 'Echidna'. , 2008, Tree physiology.

[29]  Chengcui Zhang,et al.  A progressive morphological filter for removing nonground measurements from airborne LIDAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[30]  E. Næsset.  Predicting forest stand characteristics with airborne scanning laser using a practical two-stage procedure and field data , 2002 .

[31]  Alistair M. S. Smith,et al.  Discrete Return Lidar in Natural Resources: Recommendations for Project Planning, Data Processing, and Deliverables , 2009, Remote. Sens..

[32]  Thomas H. Painter,et al.  Modeling the View Angle Dependence of Gap Fractions in Forest Canopies: Implications for Mapping Fractional Snow Cover Using Optical Remote Sensing , 2008 .

[33]  Dimitri Lague,et al.  3D Terrestrial LiDAR data classification of complex natural scenes using a multi-scale dimensionality criterion: applications in geomorphology , 2011, ArXiv.

[34]  Chaitanya K. Baru,et al.  OpenTopography: a services oriented architecture for community access to LIDAR topography , 2011, COM.Geo.

[35]  M. Pfennigbauer,et al.  Laser scanning by echo signal digitization and waveform processing , 2011 .

[36]  A. Suratno,et al.  Tree species identification in mixed coniferous forest using airborne laser scanning , 2009 .

[37]  Aloysius Wehr,et al.  Airborne laser scanning—an introduction and overview , 1999 .

[38]  Benjamin Koetz,et al.  Forest Canopy Gap Fraction From Terrestrial Laser Scanning , 2007, IEEE Geoscience and Remote Sensing Letters.

[39]  R. Shaw,et al.  Leaf area measurements based on hemispheric photographs and leaf-litter collection in a deciduous forest during autumn leaf-fall , 1989 .