Processing of Extremely High Resolution LiDAR and RGB Data: Outcome of the 2015 IEEE GRSS Data Fusion Contest—Part B: 3-D Contest

In this paper, we report the outcomes of the 2015 data fusion contest organized by the Image Analysis and Data Fusion Technical Committee (IADF TC) of the IEEE Geoscience and Remote Sensing Society. As for previous years, the IADF TC organized a data fusion contest aiming at fostering new ideas and solutions for multisource studies. The 2015 edition of the contest proposed a multiresolution and multisensorial challenge involving extremely high resolution RGB images (with a ground sample distance of 5 cm) and a 3-D light detection and ranging point cloud (with a point cloud density of approximatively 65 pts/m2 ). The competition was framed in two parallel tracks, considering 2-D and 3-D products, respectively. In this Part B, we report the results obtained by the winners of the 3-D contest, which explored challenging tasks of road extraction and ISO containers identification, respectively. The 2-D part of the contest and a detailed presentation of the dataset are discussed in Part A.

[1]  Michela Bertolotto,et al.  Octree-based region growing for point cloud segmentation , 2015 .

[2]  Hyojin Kim,et al.  Automatic registration of LiDAR and optical imagery using depth map stereo , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[3]  Samia Boukir,et al.  Relevance of airborne lidar and multispectral image data for urban scene classification using Random Forests , 2011 .

[4]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Takashi Matsuyama,et al.  SIGMA: A Knowledge-Based Aerial Image Understanding System , 1990 .

[6]  Christiaan Perneel,et al.  Detection of vehicles in shadow areas using combined hyperspectral and lidar data , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Ioannis Stamos,et al.  Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes , 2008, International Journal of Computer Vision.

[8]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[9]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[10]  George Wolberg,et al.  Multiview Geometry for Texture Mapping 2D Images Onto 3D Range Data , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Xiaohuan Xi,et al.  Fusion of Airborne Discrete-Return LiDAR and Hyperspectral Data for Land Cover Classification , 2015, Remote. Sens..

[12]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..

[13]  E. Zelniker,et al.  Detection and vectorization of roads from lidar data , 2007 .

[14]  Edoardo Pasolli,et al.  A Framework for Land Cover Classification Using Discrete Return LiDAR Data: Adopting Pseudo-Waveform and Hierarchical Segmentation , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Lena Vogler,et al.  Computer Processing Of Remotely Sensed Images An Introduction , 2016 .

[16]  Qian Du,et al.  Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Avideh Zakhor,et al.  Tree Detection in Urban Regions Using Aerial Lidar and Image Data , 2007, IEEE Geoscience and Remote Sensing Letters.

[18]  Aleksey Boyko,et al.  Extracting roads from dense point clouds in large scale urban environment , 2011 .

[19]  John B. Vogler,et al.  LiDAR-Landsat data fusion for large-area assessment of urban land cover: Balancing spatial resolution, data volume and mapping accuracy , 2012 .

[20]  Birger Hjørland,et al.  The concept of information , 2005, Annu. Rev. Inf. Sci. Technol..

[21]  Franz Rottensteiner,et al.  Building and Road Extraction by LiDAR and Imagery , 2017 .

[22]  Yongjun Zhang,et al.  Road Centerline Extraction in Complex Urban Scenes From LiDAR Data Based on Multiple Features , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[23]  L. Zadeh.  Fuzzy sets as a basis for a theory of possibility , 1999 .

[24]  Christian Früh,et al.  Automated texture mapping of 3D city models with oblique aerial imagery , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[25]  Jean-Emmanuel Deschaud,et al.  A Fast and Accurate Plane Detection Algorithm for Large Noisy Point Clouds Using Filtered Normals and Voxel Growing , 2010 .

[26]  Xiang Zhou,et al.  Seamless Fusion of LiDAR and Aerial Imagery for Building Extraction , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[28]  Xiaoyong Chen,et al.  Extraction of City Roads Through Shadow Path Reconstruction Using Laser Data , 2004 .

[29]  Radim Sára,et al.  Spatial Pattern Templates for Recognition of Objects with Regular Structure , 2013, GCPR.

[30]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Xiangyun Hu,et al.  Automatic Road Extraction from Dense Urban Area by Integrated Processing of High Resolution Imagery and Lidar Data , 2004 .

[32]  Debra F. Laefer,et al.  Visualisation of urban airborne laser scanning data with occlusion images , 2015 .

[33]  John Trinder,et al.  Building detection by fusion of airborne laser scanner data and multi-spectral images : Performance evaluation and sensitivity analysis , 2007 .

[34]  Yanming Chen,et al.  Multiscale Grid Method for Detection and Reconstruction of Building Roofs from Airborne LiDAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Bao Quanf,et al.  Automated Road Extraction from LiDAR Data Based on Clustering of Intensity , 2011 .

[36]  Vijaya Musande,et al.  Automatic Road Extraction from Airborne LiDAR : A Review , 2014 .

[37]  T. Schenk.  FUSION OF LIDAR DATA AND AERIAL IMAGERY FOR A MORE COMPLETE SURFACE DESCRIPTION , 2002 .

[38]  Lipu Zhou.  Fusing laser point cloud and visual image at data level using a new reconstruction algorithm , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[39]  F. Rottensteiner,et al.  The Automatic Extraction of Roads from LIDAR data , 2004 .

[40]  Ayman Habib.  Accuracy, Quality Assurance, and Quality Control of LiDAR Data , 2017 .

[41]  J. Brasington,et al.  Object-based land cover classification using airborne LiDAR , 2008 .

[42]  Madhurima Bandyopadhyay,et al.  Classification and extraction of trees and buildings from urban scenes using discrete return LiDAR and aerial color imagery , 2013, Defense, Security, and Sensing.

[43]  Dirk Tiede,et al.  A new geospatial overlay method for the analysis and visualization of spatial change patterns using object-oriented data modeling concepts , 2014, Cartography and geographic information science.

[44]  D. Hölbling,et al.  Object-based Class Modeling for Cadastre-constrained Delineation of Geo-objects , 2010 .

[45]  Hang Jin.  An integrated approach for precise road reconstruction from aerial imagery and LiDAR data , 2011 .

[46]  J. Hogg.  Quantitative remote sensing of land surfaces , 2004 .

[47]  Philip S. Yu,et al.  Top 10 algorithms in data mining , 2007, Knowledge and Information Systems.

[48]  Yuri Owechko,et al.  2D/3D Sensor Exploitation and Fusion for Enhanced Object Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[49]  Alexandre Boulch,et al.  Processing of Extremely High-Resolution LiDAR and RGB Data: Outcome of the 2015 IEEE GRSS Data Fusion Contest–Part A: 2-D Contest , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[50]  N. Pfeifer,et al.  Correction of laser scanning intensity data: Data and model-driven approaches , 2007 .

[51]  Mario Romero,et al.  ROAD AND ROADSIDE FEATURE EXTRACTION USING IMAGERY AND LIDAR DATA FOR TRANSPORTATION OPERATION , 2015 .

[52]  Debra F. Laefer,et al.  Aerial laser scanning and imagery data fusion for road detection in city scale , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[53]  Eyal Ben-Dor,et al.  Fusion of Optical and Thermal Imagery and LiDAR Data for Application to 3-D Urban Environment and Structure Monitoring , 2012 .

[54]  Joost van de Weijer,et al.  Color in Computer Vision: Fundamentals and Applications , 2012 .

[55]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[56]  Lewis D. Griffin,et al.  Optimality of the basic colour categories for classification , 2006, Journal of The Royal Society Interface.

[57]  D. Zaum,et al.  ROBUST BUILDING DETECTION IN AERIAL IMAGES , 2005 .

[58]  Lorenzo Bruzzone,et al.  A Three-Dimensional Model-Based Approach to the Estimation of the Tree Top Height by Fusing Low-Density LiDAR Data and Very High Resolution Optical Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[60]  C. Hilario,et al.  Detection and classification of road lanes with a frequency analysis , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[61]  V. Kadatskiy Riegl Usa,et al.  ACCURACY AND ERROR ASSESSMENT OF TERRESTRIAL, MOBILE AND AIRBORNE LIDAR , 2011 .

[62]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[63]  B. Julesz,et al.  Texton gradients: The texton theory revisited , 2004, Biological Cybernetics.

[64]  Hyo Jong Lee,et al.  Heuristic Road Extraction , 2007, 2007 International Symposium on Information Technology Convergence (ISITC 2007).

[65]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[66]  G. Sithole.  DETECTION OF BRICKS IN A MASONRY WALL , 2008 .

[67]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .

[68]  Peter van Oosterom,et al.  The Spatial Location Code , 2010 .

[69]  Robert A. Lordo,et al.  Learning from Data: Concepts, Theory, and Methods , 2001, Technometrics.

[70]  Haiyan Guan,et al.  3D Building Reconstruction from Airborne Lidar Point Clouds Fused with Aerial Imagery , 2011 .

[71]  Csaba Benedek,et al.  Extraction of Vehicle Groups in Airborne Lidar Point Clouds With Two-Level Point Processes , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Kensaku Fujii,et al.  Urban object reconstruction using airborne laser elevation image and aerial image , 2002, IEEE Trans. Geosci. Remote. Sens..

[73]  Patrick Hostert,et al.  Remote Sensing and Spatial Modelling of the Urban Environment , 2011 .

[74]  Gordon Petrie,et al.  Introduction to Laser Ranging, Profiling, and Scanning , 2017 .

[75]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[76]  Palma Blonda,et al.  Automatic Spectral-Rule-Based Preliminary Classification of Radiometrically Calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye, and DMC/SPOT-1/-2 Imagery—Part I: System Design and Implementation , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[77]  J. M. H. D. Buf,et al.  Image morphology: from perception to rendering , 2007 .

[78]  Dirk Tiede,et al.  Geospatial 2D and 3D object-based classification and 3D reconstruction of ISO-containers depicted in a LiDAR data set and aerial imagery of a harbor , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[79]  John Skilling.  Programming the Hilbert curve , 2004 .

[80]  Hyo Jong Lee,et al.  Three-Dimensional LiDAR Data Classifying to Extract Road Point in Urban Area , 2008, IEEE Geoscience and Remote Sensing Letters.