Modelling and monitoring urban built environment via multi-source integrated and fused remote sensing data

Investigation of urban built environment includes a wide range of applications that require 3-D information. New approaches are needed for near-real-time analysis of the urban environment with natural 3-D visualisation of extensive coverage. Hyperspectral remote sensing technology is a promising and powerful tool to assess quantitative classification of urban materials by exploring possible chemical/physical changes using spectral information across the VIS-NIR-SWIR spectral region. Light Detection And Ranging (LiDAR) technology offers precise information about the geometrical properties of the surfaces and can reflect the different shapes and formations in the complex urban environment. Generating a monitoring system that is based on integrative fusion of hyperspectral and LiDAR data may enlarge the application envelope of each individual technology and contribute valuable information on urban built environments and planning. A fusion process defined by a data-registration algorithm and including spectral/spatial and 3-D information is developed and presented. The proposed practical 3-D urban environment application for photogrammetric and urban planning purposes integrates the hyperspectral (spectrometer, ground camera and airborne sensor) and LiDAR data. This application may provide urban planners, civil engineers and decision-makers with tools to consider quantitative spectral information in the 3-D urban space.

[1]  Hiroshi Masaharua,et al.  A FILTERING METHOD OF AIRBORNE LASER SCANNER DATA FOR COMPLEX TERRAIN , 2002 .

[2]  Klaus Tempfli,et al.  AUTOMATIC BUILDING EXTRACTION FROM AIRBORNE LASER SCANNING DATA , 2000 .

[3]  Heung-Kyu Lee,et al.  Towards knowledge-based extraction of roads from 1 m-resolution satellite images , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[4]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[5]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[6]  Xuexia Chen,et al.  Using lidar and effective LAI data to evaluate IKONOS and Landsat 7 ETM+ vegetation cover estimates in a ponderosa pine forest , 2004 .

[7]  M. Ridd Exploring a V-I-S (vegetation-impervious surface-soil) model for urban ecosystem analysis through remote sensing: comparative anatomy for cities , 1995 .

[8]  C. Vincent Tao DATABASE-GUIDED AUTOMATIC INSPECTION OF VERTICALLY STRUCTURED TRANSPORTATION OBJECTS FROM MOBILE MAPPING IMAGE SEQUENCES , 2001 .

[9]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[10]  Jie Shan,et al.  Segmentation and Reconstruction of Polyhedral Building Roofs From Aerial Lidar Point Clouds , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[12]  I. Dowman,et al.  Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction * , 2007 .

[13]  Linda G. Shapiro,et al.  Computer Vision , 2001 .

[14]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[15]  Martin Dodge,et al.  Towards the Virtual City: VR & Internet GIS for Urban Planning , 1998 .

[16]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[17]  Stefan Hinz,et al.  Automatic extraction of urban road networks from multi-view aerial imagery , 2003 .

[18]  Horst Bunke,et al.  Edge Detection in Range Images Based on Scan Line Approximation , 1999, Comput. Vis. Image Underst..

[19]  Kurt Brassel A Model for Automatic Hill-Shading , 1974 .

[20]  José Luis Lerma,et al.  Unsupervised robust planar segmentation of terrestrial laser scanner point clouds based on fuzzy clustering methods , 2008 .

[21]  Michel Devy,et al.  Fast range image segmentation by an edge detection strategy , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[22]  Jacqueline Le Moigne,et al.  Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery , 2005, IEEE Transactions on Image Processing.

[23]  Robert De Wulf,et al.  Sub-pixel mapping with neural networks : real-world spatial configurations learned from artificial shapes , 2003 .

[24]  J. Shan,et al.  SEGMENTATION OF LIDAR POINT CLOUDS FOR BUILDING EXTRACTION , 2009 .

[25]  J. Trinder,et al.  Automated delineation of roof planes from LIDAR data , 2005 .

[26]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[27]  Noel A Cressie,et al.  Statistics for Spatial Data, Revised Edition. , 1994 .

[28]  George Vosselman,et al.  Experimental comparison of filter algorithms for bare-Earth extraction from airborne laser scanning point clouds , 2004 .

[29]  Ansgar Brunn,et al.  3rd International Workshop: Automatic Extraction of Man-Made Objects from Aerial and Space Images , 2001, Künstliche Intell..

[30]  F. Rottensteiner,et al.  The Automatic Extraction of Roads from LIDAR data , 2004 .

[31]  Yerach Doytsher,et al.  Automatic DTM Extraction from Dense Raw LIDAR Data in Urban Areas , 2003 .

[32]  Alberta Bianchin,et al.  Remote Sensing and Urban Analysis , 2008, ICCSA.

[33]  Wolfgang Eckstein,et al.  Extracting objects from digital terrain models , 1995, Optics & Photonics.

[34]  Carsten Steger,et al.  Extracting Curvilinear Structures: A Differential Geometric Approach , 1996, ECCV.

[35]  Magdy A. Bayoumi,et al.  A multi-modal automatic image registration technique based on complex wavelets , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[36]  Chengcui Zhang,et al.  A progressive morphological filter for removing nonground measurements from airborne LIDAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[37]  J. Shan,et al.  Building boundary tracing and regularization from airborne lidar point clouds , 2007 .

[38]  George Vosselman,et al.  Automatic extraction of building features from terrestrial laser scanning , 2006 .

[39]  Daniel Schläpfer,et al.  RECENT DEVELOPMENTS IN OPERATIONAL ATMOSPHERIC AND RADIOMETRIC CORRECTION OF HYPERSPECTRAL IMAGERY , 2009 .

[40]  Eli Saber,et al.  Automatic registration of multisensor airborne imagery , 2005, 34th Applied Imagery and Pattern Recognition Workshop (AIPR'05).

[41]  Christian Heipke,et al.  EVALUATION OF AUTOMATIC ROAD EXTRACTION , 2007 .

[42]  Hermann Kaufmann,et al.  Determination of robust spectral features for identification of urban surface materials in hyperspectral remote sensing data , 2007 .

[43]  K. Lu,et al.  Modeling and Prediction of Future Urban Growth in the Charleston Region of South Carolina: a GIS-based Integrated Approach , 2003 .

[44]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[45]  M. Roggero Airborne laser scanning: clustering in raw data , 2001 .

[46]  Daniel Bulmer,et al.  Title : How can computer simulated visualizations of the built environment facilitate better public participation in the planning process ? , 2001 .

[47]  Ray A. Jarvis,et al.  On the Identification of the Convex Hull of a Finite Set of Points in the Plane , 1973, Inf. Process. Lett..

[48]  Jie Shan,et al.  CLUSTERING BASED PLANAR ROOF EXTRACTION FROM LIDAR DATA , 2006 .

[49]  P. Giblin Computational geometry: algorithms and applications (2nd edn.), by M. de Berg, M. van Kreveld, M. Overmars and O. Schwarzkopf. Pp. 367. £20.50. 2000. ISBN 3 540 65620 0 (Springer-Verlag). , 2001, The Mathematical Gazette.

[50]  Anna Brook,et al.  Supervised vicarious calibration (SVC) of hyperspectral remote-sensing data , 2011 .

[51]  J. C. Price,et al.  Examples of high resolution visible to near-infrared reflectance spectra and a standardized collection for remote sensing studies , 1995 .

[52]  I. J. Dowman,et al.  Integration of LIDAR and IFSAR for mapping , 2004 .

[53]  Mark de Berg,et al.  Computational geometry: algorithms and applications , 1997 .

[54]  J. Boardman Automating spectral unmixing of AVIRIS data using convex geometry concepts , 1993 .

[55]  Eyal Ben-Dor,et al.  Quality assessment of several methods to recover surface reflectance using synthetic imaging spectroscopy data , 2004 .

[56]  C. Song,et al.  Urban 3D GIS From LiDAR and digital aerial images , 2004, Comput. Geosci..

[57]  Reinhold Huber,et al.  Road extraction from high-resolution airborne SAR using operator fusion , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[58]  Eyal Ben-Dor,et al.  Supervised Vicarious Calibration (SVC) of hyperspectral remote-sensing data , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[59]  G. Vosselman ON THE ESTIMATION OF PLANIMETRIC OFFSETS IN LASER ALTIMETRY DATA , 2002 .

[60]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[61]  Eyal Ben-Dor,et al.  Advantages of the Boresight Effect in Hyperspectral Data Analysis , 2011, Remote. Sens..

[62]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[63]  Henri Maître,et al.  3-D Reconstruction of Urban Scenes from Aerial Stereo Imagery: A Focusing Strategy , 1999, Comput. Vis. Image Underst..

[64]  George Vosselman,et al.  3D BUILDING MODEL RECONSTRUCTION FROM POINT CLOUDS AND GROUND PLANS , 2001 .

[65]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[66]  Jue Wu,et al.  Multimodal Brain Image Registration Based on Wavelet Transform Using SAD and MI , 2004, MIAR.

[67]  T. H. Kolbe,et al.  CityGML: Interoperable Access to 3D City Models , 2005 .

[68]  Sudeep Sarkar,et al.  Comparison of Edge Detectors: A Methodology and Initial Study , 1998, Comput. Vis. Image Underst..

[69]  Uwe Stilla,et al.  Detection of weak laser pulses by full waveform stacking , 2007 .

[70]  Shi Pu,et al.  AUTOMATIC EXTRACTION OF BUILDING FEATURES FROM TERRESTRIAL LASER SCANNING , 2006 .

[71]  Impyeong Lee,et al.  PERCEPTUAL ORGANIZATION OF 3D SURFACE POINTS , 2002 .

[72]  J. Shan,et al.  Urban DEM generation from raw lidar data: A labeling algorithm and its performance , 2005 .

[73]  C. Brenner,et al.  3D URBAN GIS FROM LASER ALTIMETER AND 2D MAP DATA , 1997 .

[74]  J. R. Jensen,et al.  Remote Sensing of Urban/Suburban Infrastructure and Socio‐Economic Attributes , 2011 .

[75]  E. Baltsavias,et al.  Use of DTMs/DSMs and orthoimages to support building extraction , 1995 .

[76]  Eyal Ben-Dor,et al.  Automatic Registration of Airborne and Spaceborne Images by Topology Map Matching with SURF Processor Algorithm , 2011, Remote. Sens..

[77]  T. Chapman,et al.  Topological Invariance of Whitehead Torsion , 1974 .

[78]  Abigail L. Bristow,et al.  Developing an Enhanced Weight-Based Topological Map-Matching Algorithm for Intelligent Transport Systems , 2009 .

[79]  Franz Rottensteiner,et al.  Roads and buildings from laser scanner data within a forest enterprise , 1999 .

[80]  Nicolas David,et al.  LIDAR Data Classification using Hierarchical K-means clustering , 2008 .

[81]  R. Congalton Exploring and Evaluating the Consequences of Vector-to-Raster and Raster-to-Vector Conversion , 1997 .

[82]  J. Shan,et al.  Topographic laser ranging and scanning : principles and processing , 2008 .

[83]  Noel A. C. Cressie,et al.  Statistics for Spatial Data: Cressie/Statistics , 1993 .

[84]  Richard E. Klosterman,et al.  Planning Support Systems: Integrating Geographic Information Systems,Models,and Visualization Tools , 2001 .

[85]  Guoqing Zhou,et al.  EXPERIMENTAL STUDY ON GROUND POINT DETERMINATION FROM HIGH RESOLUTION AIRBORNE AND SATELLITE IMAGERY , 2000 .

[86]  Jacqueline Le Moigne,et al.  An automated parallel image registration technique based on the correlation of wavelet features , 2013, IEEE Trans. Geosci. Remote. Sens..

[87]  R. Ayuga,et al.  Hyperspectral Remote Sensing Application for Semi-Urban Areas Monitoring , 2007, 2007 Urban Remote Sensing Joint Event.

[88]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[89]  Rui Xu,et al.  Wavelet-based Multiresolution Medical Image Registration Strategy Combining Mutual Information with Spatial Information , 2006 .

[90]  Yonghui Song,et al.  Producing 3D Applications for Urban Planning by Integrating 3D Scanned Building Data with Geo-spatial Data , 2009 .

[91]  J. Muller,et al.  3D RECONSTRUCTION FROM VERY HIGH RESOLUTION SATELLITE STEREO AND ITS APPLICATION TO OBJECT IDENTIFICATION , 2002 .

[92]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[93]  Robin Liggett,et al.  An Integrated Environment for Urban Simulation , 1995 .

[94]  Jie Shan,et al.  Building Extraction from LiDAR Point Clouds Based on Clustering Techniques , 2008 .

[95]  Martin Herold,et al.  The spatiotemporal form of urban growth: measurement, analysis and modeling , 2003 .

[96]  Sudeep Sarkar,et al.  Comparison of edge detectors: a methodology and initial study , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[97]  S. Filin SURFACE CLUSTERING FROM AIRBORNE LASER SCANNING DATA , 2002 .

[98]  Claus Brenner,et al.  EXTRACTION OF ROAD GEOMETRY PARAMETERS FROM LASER SCANNING AND EXISTING DATABASES , 2003 .

[99]  Thomas H. Kolbe,et al.  CityGML: An Open Standard for 3D City Models , 2006 .

[100]  Ralf Reulke,et al.  Comparison of image reconstruction algorithms, Remote Sensing and Reconstruction for three-dimensional objects and scenes , 1995 .

[101]  John Trinder,et al.  Building Detection Using LIDAR Data and Multispectral Images , 2003, DICTA.

[102]  Christoph Hug,et al.  Extracting Artificial Surface Objects from Airborne Laser Scanner Data , 1997 .

[103]  Robert Haining,et al.  Statistics for spatial data: by Noel Cressie, 1991, John Wiley & Sons, New York, 900 p., ISBN 0-471-84336-9, US $89.95 , 1993 .

[104]  J. Settle,et al.  Linear mixing and the estimation of ground cover proportions , 1993 .

[105]  Keith C. Clarke,et al.  The role of spatial metrics in the analysis and modeling of urban land use change , 2005, Comput. Environ. Urban Syst..