Change detection on LOD 2 building models with very high resolution spaceborne stereo imagery

Due to the fast development of the urban environment, the need for efficient maintenance and updating of 3D building models is ever increasing. Change detection is an essential step to spot the changed area for data (map/3D models) updating and urban monitoring. Traditional methods based on 2D images are no longer suitable for change detection in building scale, owing to the increased spectral variability of the building roofs and larger perspective distortion of the very high resolution (VHR) imagery. Change detection in 3D is increasingly being investigated using airborne laser scanning data or matched Digital Surface Models (DSM), but rare study has been conducted regarding to change detection on 3D city models with VHR images, which is more informative but meanwhile more complicated. This is due to the fact that the 3D models are abstracted geometric representation of the urban reality, while the VHR images record everything. In this paper, a novel method is proposed to detect changes directly on LOD (Level of Detail) 2 building models with VHR spaceborne stereo images from a different date, with particular focus on addressing the special characteristics of the 3D models. In the first step, the 3D building models are projected onto a raster grid, encoded with building object, terrain object, and planar faces. The DSM is extracted from the stereo imagery by hierarchical semi-global matching (SGM). In the second step, a multi-channel change indicator is extracted between the 3D models and stereo images, considering the inherent geometric consistency (IGC), height difference, and texture similarity for each planar face. Each channel of the indicator is then clustered with the Self-organizing Map (SOM), with “change”, “non-change” and “uncertain change” status labeled through a voting strategy. The “uncertain changes” are then determined with a Markov Random Field (MRF) analysis considering the geometric relationship between faces. In the third step, buildings are extracted combining the multispectral images and the DSM by morphological operators, and the new buildings are determined by excluding the verified unchanged buildings from the second step. Both the synthetic experiment with Worldview-2 stereo imagery and the real experiment with IKONOS stereo imagery are carried out to demonstrate the effectiveness of the proposed method. It is shown that the proposed method can be applied as an effective way to monitoring the building changes, as well as updating 3D models from one epoch to the other.

[1]  R. D. Johnson,et al.  Change vector analysis: A technique for the multispectral monitoring of land cover and condition , 1998 .

[2]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[3]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[4]  Brian Pilemann Olsen,et al.  Automated Change Detection for Updates of Digital Map Databases , 2003 .

[5]  Le Wang,et al.  MORPHOLOGY-BASED BUILDING DETECTION FROM AIRBORNE LIDAR DATA , 2009 .

[6]  Liangpei Zhang,et al.  An Adaptive Mean-Shift Analysis Approach for Object Extraction and Classification From Urban Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[7]  J. Kamini,et al.  Spatio-temporal analysis of land use in urban mumbai -using multi-sensor satellite data and gis techniques , 2006 .

[8]  D. Roberts,et al.  A comparison of methods for monitoring multitemporal vegetation change using Thematic Mapper imagery , 2002 .

[9]  Armin Gruen,et al.  Least squares 3 D surface matching , 2002 .

[10]  G. Doxani,et al.  AUTOMATIC CHANGE DETECTION IN URBAN AREAS UNDER A SCALE-SPACE , OBJECT-ORIENTED CLASSIFICATION FRAMEWORK , 2010 .

[11]  Vladimir Kolmogorov,et al.  Graph cut based image segmentation with connectivity priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Manfred Ehlers,et al.  Region-based automatic building and forest change detection on Cartosat-1 stereo imagery , 2013 .

[14]  Tapas Ranjan Martha,et al.  Landslide Volumetric Analysis Using Cartosat-1-Derived DEMs , 2010, IEEE Geoscience and Remote Sensing Letters.

[15]  G. Biging,et al.  Technical note: Use of digital surface model for hardwood rangeland monitoring , 2000 .

[16]  T. Fung An Assessment Of Tm Imagery For Land Cover Change Detection , 1989, 12th Canadian Symposium on Remote Sensing Geoscience and Remote Sensing Symposium,.

[17]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[18]  Esa Alhoniemi,et al.  Self-organizing map in Matlab: the SOM Toolbox , 1999 .

[19]  Dong-Chen He,et al.  Automatic change detection of buildings in urban environment from very high spatial resolution images using existing geodatabase and prior knowledge , 2010 .

[20]  Armin Gruen,et al.  Quality assessment of 3D building data , 2010 .

[21]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[22]  Lei Chen,et al.  Building detection in an urban area using lidar data and QuickBird imagery , 2012 .

[23]  Emilio Del-Moral-Hernandez,et al.  A SOM combined with KNN for classification task , 2011, The 2011 International Joint Conference on Neural Networks.

[24]  A. Gruen Development and Status of Image Matching in Photogrammetry , 2012 .

[25]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[26]  John Trinder,et al.  Building detection by fusion of airborne laser scanner data and multi-spectral images : Performance evaluation and sensitivity analysis , 2007 .

[27]  Seyed Vahid Moosavi,et al.  A New Automated Hierarchical Clustering Algorithm Based on Emergent Self Organizing Maps , 2012, 2012 16th International Conference on Information Visualisation.

[28]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Liangpei Zhang,et al.  Morphological Building/Shadow Index for Building Extraction From High-Resolution Imagery Over Urban Areas , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Mi Wang,et al.  Isprs Journal of Photogrammetry and Remote Sensing Epipolar Resampling of Linear Pushbroom Satellite Imagery by a New Epipolarity Model , 2022 .

[31]  Rongjun Qin,et al.  A Hierarchical Building Detection Method for Very High Resolution Remotely Sensed Images Combined with DSM Using Graph Cut Optimization , 2014 .

[32]  Qian Du,et al.  A Hybrid Approach for Building Extraction From Spaceborne Multi-Angular Optical Imagery , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Pushmeet Kohli,et al.  Markov Random Fields for Vision and Image Processing , 2011 .

[34]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Volker Walter,et al.  Object-based classification of remote sensing data for change detection , 2004 .

[36]  E. Baltsavias,et al.  Assessing changes of forest area and shrub encroachment in a mire ecosystem using digital surface models and CIR aerial images , 2008 .

[37]  H. Murakami,et al.  Change detection of buildings using an airborne laser scanner , 1999 .

[38]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[39]  Tung Fung,et al.  An Assessment Of TM Imagery For Land-cover Change Detection , 1990 .

[40]  Gerhard Winkler,et al.  Image Analysis, Random Fields and Markov Chain Monte Carlo Methods: A Mathematical Introduction , 2002 .

[41]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Jianya Gong,et al.  Multi-frame Image super-resolution based on knife-edges , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[43]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[44]  Franck Jung Detecting building changes from multitemporal aerial stereopairs , 2004 .

[45]  Markus Peura,et al.  The Self-Organizing Map of Trees , 1998, Neural Processing Letters.

[46]  Gabriele Moser,et al.  Unsupervised Change Detection From Multichannel SAR Data by Markovian Data Fusion , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Houda Chaabouni-Chouayakh,et al.  Towards Automatic 3D Change Detection inside Urban Areas by Combining Height and Shape Information , 2011 .

[48]  C. Woodcock,et al.  Classification and Change Detection Using Landsat TM Data: When and How to Correct Atmospheric Effects? , 2001 .

[49]  Shiyong Cui,et al.  Building Change Detection Based on Satellite Stereo Imagery and Digital Surface Models , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Xuehong Chen,et al.  A spectral gradient difference based approach for land cover change detection , 2013 .

[51]  C. Woodcock,et al.  An assessment of several linear change detection techniques for mapping forest mortality using multitemporal landsat TM data , 1996 .

[52]  Armin Gruen,et al.  CC-MODELER : A TOPOLOGY GENERATOR FOR 3-D CITY MODELS , 1998 .

[53]  A. Gruen,et al.  3D change detection at street level using mobile laser scanning point clouds and terrestrial images , 2014 .

[54]  Maurice K. Wong,et al.  Algorithm AS136: A k-means clustering algorithm. , 1979 .

[55]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Markus Gerke,et al.  The ISPRS benchmark on urban object classification and 3D building reconstruction , 2012 .

[57]  William J. Emery,et al.  An Innovative Neural-Net Method to Detect Temporal Changes in High-Resolution Optical Satellite Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[58]  D. Akca Matching of 3D surfaces and their intensities , 2007 .

[59]  Dušan Petrovič,et al.  Samodejen zajem in iskanje sprememb v topografskem sloju stavb iz digitalnega modela površja in multispektralnega ortofota , 2011 .

[60]  Kurt Kubik,et al.  Automatic Building Detection Using the Dempster-Shafer Algorithm , 2006 .

[61]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[62]  Jianya Gong,et al.  A Coarse Elevation Map-based Registration Method for Super-resolution of Three-line Scanner Images , 2013 .

[63]  D. Grigillo,et al.  Automatic extraction and building change detection from digital surface model and multispectral orthophoto , 2011 .

[64]  A. Gruen,et al.  Quality assessment of 3D building data , 2010 .

[65]  C. Fraser,et al.  Bias compensation in rational functions for Ikonos satellite imagery , 2003 .

[66]  Li Zhang,et al.  Multi-image matching for DSM generation from IKONOS imagery , 2006 .