Vision-Based Change Detection Using Comparative Morphology

The chapter addresses the theoretical and practical aspects of the scene change detection problem with the use of computer vision techniques. It means detecting new or disappeared objects in images registered at different moments of time and possibly in various lighting, weather, and season conditions. In this chapter, we propose the new scheme of Comparative Morphology (CM) as a generalization of the Morphological Image Analysis (MIA) scheme originally proposed by Pyt’ev. The CMs are the mathematical shape theories, which solve the tasks of the image similarity estimation, image matching, and change detection by means of some special morphological models and tools. The original morphological change detection approach is based on the analysis of difference between the test image and its projection to the shape of reference image. In our generalized approach, the morphological filter-projector is substituted by the comparative morphological filter with weaker properties, which transforms the test image guided by the local shape of reference image. Following theoretical aspects are addressed in this chapter: the comparative morphology, change detection scheme based on morphological comparative filtering, diffusion morphology, and morphological filters based on guided contrasting. Following practical aspects are addressed: the pipeline for change detection in remote sensing data based on comparative morphology and implementation of change detection scheme based on both guided contrasting and diffusion morphology. The chapter also contains the results of qualitative and quantitative experiments on a wide set of real images including the public benchmark.

[1]  Dengsheng Lu,et al.  Land‐cover binary change detection methods for use in the moist tropical region of the Amazon: a comparative study , 2005 .

[2]  Yu. P. Pyt’ev,et al.  Morphological compression of grayscale images of text , 2006, Pattern Recognition and Image Analysis.

[3]  N. A. Quarmby,et al.  Monitoring urban land cover changes at the urban fringe from SPOT HRV imagery in south-east England , 1989 .

[4]  Tony R. Martinez,et al.  Iterative Non-linear Dimensionality Reduction with Manifold Sculpting , 2007, NIPS.

[5]  John R. Jensen,et al.  Introductory Digital Image Processing: A Remote Sensing Perspective , 1986 .

[6]  C. Woodcock,et al.  An assessment of several linear change detection techniques for mapping forest mortality using multitemporal landsat TM data , 1996 .

[7]  Hassiba Nemmour,et al.  Multiple support vector machines for land cover change detection: An application for mapping urban extensions , 2006 .

[8]  D. Al-Khudhairy,et al.  Structural Damage Assessments from Ikonos Data Using Change Detection, Object-Oriented Segmentation, and Classification Techniques , 2005 .

[9]  D. Roberts,et al.  A comparison of methods for monitoring multitemporal vegetation change using Thematic Mapper imagery , 2002 .

[10]  Francesca Bovolo,et al.  A Novel Approach to Unsupervised Change Detection Based on a Semisupervised SVM and a Similarity Measure , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Gregory Duveiller,et al.  Deforestation in Central Africa: Estimates at regional, national and landscape levels by advanced processing of systematically-distributed Landsat extracts , 2008 .

[12]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  F. Mémoli,et al.  A spectral notion of Gromov–Wasserstein distance and related methods , 2011 .

[14]  D. Lu,et al.  Change detection techniques , 2004 .

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  Thomas R. Loveland,et al.  A review of large area monitoring of land cover change using Landsat data , 2012 .

[17]  C. Homer,et al.  Updating the 2001 National Land Cover Database Impervious Surface Products to 2006 using Landsat Imagery Change Detection Methods , 2010 .

[18]  Pol Coppin,et al.  Comparative performance of a modified change vector analysis in forest change detection , 2005 .

[19]  Gregory J. McDermid,et al.  Object-based approaches to change analysis and thematic map update: challenges and limitations , 2008 .

[20]  J. Fry,et al.  Updating the 2001 National Land Cover Database land cover classification to 2006 by using Landsat imagery change detection methods , 2009 .

[21]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[22]  Xia Li,et al.  Cellular automata for simulating land use changes based on support vector machines , 2008, Comput. Geosci..

[23]  Patrick Bogaert,et al.  Forest change detection by statistical object-based method , 2006 .

[24]  Suming Jin,et al.  Comparison of time series tasseled cap wetness and the normalized difference moisture index in detecting forest disturbances , 2005 .

[25]  P. Mayaux,et al.  An object-based method for mapping and change analysis in mangrove ecosystems , 2008 .

[26]  Sven Nussbaum,et al.  Change Detection: The Potential for Nuclear Safeguards , 2006 .

[27]  Jay Gao.  Digital Analysis of Remotely Sensed Imagery , 2009 .

[28]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[29]  P. Gong,et al.  Land-use/land-cover change detection using improved change-vector analysis , 2003 .

[30]  Paul E. Gessler,et al.  Integrating Landsat TM and SRTM-DEM derived variables with decision trees for habitat classification and change detection in complex neotropical environments , 2008 .

[31]  W. D. Ross,et al.  Change Detection using Adaptive Fuzzy neural networks : Environmental damage assessment after the Gulf War , 1999 .

[32]  N. Chang,et al.  Seasonal change detection of riparian zones with remote sensing images and genetic programming in a semi-arid watershed. , 2009, Journal of environmental management.

[33]  P. Marpu,et al.  Change detection using object features , 2008 .

[34]  John A. Richards,et al.  Thematic mapping from multitemporal image data using the principal components transformation , 1984 .

[35]  T. M. Lillesand,et al.  Remote Sensing and Image Interpretation , 1980 .

[36]  Yu. V. Vizilter,et al.  CHANGE DETECTION VIA MORPHOLOGICAL COMPARATIVE FILTERS , 2016 .

[37]  Richard G. Lathrop,et al.  Urban change detection based on an artificial neural network , 2002 .

[38]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[39]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[40]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[41]  A. B. Miller,et al.  An analysis of land cover changes in the Northern Forest of New England using multitemporal Landsat MSS data , 1998 .

[42]  T. Blaschke.  TOWARDS A FRAMEWORK FOR CHANGE DETECTION BASED ON IMAGE OBJECTS , 2005 .

[43]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[44]  Dong-Chen He,et al.  Automatic change detection of buildings in urban environment from very high spatial resolution images using existing geodatabase and prior knowledge , 2010 .

[45]  B. Nadler,et al.  Diffusion maps, spectral clustering and reaction coordinates of dynamical systems , 2005, math/0503445.

[46]  R. C. Maggio,et al.  An analysis of anthropogenic deforestation using logistic regression and GIS , 1990 .

[47]  Chengquan Huang,et al.  Use of a dark object concept and support vector machines to automate forest cover change analysis , 2008 .

[48]  D. Stow,et al.  Monitoring shrubland habitat changes through object-based change identification with airborne multispectral imagery , 2008 .

[49]  Bernhard Schölkopf,et al.  Kernel Principal Component Analysis , 1997, ICANN.

[50]  Amir Averbuch,et al.  Objects based change detection in a pair of gray-level images , 2005, Pattern Recognit..

[51]  S. Gopal,et al.  Remote sensing of forest change using artificial neural networks , 1996, IEEE Trans. Geosci. Remote. Sens..

[52]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[53]  Ronald R. Coifman,et al.  Geometries of sensor outputs, inference, and information processing , 2006, SPIE Defense + Commercial Sensing.

[54]  S. Yu. Zheltov,et al.  SHAPE-BASED IMAGE MATCHING USING HEAT KERNELS AND DIFFUSION MAPS , 2014 .

[55]  J. Chan,et al.  Detecting the nature of change in an urban environment : A comparison of machine learning algorithms , 2001 .

[56]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[57]  Xuehong Chen,et al.  A spectral gradient difference based approach for land cover change detection , 2013 .

[58]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Robert A. Schowengerdt,et al.  Techniques for image processing and classification in remote sensing , 1983 .

[60]  M. Bauer,et al.  Land cover classification and change analysis of the Twin Cities (Minnesota) Metropolitan Area by multitemporal Landsat remote sensing , 2005 .

[61]  R. Lunetta,et al.  Land-cover change detection using multi-temporal MODIS NDVI data , 2006 .

[62]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[63]  Bryan C. Pijanowski,et al.  Calibrating a neural network‐based urban change model for two metropolitan areas of the Upper Midwest of the United States , 2005, Int. J. Geogr. Inf. Sci..

[64]  Daniel Tomowski,et al.  Colour and texture based change detection for urban disaster analysis , 2011, 2011 Joint Urban Remote Sensing Event.

[65]  L. Lieu,et al.  High Dimensional Pattern Recognition using Diffusion Maps and Earth Mover's Distance , 2009 .

[66]  Laurence Hubert-Moy,et al.  Object-Oriented Approach and Texture Analysis for Change Detection in Very High Resolution Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[67]  C. Özkan,et al.  Comparison of maximum likelihood classification method with supervised artificial neural network algorithms for land use activities , 2004 .

[68]  Geoffrey G. Hazel.  Object-level change detection in spectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[69]  Patrick Bogaert,et al.  An object-based change detection method accounting for temporal dependences in time series with medium to coarse spatial resolution , 2008 .

[70]  M. Kelly,et al.  Individual Object Change Detection for Monitoring the Impact of a Forest Pathogen on a Hardwood Forest , 2009 .

[71]  S. Khorram,et al.  Remotely Sensed Change Detection Based on Artificial Neural Networks , 1999 .

[72]  Austin Troy,et al.  Object-based Land Cover Classification and Change Analysis in the Baltimore Metropolitan Area Using Multitemporal High Resolution Remote Sensing Data , 2008, Sensors.

[73]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering , 2013 .

[74]  Philip J. Howarth,et al.  Procedures for change detection using Landsat digital data , 1981 .

[75]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[76]  Luiz Velho,et al.  A Hierarchical Segmentation of Articulated Bodies , 2008, Comput. Graph. Forum.

[77]  G. Hay,et al.  A Multiscale Object-Specific Approach to Digital Change Detection , 2003 .

[78]  Yu. P. Pyt’ev.  Oblique projectors and relative forms in image morphology , 2013 .

[79]  S. Zheltov,et al.  GEOMETRICAL CORRELATION AND MATCHING OF 2D IMAGE SHAPES , 2012 .

[80]  Laurent Durieux,et al.  A method for monitoring building construction in urban sprawl areas using object-based analysis of Spot 5 images and existing GIS data , 2008 .

[81]  Jinsong Deng,et al.  PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data , 2008 .

[82]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[83]  Yu. P. Pyt’ev,et al.  Analysis and recognition of piecewise constant texture images , 2006, Pattern Recognition and Image Analysis.

[84]  L. M. Mestetskiy,et al.  Morphological Image Analysis for Computer Vision Applications , 2015 .

[85]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[86]  R. Kauth,et al.  The tasselled cap - A graphic description of the spectral-temporal development of agricultural crops as seen by Landsat , 1976 .

[87]  M. Bauer,et al.  Digital change detection in forest ecosystems with remote sensing imagery , 1996 .

[88]  J. Mas.  Monitoring land-cover changes: A comparison of change detection techniques , 1999 .

[89]  C. Tucker,et al.  A comparative study of NOAA–AVHRR derived drought indices using change vector analysis , 2006 .

[90]  Curtis E. Woodcock,et al.  Monitoring large areas for forest change using Landsat: Generalization across space, time and Landsat sensors , 2001 .

[91]  John R. Jensen,et al.  A change detection model based on neighborhood correlation image analysis and decision tree classification , 2005 .

[92]  Philippe De Maeyer,et al.  Object-oriented change detection for the city of Harare, Zimbabwe , 2009, Expert Syst. Appl..

[93]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[94]  Wei Ji,et al.  Characterizing urban sprawl using multi-stage remote sensing images and landscape metrics , 2006, Comput. Environ. Urban Syst..

[95]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[96]  Ram M. Narayanan,et al.  A shape-based approach to change detection of lakes using time series remote sensing images , 2003, IEEE Trans. Geosci. Remote. Sens..

[97]  Ashish Ghosh,et al.  Fuzzy clustering algorithms for unsupervised change detection in remote sensing images , 2011, Inf. Sci..

[98]  G. M. Smith,et al.  The development of integrated object-based analysis of EO data within UK national land cover products , 2008 .