CONTEXT MODELS FOR CRF-BASED CLASSIFICATION OF MULTITEMPORAL REMOTE SENSING DATA

The increasing availability of multitemporal satellite remote sensing data offers new potential for land cover analysis. By combining data acquired at different epochs it is possible both to improve the classification accuracy and to analyse land cover changes at a high frequency. A simultaneous classification of images from different epochs that is also capable of detecting changes is achieved by a new classification technique based on Conditional Random Fields (CRF). CRF provide a probabilistic classification framework including local spatial and temporal context. Although context is known to improve image analysis results, so far only little research was carried out on how to model it. Taking into account context is the main benefit of CRF in comparison to many other classification methods. Context can be already considered by the choice of features and in the design of the interaction potentials that model the dependencies of interacting sites in the CRF. In this paper, these aspects are more thoroughly investigated. The impact of the applied features on the classification result as well as different models for the spatial interaction potentials are evaluated and compared to the purely label-based Markov Random Field model.

[1]  Josiane Zerubia,et al.  Multiscale Markov random field models for parallel image classification , 1993, 1993 (4th) International Conference on Computer Vision.

[2]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[3]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[4]  Ribana Roscher,et al.  Kernel Discriminative Random Fields for land cover classification , 2010, 2010 IAPR Workshop on Pattern Recognition in Remote Sensing.

[5]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[6]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[7]  Christian Heipke,et al.  Classification of multitemporal remote sensing data using Conditional Random Fields , 2010, 2010 IAPR Workshop on Pattern Recognition in Remote Sensing.

[8]  Mark W. Schmidt,et al.  Accelerated training of conditional random fields with stochastic gradient methods , 2006, ICML.

[9]  Lorenzo Bruzzone,et al.  Detection of land-cover transitions by combining multidate classifiers , 2004, Pattern Recognit. Lett..

[10]  D. Lu,et al.  Change detection techniques , 2004 .

[11]  Christian Heipke,et al.  Classification of multitemporal remote sensing data of different resolution using Conditional Random Fields , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Gabriele Moser,et al.  A Contextual Multiscale Unsupervised Method for Change Detection with Multitemporal Remote-Sensing Images , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[14]  Ping Zhong,et al.  A Multiple Conditional Random Fields Ensemble Model for Urban Area Detection in Remote Sensing Optical Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Sebastiano B. Serpico,et al.  A Markov random field approach to spatio-temporal contextual image classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[16]  Kee Tung. Wong,et al.  Texture features for image classification and retrieval. , 2002 .

[17]  Wolfgang Förstner,et al.  Hierarchical Conditional Random Field for Multi-class Image Classification , 2010, VISAPP.

[18]  A. Willsky Multiresolution Markov models for signal and image processing , 2002, Proc. IEEE.

[19]  Raul Queiroz Feitosa,et al.  Cascade multitemporal classification based on fuzzy Markov chains , 2009 .

[20]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  Bernt Schiele,et al.  Hierarchical Support Vector Random Fields: Joint Training to Combine Local and Global Features , 2008, ECCV.