Multiresolution Supervised Classification of Panchromatic and Multispectral Images by Markov Random Fields and Graph Cuts

The problem of supervised classification of multiresolution images, which are composed of a higher resolution panchromatic channel and of several coarser resolution multispectral channels, is addressed in this paper by proposing a novel contextual method based on Markov random fields. The method iteratively exploits a linear mixture model for the relationships between data at different resolutions and a graph cut approach to Markovian energy minimization to generate a contextual classification map at the highest resolution available in the input data set. The estimation of the parameters of the method is performed by extending recently proposed techniques based on the expectation-maximization and Ho-Kashyap's algorithms. The method is experimentally validated with semisimulated and real data involving both IKONOS and Landsat-7 ETM+ images, and the results are compared with those generated by previous approaches to the classification of multiresolution imagery.

[1]  Dengsheng Lu,et al.  Integration of Landsat TM and SPOT HRG Images for Vegetation Change Detection in the Brazilian Amazon. , 2008, Photogrammetric engineering and remote sensing.

[2]  Josiane Zerubia,et al.  Image Segmentation Using Markov Random Field Model in Fully Parallel Cellular Network Architectures , 2000 .

[3]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[4]  Gabriele Moser,et al.  Supervised Classification of Multisensor and Multiresolution Remote Sensing Images With a Hierarchical Copula-Based Approach , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Anne H. Schistad Solberg,et al.  A bayesian approach to classification of multiresolution remote sensing data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Anil K. Jain,et al.  A Markov random field model for classification of multisource satellite imagery , 1996, IEEE Trans. Geosci. Remote. Sens..

[7]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images , 2014 .

[8]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[9]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Gabriele Moser,et al.  Weight Parameter Optimization by the Ho–Kashyap Algorithm in MRF Models for Supervised Image Classification , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[11]  John A. Richards,et al.  Cluster-space representation for hyperspectral data classification , 2002, IEEE Trans. Geosci. Remote. Sens..

[12]  Stan Z. Li.  Markov Random Field Modeling in Image Analysis , 2009, Advances in Pattern Recognition.

[13]  Josiane Zerubia,et al.  Markov Random Fields in Image Segmentation , 2012, Found. Trends Signal Process..

[14]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields , 2006, ECCV.

[15]  Sylvie Le Hégarat-Mascle,et al.  Surface Temperature Downscaling From Multiresolution Instruments Based on Markov Models , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[18]  K. Nikolakopoulos.  Comparison of Nine Fusion Techniques for Very High Resolution Data , 2008 .

[19]  G. Foody.  Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[20]  Lalit Kumar,et al.  Mapping Lantana camara: accuracy comparison of various fusion techniques. , 2010 .

[21]  Paul D. Gader,et al.  A Signal Processing Perspective on Hyperspectral Unmixing , 2014 .

[22]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[23]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[25]  André Stumpf,et al.  Hierarchical extraction of landslides from multiresolution remotely sensed optical images , 2014 .

[26]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Amandine Robin,et al.  Unsupervised Subpixelic Classification Using Coarse-Resolution Time Series and Structural Information , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Thomas G. Dietterich.  Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[29]  Nandamudi Lankalapalli Vijaykumar,et al.  A Multi-Resolution Multi-Temporal Technique for Detecting and Mapping Deforestation in the Brazilian Amazon Rainforest , 2011, Remote. Sens..

[30]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Sergio Teggi,et al.  TM and IRS-1C-PAN data fusion using multiresolution decomposition methods based on the 'a tròus' algorithm , 2003 .

[32]  J. C. Price,et al.  Combining multispectral data of differing spatial resolution , 1999, IEEE Trans. Geosci. Remote. Sens..

[33]  Francesca Bovolo,et al.  Analysis of the Effects of Pansharpening in Change Detection on VHR Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[34]  Jon Atli Benediktsson,et al.  Land-Cover Mapping by Markov Modeling of Spatial–Contextual Information in Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[35]  E. Vivoni,et al.  Riparian vegetation mapping for hydraulic roughness estimation using very high resolution remote sensing data fusion. , 2010 .

[36]  Fei Yuan,et al.  Land‐cover change and environmental impact analysis in the Greater Mankato area of Minnesota using remote sensing and GIS modelling , 2008 .

[37]  Germain Forestier,et al.  Multiresolution Remote Sensing Image Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[38]  Dieter Oertel,et al.  Unmixing-based multisensor multiresolution image fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[39]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[40]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[41]  José A. Sobrino,et al.  Mapping wild pear trees (Pyrus bourgaeana) in Mediterranean forest using high-resolution QuickBird satellite imagery , 2013 .

[42]  Klaus Steinnocher,et al.  Influence of image fusion approaches on classification accuracy: a case study , 2006 .

[43]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[44]  Siamak Khorram,et al.  Per-pixel Classification of High Spatial Resolution Satellite Imagery for Urban Land-cover Mapping , 2008 .

[45]  S. Baronti,et al.  Remote Sensing Image Fusion , 2015 .

[46]  A. Podaire,et al.  Extracting crop radiometric responses from simulated low and high spatial resolution satellite data using a linear mixing model , 1994 .

[47]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[48]  Palma Blonda,et al.  Automatic Spectral-Rule-Based Preliminary Classification of Radiometrically Calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye, and DMC/SPOT-1/-2 Imagery—Part I: System Design and Implementation , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Dongmei Chen,et al.  Strategies for Integrating Information from Multiple Spatial Resolutions into Land-Use/Land-Cover Classification Routines , 2003 .

[50]  Antonio J. Plaza,et al.  A Signal Processing Perspective on Hyperspectral Unmixing: Insights from Remote Sensing , 2014, IEEE Signal Processing Magazine.

[51]  Nicolas Passat,et al.  Extraction of complex patterns from multiresolution remote sensing images: A hierarchical top-down methodology , 2012, Pattern Recognit..

[52]  Gabriele Moser,et al.  Classification of High-Resolution Images Based on MRF Fusion and Multiscale Segmentation , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.