Causal Markov Mesh Hierarchical Modeling for the Contextual Classification of Multiresolution Satellite Images

In this paper, we address the problem of the joint classification of multiple images acquired on the same scene at different spatial resolutions. From an application viewpoint, this problem is of importance in several contexts, including, most remarkably, satellite and aerial imagery. From a methodological perspective, we use a probabilistic graphical approach and adopt a hierarchical Markov mesh framework that we have recently developed and models the spatial-contextual classification of multiresolution and possibly multisensor images. Here, we focus on the methodological properties of this framework. First, we prove the causality of the model, a highly desirable property with respect to the computational cost of the inference. Then, we prove the expression of the marginal posterior mode criterion for this model and discuss the related assumptions. Experimental results with multi-spectral and panchromatic satellite images are also presented.

[1]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[2]  Patrick Pérez,et al.  Discrete Markov image modeling and inference on the quadtree , 2000, IEEE Trans. Image Process..

[3]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[4]  Nasser Kehtarnavaz,et al.  Computationally Tractable Stochastic Image Modeling Based on Symmetric Markov Mesh Random Fields , 2013, IEEE Transactions on Image Processing.

[5]  Gabriele Moser,et al.  Multiresolution Supervised Classification of Panchromatic and Multispectral Images by Markov Random Fields and Graph Cuts , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Laveen N. Kanal,et al.  Classification of binary random patterns , 1965, IEEE Trans. Inf. Theory.

[7]  D. M. Titterington Computational Bayesian Analysis of Hidden , 2016 .

[8]  G. Y. Belay,et al.  Demonstration of a multichannel, multiresolution imaging system. , 2013, Applied optics.

[9]  Jocelyn Chanussot,et al.  Fusion of Multispectral and Panchromatic Images Based on Morphological Operators , 2016, IEEE Transactions on Image Processing.

[10]  Gabriele Moser,et al.  Information Extraction From Remote Sensing Images for Flood Monitoring and Damage Evaluation , 2012, Proceedings of the IEEE.

[11]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[12]  Xiaogang Wang,et al.  Deep Learning in Object Recognition, Detection, and Segmentation , 2016, Found. Trends Signal Process..

[13]  D. Massonnet,et al.  Imaging with Synthetic Aperture Radar , 2008 .

[14]  Carsten Rother,et al.  Conditional Random Fields Meet Deep Neural Networks for Semantic Segmentation: Combining Probabilistic Graphical Models with Deep Learning for Structured Prediction , 2018, IEEE Signal Processing Magazine.

[15]  Xuelong Li,et al.  Multiresolution Imaging , 2014, IEEE Transactions on Cybernetics.

[16]  Gabriele Moser,et al.  Joint Classification of Multiresolution and Multisensor Data Using a Multiscale Markov Mesh Model , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[17]  Pierre A. Devijver,et al.  Hidden Markov mesh random field models in image analysis , 1993 .

[18]  Qolamreza R. Razlighi,et al.  Computation of Image Spatial Entropy Using Quadrilateral Markov Random Field , 2009, IEEE Transactions on Image Processing.

[19]  D. M. Titterington,et al.  Computational Bayesian Analysis of Hidden Markov Mesh Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Gabriele Moser,et al.  Multi-resolution classification of urban areas using hierarchical symmetric Markov mesh models , 2017, 2017 Joint Urban Remote Sensing Event (JURSE).

[21]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Mandy Eberhart,et al.  Decision Forests For Computer Vision And Medical Image Analysis , 2016 .

[23]  A. Willsky Multiresolution Markov models for signal and image processing , 2002, Proc. IEEE.

[24]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.