Variational Textured Dirichlet Process Mixture Model With Pairwise Constraint for Unsupervised Classification of Polarimetric SAR Images

This paper proposes an unsupervised classification method for multilook polarimetric synthetic aperture radar (PolSAR) data. The proposed method simultaneously deals with the heterogeneity and incorporates the local correlation in PolSAR images. Specifically, within the probabilistic framework of the Dirichlet process mixture model (DPMM), an observed PolSAR data point is described by the multiplication of a Wishart-distributed component and a class-dependent random variable (i.e., the textual variable). This modeling scheme leads to the proposed textured DPMM (tDPMM), which possesses more flexibility in characterizing PolSAR data in heterogeneous areas and from high-resolution images due to the introduction of the class-dependent texture variable. The proposed tDPMM is learned by solving an optimization problem to achieve its Bayesian inference. With the knowledge of this optimization-based learning, the local correlation is incorporated through the pairwise constraint, which integrates an appropriate penalty term into the objective function, so as to encourage the neighboring pixels to fall into the same category and to alleviate the salt-and-pepper classification appearance. We develop the learning algorithm with all the closed-form updates. The performance of the proposed method is evaluated with both low-resolution and high-resolution PolSAR images, which involve homogeneous, heterogeneous, and extremely heterogeneous areas. The experimental results reveal that the class-dependent texture variable is beneficial to PolSAR image classification and the pairwise constraint can effectively incorporate the local correlation in PolSAR images.

[1]  Jong-Sen Lee,et al.  Polarimetric SAR speckle filtering and its implication for classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[2]  Raffaella Guida,et al.  Application of Mellin-Kind Statistics to Polarimetric ${\cal G}$ Distribution for SAR Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Carlos H. Muravchik,et al.  Unsupervised Polarimetric SAR Image Classification Using $\mathcal {G}_{p}^{0}$ Mixture Model , 2017, IEEE Geoscience and Remote Sensing Letters.

[4]  Mihai Datcu,et al.  Spatial information retrieval from remote-sensing images. II. Gibbs-Markov random fields , 1998, IEEE Trans. Geosci. Remote. Sens..

[5]  K. Ranson,et al.  K-distribution for multi-look processed polarimetric SAR imagery , 1994, Proceedings of IGARSS '94 - 1994 IEEE International Geoscience and Remote Sensing Symposium.

[6]  William J. Emery,et al.  $\mathcal {H}$ Distribution for Multilook Polarimetric SAR Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[8]  Florence Forbes,et al.  Hidden Markov Random Field Model Selection Criteria Based on Mean Field-Like Approximations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Peng Zhang,et al.  Adaptive Hybrid Conditional Random Field Model for SAR Image Segmentation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[10]  P. Shaman The inverted complex Wishart distribution and its application to spectral estimation , 1980 .

[11]  Heesung Kwon,et al.  Going Deeper With Contextual CNN for Hyperspectral Image Classification , 2016, IEEE Transactions on Image Processing.

[12]  D.G. Tzikas,et al.  The variational approximation for Bayesian inference , 2008, IEEE Signal Processing Magazine.

[13]  Sotirios Chatzis,et al.  The infinite Hidden Markov random field model , 2009, ICCV.

[14]  Jun Zhang,et al.  Integrating Contextual Information With ${H}/{\bar {\alpha }}$ Decomposition for PolSAR Data Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[15]  Eric Pottier,et al.  An entropy based classification scheme for land applications of polarimetric SAR , 1997, IEEE Trans. Geosci. Remote. Sens..

[16]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[17]  Carlos López-Martínez,et al.  A Physical Analysis of Polarimetric SAR Data Statistical Models , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Liangpei Zhang,et al.  A Support Vector Conditional Random Fields Classifier With a Mahalanobis Distance Boundary Constraint for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  谢鸿全 An Unsupervised Segmentation With an Adaptive Number of Clusters Using the SPAN/H/a/A Space and the Complex Wishart Clustering for Fully Polarimetric SAR Data Analysis , 2007 .

[20]  N. R. Goodman Statistical analysis based on a certain multivariate complex Gaussian distribution , 1963 .

[21]  Chong Wang,et al.  Nested Hierarchical Dirichlet Processes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Carlos López-Martínez,et al.  Statistical Modeling of Polarimetric SAR Data: A Survey and Challenges , 2017, Remote. Sens..

[23]  Xiaochun Cao,et al.  Constrained Multi-View Video Face Clustering , 2015, IEEE Transactions on Image Processing.

[24]  Yunhong Wang,et al.  Relevance Metric Learning for Person Re-Identification by Exploiting Listwise Similarities , 2015, IEEE Transactions on Image Processing.

[25]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.

[26]  Anthony P. Doulgeris,et al.  An Automatic ${\cal U}$-Distribution and Markov Random Field Segmentation Algorithm for PolSAR Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[28]  J. Sethuraman A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[29]  Liangpei Zhang,et al.  High-Resolution Image Classification Integrating Spectral-Spatial-Location Cues by Conditional Random Fields , 2016, IEEE Transactions on Image Processing.

[30]  Rong Yan,et al.  A Discriminative Learning Framework with Pairwise Constraints for Video Object Classification , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Yan Wu,et al.  Hierarchical Conditional Random Fields Model for Semisupervised SAR Image Segmentation , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Maoguo Gong,et al.  Unsupervised Classification of Fully Polarimetric SAR Images Based on Scattering Power Entropy and Copolarized Ratio , 2013, IEEE Geoscience and Remote Sensing Letters.

[33]  Alejandro C. Frery,et al.  The polarimetric 𝒢 distribution for SAR data analysis , 2005 .

[34]  Torbjørn Eltoft,et al.  Monitoring Glacier Changes Using Multitemporal Multipolarization SAR Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Mohammed Dabboor,et al.  An Unsupervised Classification Approach for Polarimetric SAR Data Based on the Chernoff Distance for Complex Wishart Distribution , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Xinwu Li,et al.  A New Approach to Collapsed Building Extraction Using RADARSAT-2 Polarimetric SAR Imagery , 2012, IEEE Geoscience and Remote Sensing Letters.

[37]  Jun Yu,et al.  Complex Object Correspondence Construction in Two-Dimensional Animation , 2011, IEEE Transactions on Image Processing.

[38]  Jérôme Darbon,et al.  SAR Image Regularization With Fast Approximate Discrete Minimization , 2009, IEEE Transactions on Image Processing.

[39]  Xiuping Jia,et al.  Simplified Conditional Random Fields With Class Boundary Constraint for Spectral-Spatial Based Remote Sensing Image Classification , 2012, IEEE Geoscience and Remote Sensing Letters.

[40]  Xinwu Li,et al.  Urban Area SAR Image Man-Made Target Extraction Based on the Product Model and the Time–Frequency Analysis , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  M. Escobar,et al.  Markov Chain Sampling Methods for Dirichlet Process Mixture Models , 2000 .

[42]  Armand Lopes,et al.  Optimal speckle reduction for the product model in multilook polarimetric SAR imagery and the Wishart distribution , 1997, IEEE Trans. Geosci. Remote. Sens..

[43]  Yi Su,et al.  Region-Based Classification of Polarimetric SAR Images Using Wishart MRF , 2008, IEEE Geoscience and Remote Sensing Letters.

[44]  Torbjørn Eltoft,et al.  Automated Non-Gaussian Clustering of Polarimetric Synthetic Aperture Radar Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Ron Kwok,et al.  Classification of multi-look polarimetric SAR imagery based on complex Wishart distribution , 1994 .

[46]  Shuiping Gou,et al.  Semi-Supervised Tensorial Locally Linear Embedding for Feature Extraction Using PolSAR Data , 2018, IEEE Journal of Selected Topics in Signal Processing.

[47]  Wenxian Yu,et al.  Superpixel-Based Classification With an Adaptive Number of Classes for Polarimetric SAR Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Xi Yang,et al.  ASI aurora search: an attempt of intelligent image processing for circular fisheye lens. , 2018, Optics express.

[49]  E. Pottier,et al.  Polarimetric Radar Imaging: From Basics to Applications , 2009 .

[50]  Jong-Sen Lee,et al.  Fuzzy classification of Earth terrain covers using multi-look polarimetric SAR image data , 1993, Proceedings of IGARSS '93 - IEEE International Geoscience and Remote Sensing Symposium.

[51]  Emanuele Trucco,et al.  Subcategory Classifiers for Multiple-Instance Learning and Its Application to Retinal Nerve Fiber Layer Visibility Classification , 2016, IEEE Transactions on Medical Imaging.

[52]  Deyu Meng,et al.  Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network , 2017, IEEE Transactions on Image Processing.

[53]  Shiyong Cui,et al.  A Comparative Study of Statistical Models for Multilook SAR Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[54]  Thomas L. Ainsworth,et al.  Unsupervised classification using polarimetric decomposition and the complex Wishart classifier , 1999, IEEE Trans. Geosci. Remote. Sens..

[55]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[56]  Zongben Xu,et al.  A Graph-Based Semisupervised Deep Learning Model for PolSAR Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Jie Yang,et al.  A New Automatic Ship Detection Method Using $L$-Band Polarimetric SAR Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[58]  Zhengdong Lu Semi-supervised Clustering with Pairwise Constraints: A Discriminative Approach , 2007, AISTATS.

[59]  Donald B. Percival,et al.  Probability density functions for multilook polarimetric signatures , 1994, IEEE Trans. Geosci. Remote. Sens..

[60]  Xuelong Li,et al.  An Efficient MRF Embedded Level Set Method for Image Segmentation , 2015, IEEE Transactions on Image Processing.

[61]  Lionel Bombrun,et al.  Fisher Distribution for Texture Modeling of Polarimetric SAR Data , 2008, IEEE Geoscience and Remote Sensing Letters.

[62]  Carlos López-Martínez,et al.  Analysis of texture distributions of polarimetric SAR data , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[63]  Hong Sun,et al.  A Supervised Classification Method Based on Conditional Random Fields With Multiscale Region Connection Calculus Model for SAR Image , 2011, IEEE Geoscience and Remote Sensing Letters.

[64]  C. Antoniak Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[65]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[66]  Yan Wu,et al.  The WGΓ Distribution for Multilook Polarimetric SAR Data and Its Application , 2015, IEEE Geoscience and Remote Sensing Letters.

[67]  Josiane Zerubia,et al.  Unsupervised Amplitude and Texture Classification of SAR Images With Multinomial Latent Model , 2013, IEEE Transactions on Image Processing.

[68]  Rama Chellappa,et al.  Segmentation of polarimetric synthetic aperture radar data , 1992, IEEE Trans. Image Process..

[69]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[70]  Thomas L. Ainsworth,et al.  Unsupervised classification of polarimetric synthetic aperture Radar images using fuzzy clustering and EM clustering , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[71]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Yee Whye Teh,et al.  Dirichlet Process , 2017, Encyclopedia of Machine Learning and Data Mining.

[73]  S. Quegan,et al.  Understanding Synthetic Aperture Radar Images , 1998 .

[74]  Fulvio Gini,et al.  Statistical Analysis of High-Resolution SAR Ground Clutter Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[75]  Jong-Sen Lee,et al.  Fuzzy classification of earth terrain covers using complex polarimetric SAR data , 1996 .

[76]  Liang Wang,et al.  Cross-Modal Subspace Learning via Pairwise Constraints , 2014, IEEE Transactions on Image Processing.