A Spatial Gaussian Mixture Model for Optical Remote Sensing Image Clustering

Clustering has always been one of the most challenging tasks in optical remote-sensing image (ORSI) processing, as a result of the intrinsic complexity of the distribution of the ground objects. The Gaussian mixture model (GMM), as a traditional, effective clustering method, has been widely applied. However, the traditional model does not take the spatial information into consideration. To solve the problem, a new model named the spatial Gaussian mixture model (SGMM) is proposed for ORSI clustering. The SGMM can incorporate the spatial information by generating spatial windows around pixels. An estimation algorithm based on expectation-maximization (EM) is also developed to estimate the parameters of the SGMM. The relationships between the SGMM/GMM and the SGMM/probabilistic latent semantic analysis (PLSA) are analyzed theoretically. The proposed SGMM can be considered to be an extension of the GMM and a continuous version of PLSA. In addition, two methods based on the SGMM are proposed to infer the cluster labels of the pixels. One method is based on the maximum likelihood rule, and is called SGMM-MLR, while the other method combines the SGMM and conditional random fields (CRF), and is called SGMM-CRF. The experimental results with three remote-sensing images show that the proposed clustering method based on the SGMM can improve the performance of clustering for ORSIs, compared to k-means, fuzzy c-means (FCM), and the GMM. It is also able to acquire a better performance than the latest cluster methods with spatial information, such as kernel weighted fuzzy local information c-means (KWFLICM), and the GMM coupled with CRF.

[1]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Maoguo Gong,et al.  Fuzzy C-Means Clustering With Local Information and Kernel Metric for Image Segmentation , 2013, IEEE Transactions on Image Processing.

[3]  Selim Aksoy,et al.  Detection of Compound Structures Using a Gaussian Mixture Model With Spectral and Spatial Constraints , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[5]  David A. Landgrebe,et al.  A model-based mixture-supervised classification approach in hyperspectral data analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[6]  David A. Landgrebe,et al.  Robust parameter estimation for mixture model , 2000, IEEE Trans. Geosci. Remote. Sens..

[7]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[8]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[9]  Iñaki Barcena,et al.  The Basque Country , 2003 .

[10]  Turgay Çelik Bayesian change detection based on spatial sampling and Gaussian mixture model , 2011, Pattern Recognit. Lett..

[11]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[12]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[14]  Liangpei Zhang,et al.  Spectral-Spatial Clustering with a Local Weight Parameter Determination Method for Remote Sensing Imagery , 2016, Remote. Sens..

[15]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[16]  David J. Miller,et al.  A Mixture Model and EM-Based Algorithm for Class Discovery, Robust Classification, and Outlier Rejection in Mixed Labeled/Unlabeled Data Sets , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Driss Aboutajdine,et al.  Textural feature selection by joint mutual information based on Gaussian mixture model for multispectral image classification , 2010, Pattern Recognit. Lett..

[18]  X. Zhou,et al.  Optimisation of Gaussian mixture model for satellite image classification , 2006 .

[19]  Anil K. Jain,et al.  Simultaneous feature selection and clustering using mixture models , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  James E. Fowler,et al.  Segmented Mixture-of-Gaussian Classification for Hyperspectral Image Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.

[22]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[23]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[25]  Liangpei Zhang,et al.  An Adaptive Memetic Fuzzy Clustering Algorithm With Spatial Information for Remote Sensing Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  James E. Fowler,et al.  Hyperspectral Image Classification Using Gaussian Mixture Models and Markov Random Fields , 2014, IEEE Geoscience and Remote Sensing Letters.

[27]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[28]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Liangpei Zhang,et al.  Detail-Preserving Smoothing Classifier Based on Conditional Random Fields for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[31]  Adrian E. Raftery,et al.  How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis , 1998, Comput. J..

[32]  Liangpei Zhang,et al.  Automatic Fuzzy Clustering Based on Adaptive Multi-Objective Differential Evolution for Remote Sensing Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Yu Wang,et al.  A study of a Gaussian mixture model for urban land-cover mapping based on VHR remote sensing imagery , 2016 .

[34]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[35]  Liangpei Zhang,et al.  Scene Classification Based on the Multifeature Fusion Probabilistic Topic Model for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[37]  Sankar K. Pal,et al.  Multispectral image segmentation using the rough-set-initialized EM algorithm , 2002, IEEE Trans. Geosci. Remote. Sens..