Markov Regularization of Mixture of Latent variable Models for Multi-component Image Unsupervised Joint Reduction/Segmentatin

This paper is concerned with multi-component image segmentation which plays an important role in many imagery applications. Unfortunately, we are faced with the Hughes phenomenon when the number of components increases, and a space dimensionality reduction is often carried out as a preprocessing step before segmentation. An interesting solution is the mixtures of latent variable models which recover clusters in the observation structure and establish a local linear mapping on a reduced dimension space for each cluster. Thus, a globally nonlinear model is obtained to reduce dimensionality. Furthermore, a likelihood to each local model is often available which allows a well formulation of the mixture model and a maximum likelihood based decision for the clustering task. However for D-component images classification, such clustering, based only on the distance between observations in the D-dimensional space is not adapted since it neglects the observation spatial locations in the image. We propose to use a Markov a priori associated with such models to regularize D-dimensional pixel classification. Thus segmentation and reduction are performed simultaneously. In this paper, we focus on the probabilistic principal component analysis (PPCA) as latent model, and the hidden Markov quad-tree (HMT) as a Markov a priori

[1]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[3]  Geoffrey E. Hinton,et al.  The EM algorithm for mixtures of factor analyzers , 1996 .

[4]  Wojciech Pieczynski,et al.  Estimation of Generalized Multisensor Hidden Markov Chains and Unsupervised Image Segmentation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Nanda Kambhatla,et al.  Dimension Reduction by Local Principal Component Analysis , 1997, Neural Computation.

[6]  PieczynskiWojciech,et al.  Estimation of Generalized Multisensor Hidden Markov Chains and Unsupervised Image Segmentation , 1997 .

[7]  Patrick Pérez,et al.  Noniterative Manipulation of Discrete Energy-Based Models for Image Analysis , 1997, EMMCVPR.

[8]  Patrick Pérez,et al.  Hierarchical Markovian segmentation of multispectral images for the reconstruction of water depth maps , 2004, Comput. Vis. Image Underst..

[9]  William D. Penny,et al.  Mixtures of Independent Component Analysers , 2001, ICANN.

[10]  Francoise J. Preteux,et al.  Hierarchical Markov random field models applied to image analysis: a review , 1995, Optics + Photonics.

[11]  Josiane Zerubia,et al.  A Hierarchical Markov Random Field Model and Multitemperature Annealing for Parallel Image Classification , 1996, CVGIP Graph. Model. Image Process..

[12]  Terrence J. Sejnowski,et al.  ICA Mixture Models for Unsupervised Classification of Non-Gaussian Classes and Automatic Context Switching in Blind Signal Separation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Patrick Pérez,et al.  Sonar image segmentation using an unsupervised hierarchical MRF model , 2000, IEEE Trans. Image Process..

[14]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[15]  David G. Stork,et al.  Pattern Classification , 1973 .

[16]  Michael I. Jordan,et al.  Mixtures of Probabilistic Principal Component Analyzers , 2001 .

[17]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[18]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[19]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[20]  Patrick Pérez,et al.  Discrete Markov image modeling and inference on the quadtree , 2000, IEEE Trans. Image Process..