Unsupervised image classification with a hierarchical EM algorithm

This work is undertaken in the context of hierarchical stochastic models for the resolution of discrete inverse problems from low level vision. Some of these models lie on the nodes of a quadtree which leads to non-iterative inference procedures. Nevertheless, if they circumvent the algorithmic drawbacks of grid-based models (computational load and/or great dependance on the initialization), they admit modeling shortcomings (cumbersome and somehow artificial). We investigate a new hierarchical stochastic model which benefits from both the spatial and hierarchical prior modeling. The independence graph is based on a tree which has been pollarded with nodes at the coarsest resolution exhibiting a grid-based interaction structure. For this class of model, we address the critical problem of parameter estimation. To this end, we derive an EM algorithm on the hybrid structure which mixes an exact EM algorithm on each subtree and a low cost Gibbs EM algorithm on the coarse spatial grid. Experiments on a synthetic image and multispectral satellite images are reported.

[1]  Patrick Pérez,et al.  Discrete Markov image modeling and inference on the quadtree , 2000, IEEE Trans. Image Process..

[2]  Mari Ostendorf,et al.  ML parameter estimation of a multiscale stochastic process using the EM algorithm , 2000, IEEE Trans. Signal Process..

[3]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[4]  Alan S. Willsky,et al.  Multiresolution stochastic models, data fusion, and wavelet transforms , 1993, Signal Process..

[5]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[6]  Bernard Chalmond,et al.  An iterative Gibbsian technique for reconstruction of m-ary images , 1989, Pattern Recognit..

[7]  Anthony A. Maciejewski,et al.  A multiscale stochastic image model for automated inspection , 1995, IEEE Transactions on Image Processing.

[8]  Patrick Pérez,et al.  Mode of posterior marginals with hierarchical models , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[9]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[10]  Patrick Pérez,et al.  Semi-iterative inference with hierarchical models , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[11]  Mari Ostendorf,et al.  ML estimation of a stochastic linear system with the EM algorithm and its application to speech recognition , 1993, IEEE Trans. Speech Audio Process..

[12]  Charles A. Bouman,et al.  A multiscale random field model for Bayesian image segmentation , 1994, IEEE Trans. Image Process..

[13]  W. Clem Karl,et al.  Efficient multiscale regularization with applications to the computation of optical flow , 1994, IEEE Trans. Image Process..

[14]  Jun Zhang,et al.  Maximum-likelihood parameter estimation for unsupervised stochastic model-based image segmentation , 1994, IEEE Trans. Image Process..

[15]  Patrick Pérez,et al.  Noniterative manipulation of discrete energy-based models for image analysis , 1997, Pattern Recognit..