Maximum-likelihood parameter estimation for unsupervised stochastic model-based image segmentation

An unsupervised stochastic model-based approach to image segmentation is described, and some of its properties investigated. In this approach, the problem of model parameter estimation is formulated as a problem of parameter estimation from incomplete data, and the expectation-maximization (EM) algorithm is used to determine a maximum-likelihood (ML) estimate. Previously, the use of the EM algorithm in this application has encountered difficulties since an analytical expression for the conditional expectations required in the EM procedure is generally unavailable, except for the simplest models. In this paper, two solutions are proposed to solve this problem: a Monte Carlo scheme and a scheme related to Besag's (1986) iterated conditional mode (ICM) method. Both schemes make use of Markov random-field modeling assumptions. Examples are provided to illustrate the implementation of the EM algorithm for several general classes of image models. Experimental results on both synthetic and real images are provided.

[1]  T.F. Quatieri,et al.  Statistical model-based algorithms for image analysis , 1986, Proceedings of the IEEE.

[2]  J. W. Modestino,et al.  the Mean Field Theory in EM Procedures for Markov Random Fields , 1991, Proceedings. 1991 IEEE International Symposium on Information Theory.

[3]  Jun Zhang,et al.  A Model-Fitting Approach to Cluster Validation with Application to Stochastic Model-Based Image Segmentation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  M.I. Miller,et al.  The role of likelihood and entropy in incomplete-data problems: Applications to estimating point-process intensities and toeplitz constrained covariances , 1987, Proceedings of the IEEE.

[5]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[6]  Thrasyvoulos N. Pappas.  An adaptive clustering algorithm for image segmentation , 1992, IEEE Trans. Signal Process..

[7]  David B. Cooper,et al.  Bayesian Clustering for Unsupervised Estimation of Surface and Texture Models , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[9]  J. W. Modestino,et al.  Use of the mean-field approximation in an EM-based approach to unsupervised stochastic model-based image segmentation , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  C. K. Yuen,et al.  Digital spectral analysis , 1979 .

[12]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Nuggehally Sampath Jayant,et al.  An adaptive clustering algorithm for image segmentation , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[14]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[15]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[16]  Patrick A. Kelly,et al.  Adaptive segmentation of speckled images using a hierarchical random field model , 1988, IEEE Trans. Acoust. Speech Signal Process..

[17]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[19]  David B. Cooper,et al.  Simple Parallel Hierarchical and Relaxation Algorithms for Segmenting Noncausal Markovian Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[21]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[22]  James W. Modestino,et al.  Texture Discrimination Based Upon an Assumed Stochastic Texture Model , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.