Performance evaluation of finite normal mixture model-based image segmentation techniques

Finite Normal Mixture (FNM) model-based image segmentation techniques adopt the following detection-estimation-classification paradigm: 1) detect the number of image regions by using theoretical information criteria; 2) estimate model parameters by using expectation-maximization (EM)/classification-maximization (CM) algorithms; and 3) classify pixels into regions by using various classifiers. This paper presents a theoretical framework to evaluate the performance of this class of image segmentation techniques. For the detection performance, probabilities of over-detection and under-detection of the number of image regions are defined, and the associated formulae in terms of model parameters and image quality are derived. For the estimation performance, both EM and CM algorithms are showed to produce asymptotically unbiased ML estimates of model parameters in the case of no-overlap. Cramer-Rao bounds of variances of these estimates are derived. For the classification performance, misclassification probability for the Bayesian classifier is defined, and a simple formula based on parameter estimates and classified data is derived to evaluate segmentation errors. This evaluation method provides both theoretically approachable accuracy limits of the techniques and practically achievable performance of the given images. Theoretical and experimental results are in good agreement and indicate that, for images of moderate quality, the detection operation is robust, the parameter estimates are accurate, and the segmentation errors are small.

[1]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..

[2]  Leonid I. Perlovsky,et al.  Cramer-Rao bounds for the estimation of means in a clustering problem , 1988, Pattern Recognit. Lett..

[3]  A. M. Walker,et al.  Probability Theory and Mathematical Statistics. By Marek Fisz. Pp. xvi, 677. 115s. 1963. (John Wiley and Sons: New York, London) , 1965, The Mathematical Gazette.

[4]  Restoration Jun Zhang The Mean Field Theory in EM Procedures for Blind Markov Random Field Image , 1992 .

[5]  Jun Zhang,et al.  A Markov Random Field Model-Based Approach to Image Interpretation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Patrick A. Kelly,et al.  Adaptive segmentation of speckled images using a hierarchical random field model , 1988, IEEE Trans. Acoust. Speech Signal Process..

[7]  Zhengrong Liang,et al.  Parameter estimation and tissue segmentation from multispectral MR images , 1994, IEEE Trans. Medical Imaging.

[8]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  M Fuderer,et al.  The information content of MR images. , 1988, IEEE transactions on medical imaging.

[10]  Tianhu Lei,et al.  Statistical approach to X-ray CT imaging and its applications in image analysis. I. Statistical analysis of X-ray CT imaging , 1992, IEEE Trans. Medical Imaging.

[11]  T. W. Anderson An Introduction to Multivariate Statistical Analysis , 1959 .

[12]  J. Rissanen A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH , 1983 .

[13]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[14]  Nicolaos B. Karayiannis,et al.  Soft learning vector quantization and clustering algorithms based on non-Euclidean norms: single-norm algorithms , 2005, IEEE Transactions on Neural Networks.

[15]  I. S. Gradshteyn,et al.  Table of Integrals, Series, and Products , 1976 .

[16]  Leonid I. Perlovsky,et al.  Cramer-Rao bounds for the estimation of normal mixtures , 1989, Pattern Recognit. Lett..

[17]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[18]  T Lei,et al.  Statistical approach to X-ray CT imaging and its applications in image analysis. II. A new stochastic model-based image segmentation technique for X-ray CT image , 1992, IEEE Trans. Medical Imaging.

[19]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[20]  Jun Zhang,et al.  The mean field theory in EM procedures for blind Markov random field image restoration , 1993, IEEE Trans. Image Process..

[21]  Supun Samarasekera,et al.  Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 1996, CVGIP Graph. Model. Image Process..

[22]  Nicolaos B. Karayiannis,et al.  Soft learning vector quantization and clustering algorithms based on ordered weighted aggregation operators , 2000, IEEE Trans. Neural Networks Learn. Syst..

[23]  Anil K. Jain,et al.  Random field models in image analysis , 1989 .

[24]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[25]  H. Scheffé,et al.  The Analysis of Variance , 1960 .

[26]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Xavier Descombes,et al.  Spatio-temporal fMRI analysis using Markov random fields , 1998, IEEE Transactions on Medical Imaging.

[28]  Jun Zhang,et al.  A Model-Fitting Approach to Cluster Validation with Application to Stochastic Model-Based Image Segmentation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..