Precise segmentation of multimodal images

We propose new techniques for unsupervised segmentation of multimodal grayscale images such that each region-of-interest relates to a single dominant mode of the empirical marginal probability distribution of grey levels. We follow the most conventional approaches in that initial images and desired maps of regions are described by a joint Markov-Gibbs random field (MGRF) model of independent image signals and interdependent region labels. However, our focus is on more accurate model identification. To better specify region borders, each empirical distribution of image signals is precisely approximated by a linear combination of Gaussians (LCG) with positive and negative components. We modify an expectation-maximization (EM) algorithm to deal with the LCGs and also propose a novel EM-based sequential technique to get a close initial LCG approximation with which the modified EM algorithm should start. The proposed technique identifies individual LCG models in a mixed empirical distribution, including the number of positive and negative Gaussians. Initial segmentation based on the LCG models is then iteratively refined by using the MGRF with analytically estimated potentials. The convergence of the overall segmentation algorithm at each stage is discussed. Experiments show that the developed techniques segment different types of complex multimodal medical images more accurately than other known algorithms.

[1]  Anil K. Jain,et al.  Goal-Directed Evaluation of Binarization Methods , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[3]  Dimitris N. Metaxas,et al.  MetaMorphs: Deformable shape and texture models , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Zhuowen Tu,et al.  Image Parsing: Unifying Segmentation, Detection, and Recognition , 2005, International Journal of Computer Vision.

[6]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[7]  A. Ardeshir Goshtasby,et al.  Curve Fitting by a Sum of Gaussians , 1994, CVGIP Graph. Model. Image Process..

[8]  Chris A. Glasbey,et al.  An Analysis of Histogram-Based Thresholding Algorithms , 1993, CVGIP Graph. Model. Image Process..

[9]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[10]  Charles C. Taylor,et al.  Bayesian texture segmentation of weed and crop images using reversible jump Markov chain Monte Carlo methods , 2003 .

[11]  Václav Hlavác,et al.  Ten Lectures on Statistical and Structural Pattern Recognition , 2002, Computational Imaging and Vision.

[12]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[13]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[14]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[15]  Georgy L. Gimel'farb,et al.  Probabilistic models of digital region maps based on Markov random fields with short- and long-range interaction , 1993, Pattern Recognit. Lett..

[16]  Aly A. Farag,et al.  Image segmentation based on composite random field models , 1992 .

[17]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[18]  Aly A. Farag,et al.  Image segmentation using GMRF models: parameters estimation and applications , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[19]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[20]  Narendra Ahuja,et al.  Regression based bandwidth selection for segmentation using Parzen windows , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[21]  Slng-Tze Bow Supervised and Unsupervised Learning in Pattern Recognition , 2002 .

[22]  Charles A. Bouman,et al.  A multiscale random field model for Bayesian image segmentation , 1994, IEEE Trans. Image Process..

[23]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[24]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Aly A. Farag,et al.  Precise Image Segmentation by Iterative EM-Based Approximation of Empirical Grey Level Distributions with Linear Combinations of Gaussians , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[26]  Jiancheng Jia,et al.  An active contour model for colour region extraction in natural scenes , 1999, Image Vis. Comput..

[27]  Pong C. Yuen,et al.  Segmented snake for contour detection , 1998, Pattern Recognit..

[28]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[29]  Charles A. Bouman,et al.  Multiple Resolution Segmentation of Textured Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[31]  Mubarak Shah,et al.  A Fast algorithm for active contours and curvature estimation , 1992, CVGIP Image Underst..

[32]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  H. Sorenson,et al.  Recursive bayesian estimation using gaussian sums , 1971 .

[34]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[35]  Aly A. Farag,et al.  Expectation-maximization for a linear combination of Gaussians , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[36]  A.K. Jain,et al.  Advances in mathematical models for image processing , 1981, Proceedings of the IEEE.

[37]  Anil K. Jain,et al.  Random field models in image analysis , 1989 .

[38]  Ayman El-Baz,et al.  Experimental Evaluation of Statistical and Deformable Model-Based Segmentation , 2004 .

[39]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[40]  Georgy L. Gimel'farb,et al.  Image Textures and Gibbs Random Fields , 1999, Computational Imaging and Vision.

[41]  David N. Levin,et al.  "Brownian Strings": Segmenting Images with Stochastically Deformable Contours , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Vladimir Kolmogorov,et al.  Computing geodesics and minimal surfaces via graph cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[43]  Pong C. Yuen,et al.  A contour detection method: Initialization and contour model , 1999, Pattern Recognit. Lett..

[44]  Laurence G. Hassebrook,et al.  A multistage, optimal active contour model , 1996, IEEE Trans. Image Process..

[45]  Miroslaw Bober,et al.  Fast Active Contour Convergence Through Curvature Scale Space Filtering , 2003 .

[46]  Aly A. Farag,et al.  Density estimation using modified expectation-maximization algorithm for a linear combination of Gaussians , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[47]  Ibrahim M. Elfadel,et al.  Structure of aura and co-occurrence matrices for the Gibbs texture model , 1992, Journal of Mathematical Imaging and Vision.

[48]  Nikos Paragios,et al.  Gradient vector flow fast geometric active contours , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.