Genetic Algorithms for Finite Mixture Model Based Voxel Classification in Neuroimaging

Finite mixture models (FMMs) are an indispensable tool for unsupervised classification in brain imaging. Fitting an FMM to the data leads to a complex optimization problem. This optimization problem is difficult to solve by standard local optimization methods, such as the expectation-maximization (EM) algorithm, if a principled initialization is not available. In this paper, we propose a new global optimization algorithm for the FMM parameter estimation problem, which is based on real coded genetic algorithms. Our specific contributions are two-fold: 1) we propose to use blended crossover in order to reduce the premature convergence problem to its minimum and 2) we introduce a completely new permutation operator specifically meant for the FMM parameter estimation. In addition to improving the optimization results, the permutation operator allows for imposing biologically meaningful constraints to the FMM parameter values. We also introduce a hybrid of the genetic algorithm and the EM algorithm for efficient solution of multidimensional FMM fitting problems. We compare our algorithm to the self-annealing EM-algorithm and a standard real coded genetic algorithm with the voxel classification tasks within the brain imaging. The algorithms are tested on synthetic data as well as real three-dimensional image data from human magnetic resonance imaging, positron emission tomography, and mouse brain MRI. The tissue classification results by our method are shown to be consistently more reliable and accurate than with the competing parameter estimation methods

[1]  James C. Gee,et al.  Partial Volume Segmentation of Cerebral MRI Scans with Mixture Model Clustering , 2001, IPMI.

[2]  A J Thompson,et al.  Progressive grey matter atrophy in clinically early relapsing-remitting multiple sclerosis , 2003, Multiple sclerosis.

[3]  I. Olkin,et al.  Generating Correlation Matrices , 1984 .

[4]  Geoffrey E. Hinton,et al.  SMEM Algorithm for Mixture Models , 1998, Neural Computation.

[5]  Reto Meuli,et al.  Robust parameter estimation of intensity distributions for brain magnetic resonance images , 1998, IEEE Transactions on Medical Imaging.

[6]  P. Santago,et al.  Quantification of MR brain images by mixture density and partial volume modeling , 1993, IEEE Trans. Medical Imaging.

[7]  W. Eric L. Grimson,et al.  Adaptive Segmentation of MRI Data , 1995, CVRMed.

[8]  D. Louis Collins,et al.  Application of Information Technology: A Four-Dimensional Probabilistic Atlas of the Human Brain , 2001, J. Am. Medical Informatics Assoc..

[9]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[10]  Mário A. T. Figueiredo On Gaussian radial basis function approximations: interpretation, extensions, and learning strategies , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[11]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[12]  Anil K. Jain,et al.  Unsupervised selection and estimation of finite mixture models , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  G. Gray,et al.  Bias in misspecified mixtures. , 1994, Biometrics.

[14]  H. Donald Gage,et al.  Statistical models of partial volume effect , 1995, IEEE Trans. Image Process..

[15]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[16]  J. Mazziotta,et al.  Brain Mapping: The Methods , 2002 .

[17]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[18]  Christopher J. Taylor,et al.  A cluster analysis approach for the characterization of dynamic PET data , 1996 .

[19]  Alan C. Evans,et al.  Automated 3-D Extraction of Inner and Outer Surfaces of Cerebral Cortex from MRI , 2000, NeuroImage.

[20]  David H. Miller,et al.  Measurement of atrophy in multiple sclerosis: pathological basis, methodological aspects and clinical relevance. , 2002, Brain : a journal of neurology.

[21]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[22]  Djamel Bouchaffra,et al.  Genetic-based EM algorithm for learning Gaussian mixture models , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Naonori Ueda,et al.  Deterministic annealing EM algorithm , 1998, Neural Networks.

[24]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[25]  R. Leahy,et al.  Magnetic Resonance Image Tissue Classification Using a Partial Volume Model , 2001, NeuroImage.

[26]  Robert D. Nowak,et al.  Wavelet-based Rician noise removal for magnetic resonance imaging , 1999, IEEE Trans. Image Process..

[27]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[28]  Meritxell Bach Cuadra,et al.  Validation of Tissue Modelization and Classification Techniques in T1-Weighted MR Brain Images , 2002, MICCAI.

[29]  Ulla Ruotsalainen,et al.  Using local median as the location of the prior distribution in iterative emission tomography image reconstruction , 1997 .

[30]  Steve R. Gunn,et al.  Markov Random Field Models for Segmentation of PET Images , 2001, IPMI.

[31]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[32]  U. Ruotsalainen,et al.  Comparison of pattern classification methods in segmentation of dynamic PET brain images , 2004, Proceedings of the 6th Nordic Signal Processing Symposium, 2004. NORSIG 2004..

[33]  A. Evans,et al.  MRI simulation-based evaluation of image-processing and classification methods , 1999, IEEE Transactions on Medical Imaging.

[34]  Jianhua Xuan,et al.  Magnetic resonance image analysis by information theoretic criteria and stochastic site models , 2001, IEEE Transactions on Information Technology in Biomedicine.

[35]  Koenraad Van Leemput,et al.  A unifying framework for partial volume segmentation of brain MR images , 2003, IEEE Transactions on Medical Imaging.

[36]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[37]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[38]  Ulla Ruotsalainen,et al.  GENETIC ALGORITHMS FOR FINITE MIXTURE MODEL BASED TISSUE CLASSIFICATION IN BRAIN MRI , 2005 .

[39]  Wesley E. Snyder,et al.  Optimization of functions with many minima , 1991, IEEE Trans. Syst. Man Cybern..

[40]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Alan C. Evans,et al.  Fast and robust parameter estimation for statistical partial volume models in brain MRI , 2004, NeuroImage.

[42]  D R Haynor,et al.  Partial volume tissue classification of multichannel magnetic resonance images-a mixel model. , 1991, IEEE transactions on medical imaging.

[43]  André Berchtold,et al.  Optimization of Mixture Models: Comparison of Different Strategies , 2004, Comput. Stat..

[44]  T.M. Talavage,et al.  Testing a model for MR imager noise , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[45]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[46]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[47]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[48]  R. Jennrich Asymptotic Properties of Non-Linear Least Squares Estimators , 1969 .

[49]  Jordi Vitrià,et al.  Learning mixture models using a genetic version of the EM algorithm , 2000, Pattern Recognition Letters.

[50]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[51]  T K Narayan,et al.  A methodology for testing for statistically significant differences between fully 3D PET reconstruction algorithms. , 1994, Physics in medicine and biology.

[52]  J. Ashburner,et al.  Multimodal Image Coregistration and Partitioning—A Unified Framework , 1997, NeuroImage.

[53]  Jouni M. Mykkänen,et al.  Deformable Mesh For Automated Surface Extraction From Noisy Images , 2004, Int. J. Image Graph..

[54]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[55]  Jordi Vitrià,et al.  Clustering in image space for place recognition and visual annotations for human-robot interaction , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[56]  Akihiro Minagawa,et al.  SMEM Algorithm Is Not Fully Compatible with Maximum-Likelihood Framework , 2002, Neural Computation.

[57]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms in Engineering Applications , 1997, Springer Berlin Heidelberg.

[58]  Ulla Ruotsalainen,et al.  Automatic extraction of brain surface and mid-sagittal plane from PET images applying deformable models , 2005, Comput. Methods Programs Biomed..

[59]  C. Patlak,et al.  Graphical Evaluation of Blood-to-Brain Transfer Constants from Multiple-Time Uptake Data. Generalizations , 1985, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.