Dual-modality brain PET-CT image segmentation based on adaptive use of functional and anatomical information

Dual medical imaging modalities, such as PET-CT, are now a routine component of clinical practice. Medical image segmentation methods, however, have generally only been applied to single modality images. In this paper, we propose the dual-modality image segmentation model to segment brain PET-CT images into gray matter, white matter and cerebrospinal fluid. This model converts PET-CT image segmentation into an optimization process controlled simultaneously by PET and CT voxel values and spatial constraints. It is innovative in the creation and application of the modality discriminatory power (MDP) coefficient as a weighting scheme to adaptively combine the functional (PET) and anatomical (CT) information on a voxel-by-voxel basis. Our approach relies upon allowing the modality with higher discriminatory power to play a more important role in the segmentation process. We compared the proposed approach to three other image segmentation strategies, including PET-only based segmentation, combination of the results of independent PET image segmentation and CT image segmentation, and simultaneous segmentation of joint PET and CT images without an adaptive weighting scheme. Our results in 21 clinical studies showed that our approach provides the most accurate and reliable segmentation for brain PET-CT images.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  M. Bandstra,et al.  Measurements of Fukushima fallout by the Berkeley Radiological Air and Water Monitoring project , 2011, 2011 IEEE Nuclear Science Symposium Conference Record.

[3]  Christian Roux,et al.  A Fuzzy Locally Adaptive Bayesian Segmentation Approach for Volume Determination in PET , 2009, IEEE Transactions on Medical Imaging.

[4]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[5]  M. Janier,et al.  Automated seeds location for whole body NaF PET segmentation , 2003, 2003 IEEE Nuclear Science Symposium. Conference Record (IEEE Cat. No.03CH37515).

[6]  Christophe Lenglet,et al.  ODF reconstruction in q-ball imaging with solid angle consideration , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[7]  Ulla Ruotsalainen,et al.  Genetic Algorithms for Finite Mixture Model Based Voxel Classification in Neuroimaging , 2007, IEEE Transactions on Medical Imaging.

[8]  S M Larson,et al.  Segmentation of lung lesion volume by adaptive positron emission tomography image thresholding , 1997, Cancer.

[9]  C. Rübe,et al.  Comparison of different methods for delineation of 18F-FDG PET-positive tissue for target volume definition in radiotherapy of patients with non-Small cell lung cancer. , 2005, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[10]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[11]  Sébastien Ourselin,et al.  Spline Based Inhomogeneity Correction for 11C-PIB PET Segmentation Using Expectation Maximization , 2007, MICCAI.

[12]  U. Ruotsalainen,et al.  Automatic Extraction of Caudate and Putamen in [$^11$C] Raclopride PET Using Deformable Surface Models and Normalized Cuts , 2006, IEEE Transactions on Nuclear Science.

[13]  V. Sossi,et al.  Methods for Parkinson’s rat model PET image analysis with regions of interest , 2007, 2007 IEEE Nuclear Science Symposium Conference Record.

[14]  Hugh Gribben,et al.  MAP-MRF segmentation of lung tumours in PET/CT images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[15]  Weidong Cai,et al.  Dual-Modality PET-CT Visualization using Real-Time Volume Rendering and Image Fusion with Interactive 3D Segmentation of Anatomical Structures , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[16]  Myoung-Hee Kim,et al.  Tumor segmentation from small animal PET using region growing based on gradient magnitude , 2005, Proceedings of 7th International Workshop on Enterprise networking and Computing in Healthcare Industry, 2005. HEALTHCOM 2005..

[17]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[18]  David A. Clausi,et al.  Unsupervised image segmentation using a simple MRF model with a new implementation scheme , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[19]  Ulla Ruotsalainen,et al.  Automatic extraction of brain surface and mid-sagittal plane from PET images applying deformable models , 2005, Comput. Methods Programs Biomed..

[20]  H. Malcolm Hudson,et al.  Accelerated image reconstruction using ordered subsets of projection data , 1994, IEEE Trans. Medical Imaging.

[21]  Xiaolei Huang,et al.  Automated tumor delineation using joint PET/CT information , 2007, SPIE Medical Imaging.

[22]  David Dagan Feng,et al.  Segmentation of dual modality brain PET/CT images using the MAP-MRF model , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[23]  Ethem Alpaydin.  Bayesian Decision Theory , 2014 .

[24]  J. Thie.  Understanding the standardized uptake value, its methods, and implications for usage. , 2004, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[25]  Michel Herbin,et al.  TUMOR SEGMENTATION FROM PET/CT IMAGES USING LEVEL SETS METHOD , 2006 .

[26]  David Dagan Feng,et al.  Segmentation of brain PET-CT images based on adaptive use of complementary information , 2009, Medical Imaging.

[27]  Sung-Cheng Huang,et al.  Regional quantitative analysis of cortical surface maps of FDG PET images , 2005, IEEE Nuclear Science Symposium Conference Record, 2005.

[28]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[29]  Steve R. Gunn,et al.  Markov Random Field Models for Segmentation of PET Images , 2001, IPMI.

[30]  Andreas Bockisch,et al.  Segmentation of PET volumes by iterative image thresholding. , 2007, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[31]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[32]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[33]  Yong Xia,et al.  Segmentation of brain structures using PET-CT images , 2008, 2008 International Conference on Information Technology and Applications in Biomedicine.

[34]  Sébastien Ourselin,et al.  PIB-PET SEGMENTATION FOR AUTOMATIC SUVR NORMALISATION WITHOUT MR INFORMATION , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[35]  Abbes Amira,et al.  A segmentation concept for positron emission tomography imaging using multiresolution analysis , 2008, Neurocomputing.

[36]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.