Multi-modal medical image segmentation based on vector-valued active contour models

Abstract Positron emission tomography (PET), magnetic resonance imaging (MRI) and computed tomography (CT) are widely utilized medical imaging modalities that provide essential anatomic and structural details. Many medical segmentation methods are not effective for a single-modal image of poor quality (e.g., low contrast in CT or low spatial resolution in PET). For practical radiotherapy treatment planning, multi-modal imaging information is regularly used. In this paper, a novel vector-valued active contour model is proposed to segment multi-modal medical images simultaneously for abnormal tissue regions. The method makes use of the functionality information and anatomical structure information advantages from each modality. Since each modality has its own signal characteristics, we use region-based information, combining hybrid mean intensities simultaneously. Furthermore, by utilizing a two-dimensional vector field with different image modalities, edge-based information is used to constrain the results of the image segmentation. The proposed approach is evaluated on datasets including lung PET-CT and brain MRI-CT images. Our qualitative and quantitative research results confirm the effectiveness of the proposed method.

[1]  Xiaofei Yan,et al.  Juxta-Vascular Pulmonary Nodule Segmentation in PET-CT Imaging Based on an LBF Active Contour Model with Information Entropy and Joint Vector , 2018, Comput. Math. Methods Medicine.

[2]  David R. Haynor,et al.  PET-CT image registration in the chest using free-form deformations , 2003, IEEE Transactions on Medical Imaging.

[3]  Jiebo Luo,et al.  Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance , 2011, International Journal of Computer Vision.

[4]  David R. Haynor,et al.  Nonrigid multimodality image registration , 2001, SPIE Medical Imaging.

[5]  Yongguo Zheng,et al.  A Fast Global Minimization of Region-Scalable Fitting Model for Medical Image Segmentation , 2014, J. Softw..

[6]  Marios Savvides,et al.  Deep Recurrent Level Set for Segmenting Brain Tumors , 2018, MICCAI.

[7]  Woei-Chyn Chu,et al.  Performance measure characterization for evaluating neuroimage segmentation algorithms , 2009, NeuroImage.

[8]  Vikrant Bhateja,et al.  Medical Imaging in Clinical Applications: Algorithmic and Computer-Based Approaches , 2016 .

[9]  David Dagan Feng,et al.  Robust Model for Segmenting Images With/Without Intensity Inhomogeneities , 2013, IEEE Transactions on Image Processing.

[10]  R. S. Anand,et al.  A hybrid edge-based segmentation approach for ultrasound medical images , 2017, Biomed. Signal Process. Control..

[11]  Junjie Bai,et al.  Optimal Co-Segmentation of Tumor in PET-CT Images With Context Information , 2013, IEEE Transactions on Medical Imaging.

[12]  S. Gowri,et al.  AMELIORATE FUZZY C-MEANS: AN AMELIORATE FUZZY C-MEANS CLUSTERING ALGORITHM FOR CT-LUNG IMAGE SEGMENTATION , 2013 .

[13]  Vidya Manian,et al.  Object segmentation in hyperspectral images using active contours and graph cuts , 2012 .

[14]  J. Buatti,et al.  Globally Optimal Tumor Segmentation in PET-CT Images: A Graph-Based Co-segmentation Method , 2011, IPMI.

[15]  Xinjian Chen,et al.  Joint segmentation of anatomical and functional images: Applications in quantification of lesions from PET, PET-CT, MRI-PET, and MRI-PET-CT images , 2013, Medical Image Anal..

[16]  Ji Zhao,et al.  An Improved Integrated Active Contour Model without Re-Initialization for Vector-Valued Images Segmentation , 2012 .

[17]  T. Holland-Letz,et al.  Intra-individual comparison of 68Ga-PSMA-11-PET/CT and multi-parametric MR for imaging of primary prostate cancer , 2016, European Journal of Nuclear Medicine and Molecular Imaging.

[18]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[19]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[20]  Tony F. Chan,et al.  Active Contours without Edges for Vector-Valued Images , 2000, J. Vis. Commun. Image Represent..

[21]  Lei Wang,et al.  An active contour model based on local fitted images for image segmentation , 2017, Inf. Sci..

[22]  Luca Zanni,et al.  Reconstruction of 3D X-ray CT images from reduced sampling by a scaled gradient projection algorithm , 2018, Comput. Optim. Appl..

[23]  Ulas Bagci,et al.  Computer-assisted detection of infectious lung diseases: A review , 2012, Comput. Medical Imaging Graph..

[24]  Li Chen,et al.  GACV: Geodesic-Aided C-V method , 2006, Pattern Recognit..

[25]  Isabella Castiglioni,et al.  A fully automatic, threshold-based segmentation method for the estimation of the Metabolic Tumor Volume from PET images: validation on 3D printed anthropomorphic oncological lesions , 2016 .

[26]  A. Valarmathi,et al.  Efficient fuzzy c-means based multilevel image segmentation for brain tumor detection in MR images , 2018, Design Automation for Embedded Systems.

[27]  Jinhui Tang,et al.  Weakly Supervised Deep Matrix Factorization for Social Image Understanding , 2017, IEEE Transactions on Image Processing.

[28]  Victor Alves,et al.  Adaptive feature recombination and recalibration for semantic segmentation: application to brain tumor segmentation in MRI , 2018, MICCAI.

[29]  Mohammad Sadegh Helfroush,et al.  Simultaneous vector-valued image segmentation and intensity nonuniformity correction using variational level set combined with Markov random field modeling , 2016, Signal Image Video Process..

[30]  Dacheng Tao,et al.  One-Pass Multi-task Convolutional Neural Networks for Efficient Brain Tumor Segmentation , 2018, MICCAI.

[31]  Xiaofeng Zhu,et al.  Efficient kNN Classification With Different Numbers of Nearest Neighbors , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[32]  C. A. Murthy,et al.  IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Standardization of Edge Magnitude in Color Images , 2022 .

[33]  Xuelong Li,et al.  Learning k for kNN Classification , 2017, ACM Trans. Intell. Syst. Technol..

[34]  Guillermo Sapiro,et al.  Vector-valued active contours , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Isabelle Bloch,et al.  From neonatal to adult brain MR image segmentation in a few seconds using 3D-like fully convolutional network and transfer learning , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[36]  Jihun Oh,et al.  Improved B-spline image registration between exhale and inhale lung CT images based on intensity and gradient orientation information , 2016, SPIE Medical Imaging.

[37]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Chin-Tu Chen,et al.  Medical image segmentation by a constraint satisfaction neural network , 1990 .

[39]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[40]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[41]  Tianshuang Qiu,et al.  A hybrid active contour model based on global and local information for medical image segmentation , 2019, Multidimens. Syst. Signal Process..

[42]  Isabelle Bloch,et al.  Joint variational segmentation of CT-PET data for tumoral lesions , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.