Iterative framework for the joint segmentation and CT synthesis of MR images: application to MRI-only radiotherapy treatment planning

Abstract To tackle the problem of magnetic resonance imaging (MRI)-only radiotherapy treatment planning (RTP), we propose a multi-atlas information propagation scheme that jointly segments organs and generates pseudo x-ray computed tomography (CT) data from structural MR images (T1-weighted and T2-weighted). As the performance of the method strongly depends on the quality of the atlas database composed of multiple sets of aligned MR, CT and segmented images, we also propose a robust way of registering atlas MR and CT images, which combines structure-guided registration, and CT and MR image synthesis. We first evaluated the proposed framework in terms of segmentation and CT synthesis accuracy on 15 subjects with prostate cancer. The segmentations obtained with the proposed method were compared using the Dice score coefficient (DSC) to the manual segmentations. Mean DSCs of 0.73, 0.90, 0.77 and 0.90 were obtained for the prostate, bladder, rectum and femur heads, respectively. The mean absolute error (MAE) and the mean error (ME) were computed between the reference CTs (non-rigidly aligned to the MRs) and the pseudo CTs generated with the proposed method. The MAE was on average \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}$45.7\pm 4.6$ \end{document}45.7±4.6 HU and the ME \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}$-1.6\pm 7.7$ \end{document}−1.6±7.7 HU. We then performed a dosimetric evaluation by re-calculating plans on the pseudo CTs and comparing them to the plans optimised on the reference CTs. We compared the cumulative dose volume histograms (DVH) obtained for the pseudo CTs to the DVH obtained for the reference CTs in the planning target volume (PTV) located in the prostate, and in the organs at risk at different DVH points. We obtained average differences of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}$-0.14 \% $ \end{document}−0.14% in the PTV for \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}${{D}_{98 \% }}$ \end{document}D98%, and between \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}$-0.14 \% $ \end{document}−0.14% and 0.05% in the PTV, bladder, rectum and femur heads for Dmean and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}${{D}_{2 \% }}$ \end{document}D2%. Overall, we demonstrate that the proposed framework is able to automatically generate accurate pseudo CT images and segmentations in the pelvic region, potentially bypassing the need for CT scan for accurate RTP.

[1]  Sébastien Ourselin,et al.  Fast free-form deformation using graphics processing units , 2010, Comput. Methods Programs Biomed..

[2]  Wicger K H Wong,et al.  Evaluation and optimization of the parameters used in multiple-atlas-based segmentation of prostate cancers in radiation therapy. , 2016, The British journal of radiology.

[3]  Habib Zaidi,et al.  Atlas-guided generation of pseudo-CT images for MRI-only and hybrid PET–MRI-guided radiotherapy treatment planning , 2016, Physics in medicine and biology.

[4]  J. Edmund,et al.  A criterion for the reliable use of MRI-only radiotherapy , 2014, Radiation oncology.

[5]  Olivier Salvado,et al.  An atlas-based electron density mapping method for magnetic resonance imaging (MRI)-alone treatment planning and adaptive MRI-based prostate radiation therapy. , 2012, International journal of radiation oncology, biology, physics.

[6]  Ninon Burgos,et al.  Robust CT Synthesis for Radiotherapy Planning: Application to the Head and Neck Region , 2015, MICCAI.

[7]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Ninon Burgos,et al.  Multi-contrast attenuation map synthesis for PET/MR scanners: assessment on FDG and Florbetapir PET tracers , 2015, European Journal of Nuclear Medicine and Molecular Imaging.

[10]  D. Izquierdo-Garcia,et al.  MR Imaging-Guided Attenuation Correction of PET Data in PET/MR Imaging. , 2016, PET clinics.

[11]  Sébastien Ourselin,et al.  Global image registration using a symmetric block-matching approach , 2014, Journal of medical imaging.

[12]  Sébastien Ourselin,et al.  Parametric non-rigid registration using a stationary velocity field , 2012, 2012 IEEE Workshop on Mathematical Methods in Biomedical Image Analysis.

[13]  Stefan Klein,et al.  Automatic segmentation of the prostate in 3D MR images by atlas matching using localized mutual information. , 2008, Medical physics.

[14]  Nicholas Ayache,et al.  Iconic feature based nonrigid registration: the PASHA algorithm , 2003, Comput. Vis. Image Underst..

[15]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[16]  Lei Xing,et al.  A unifying probabilistic Bayesian approach to derive electron density from MRI for radiation therapy treatment planning , 2014, Physics in medicine and biology.

[17]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Meritxell Bach Cuadra,et al.  A review of atlas-based segmentation for magnetic resonance brain images , 2011, Comput. Methods Programs Biomed..

[19]  Yaozong Gao,et al.  Learning-Based Multimodal Image Registration for Prostate Cancer Radiation Therapy , 2016, MICCAI.

[20]  Daniel Rueckert,et al.  A Probabilistic Patch-Based Label Fusion Model for Multi-Atlas Segmentation With Registration Refinement: Application to Cardiac MR Images , 2013, IEEE Transactions on Medical Imaging.

[21]  Aaron Carass,et al.  Using image synthesis for multi-channel registration of different image modalities , 2015, Medical Imaging.

[22]  Jurgen Fripp,et al.  Automatic Substitute Computed Tomography Generation and Contouring for Magnetic Resonance Imaging (MRI)-Alone External Beam Radiation Therapy From Standard MRI Sequences. , 2015, International journal of radiation oncology, biology, physics.

[23]  Snehashis Roy,et al.  MR to CT registration of brains using image synthesis , 2014, Medical Imaging.

[24]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[25]  Ben Glocker,et al.  Is Synthesizing MRI Contrast Useful for Inter-modality Analysis? , 2013, MICCAI.

[26]  Jinsoo Uh,et al.  MRI-based treatment planning with pseudo CT generated through atlas registration. , 2014, Medical physics.

[27]  Marcel van Herk,et al.  Target definition in prostate, head, and neck. , 2005, Seminars in radiation oncology.

[28]  Ninon Burgos,et al.  Joint Segmentation and CT Synthesis for MRI-only Radiotherapy Treatment Planning , 2016, MICCAI.

[29]  Peter B. Greer,et al.  Structure-Guided Nonrigid Registration of CT-MR Pelvis Scans with Large Deformations in MR-Based Image Guided Radiation Therapy , 2013, CLIP.

[30]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[31]  D Forsberg,et al.  Generating patient specific pseudo-CT of the head from MR using atlas-based regression , 2015, Physics in medicine and biology.

[32]  Ninon Burgos,et al.  Attenuation Correction Synthesis for Hybrid PET-MR Scanners: Application to Brain Studies , 2014, IEEE Transactions on Medical Imaging.