Magnetic resonance imaging-based pseudo computed tomography using anatomic signature and joint dictionary learning

Abstract. Magnetic resonance imaging (MRI) provides a number of advantages over computed tomography (CT) for radiation therapy treatment planning; however, MRI lacks the key electron density information necessary for accurate dose calculation. We propose a dictionary-learning-based method to derive electron density information from MRIs. Specifically, we first partition a given MR image into a set of patches, for which we used a joint dictionary learning method to directly predict a CT patch as a structured output. Then a feature selection method is used to ensure prediction robustness. Finally, we combine all the predicted CT patches to obtain the final prediction for the given MR image. This prediction technique was validated for a clinical application using 14 patients with brain MR and CT images. The peak signal-to-noise ratio (PSNR), mean absolute error (MAE), normalized cross-correlation (NCC) indices and similarity index (SI) for air, soft-tissue and bone region were used to quantify the prediction accuracy. The mean ± std of PSNR, MAE, and NCC were: 22.4  ±  1.9  dB, 82.6  ±  26.1 HU, and 0.91  ±  0.03 for the 14 patients. The SIs for air, soft-tissue, and bone regions are 0.98  ±  0.01, 0.88  ±  0.03, and 0.69  ±  0.08. These indices demonstrate the CT prediction accuracy of the proposed learning-based method. This CT image prediction technique could be used as a tool for MRI-based radiation treatment planning, or for PET attenuation correction in a PET/MRI scanner.

[1]  Anestis Antoniadis,et al.  A sparse version of the ridge logistic regression for large-scale text categorization , 2011, Pattern Recognit. Lett..

[2]  S. Holm,et al.  Region specific optimization of continuous linear attenuation coefficients based on UTE (RESOLUTE): application to PET/MR brain imaging , 2015, Physics in medicine and biology.

[3]  Fredrik Nordström,et al.  Technical Note: MRI only prostate radiotherapy planning using the statistical decomposition algorithm. , 2015, Medical physics.

[4]  C. Kuhl,et al.  MRI-Based Attenuation Correction for Hybrid PET/MRI Systems: A 4-Class Tissue Segmentation Technique Using a Combined Ultrashort-Echo-Time/Dixon MRI Sequence , 2012, The Journal of Nuclear Medicine.

[5]  P. K. Marsden,et al.  Investigation of MR-Based Attenuation Correction and Motion Compensation for Hybrid PET/MR , 2012, IEEE Transactions on Nuclear Science.

[6]  Hamidreza Saligheh Rad,et al.  Generation of a Four-Class Attenuation Map for MRI-Based Attenuation Correction of PET Data in the Head Area Using a Novel Combination of STE/Dixon-MRI and FCM Clustering , 2015, Molecular Imaging and Biology.

[7]  Live Eikenes,et al.  PET/MR brain imaging: evaluation of clinical UTE-based attenuation correction , 2015, European Journal of Nuclear Medicine and Molecular Imaging.

[8]  C. Caldwell,et al.  Toward magnetic resonance-only simulation: segmentation of bone in MR for radiation therapy verification of the head. , 2014, International journal of radiation oncology, biology, physics.

[9]  Mika Kapanen,et al.  T1/T2*-weighted MRI provides clinically relevant pseudo-CT density data for the pelvic bones in MRI-only based radiotherapy treatment planning , 2013, Acta oncologica.

[10]  Adam Johansson,et al.  Improved quality of computed tomography substitute derived from magnetic resonance (MR) data by incorporation of spatial information – potential application for MR-only radiotherapy and attenuation correction in positron emission tomography , 2013, Acta oncologica.

[11]  Djemel Ziou,et al.  Automated feature weighting and random pixel sampling in k-means clustering for terahertz image segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Koen Van Leemput,et al.  A patch-based pseudo-CT approach for MRI-only radiotherapy in the pelvis. , 2016, Medical physics.

[13]  Carri Glide-Hurst,et al.  Implementation of a novel algorithm for generating synthetic CT images from magnetic resonance imaging data sets for prostate cancer radiation therapy. , 2015, International journal of radiation oncology, biology, physics.

[14]  S. Vandenberghe,et al.  MRI-Based Attenuation Correction for PET/MRI Using Ultrashort Echo Time Sequences , 2010, Journal of Nuclear Medicine.

[15]  Amod Jog,et al.  Improving magnetic resonance resolution with supervised learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[16]  Olivier Salvado,et al.  An atlas-based electron density mapping method for magnetic resonance imaging (MRI)-alone treatment planning and adaptive MRI-based prostate radiation therapy. , 2012, International journal of radiation oncology, biology, physics.

[17]  S. Aouadi,et al.  Sparse patch-based method applied to mri-only radiotherapy planning , 2016 .

[18]  Antonio Criminisi,et al.  Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences , 2011, MICCAI.

[19]  D Forsberg,et al.  Generating patient specific pseudo-CT of the head from MR using atlas-based regression , 2015, Physics in medicine and biology.

[20]  Stuart Crozier,et al.  Automated Classification of Bone and Air Volumes for Hybrid PET-MRI Brain Imaging , 2013, 2013 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[21]  Horace Ho-Shing Ip,et al.  Image fusion enhancement of deformable human structures using a two-stage warping-deformable strategy: A content-based image retrieval consideration , 2009, Inf. Syst. Frontiers.

[22]  T. Nyholm,et al.  A review of substitute CT generation for MRI-only radiation therapy , 2017, Radiation oncology.

[23]  Bernhard Schölkopf,et al.  MRI-Based Attenuation Correction for PET/MRI: A Novel Approach Combining Pattern Recognition and Atlas Registration , 2008, Journal of Nuclear Medicine.

[24]  Adam Johansson,et al.  CT substitute derived from MRI sequences with ultrashort echo time. , 2011, Medical physics.

[25]  J. L. Herraiz,et al.  Fast Patch-Based Pseudo-CT Synthesis from T1-Weighted MR Images for PET/MR Attenuation Correction in Brain Studies , 2016, The Journal of Nuclear Medicine.

[26]  Mohammad Reza Ay,et al.  A novel segmentation approach for implementation of MRAC in head PET/MRI employing Short-TE MRI and 2-point Dixon method in a fuzzy C-means framework , 2014 .

[27]  Hans Burkhardt,et al.  3D rotation invariant local binary patterns , 2008, 2008 19th International Conference on Pattern Recognition.

[28]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[29]  Yves Grandvalet,et al.  Sparse conditional logistic regression for analyzing large-scale matched data from epidemiological studies: a simple algorithm , 2015, BMC Bioinformatics.

[30]  Koenraad Van Leemput,et al.  Computed tomography synthesis from magnetic resonance images in the pelvis using multiple random forests and auto-context features , 2016, SPIE Medical Imaging.

[31]  H. Quick,et al.  Magnetic Resonance–Based Attenuation Correction for PET/MR Hybrid Imaging Using Continuous Valued Attenuation Maps , 2013, Investigative radiology.

[32]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[33]  J. Edmund,et al.  Patch-based generation of a pseudo CT from conventional MRI sequences for MRI-only radiotherapy of the brain. , 2015, Medical physics.

[34]  Baowei Fei,et al.  A skull segmentation method for brain MR images based on multiscale bilateral filtering scheme , 2010, Medical Imaging.

[35]  Slobodan Devic,et al.  MRI simulation for radiotherapy treatment planning. , 2012, Medical physics.

[36]  Christopher M. Rank,et al.  MRI-based treatment plan simulation and adaptation for ion radiotherapy using a classification-based approach , 2013, Radiation Oncology.

[37]  Tiina Seppälä,et al.  A dual model HU conversion from MRI intensity values within and outside of bone segment for MRI-based radiotherapy treatment planning of prostate cancer. , 2013, Medical physics.

[38]  J. A. Noble,et al.  Investigation of the Role of Feature Selection and Weighted Voting in Random Forests for 3-D Volumetric Segmentation , 2014, IEEE Transactions on Medical Imaging.

[39]  Wotao Yin,et al.  Group sparse optimization by alternating direction method , 2013, Optics & Photonics - Optical Engineering + Applications.

[40]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[41]  Adam Johansson,et al.  Accuracy of inverse treatment planning on substitute CT images derived from MR data for brain lesions , 2015, Radiation oncology.

[42]  Jinsoo Uh,et al.  MRI-based treatment planning with pseudo CT generated through atlas registration. , 2014, Medical physics.

[43]  Stefan Förster,et al.  MR-Based Attenuation Correction Using Ultrashort-Echo-Time Pulse Sequences in Dementia Patients , 2015, The Journal of Nuclear Medicine.

[44]  Baowei Fei,et al.  Research and applications: Multiscale segmentation of the skull in MR images for MRI-based attenuation correction of combined MR/PET , 2013, J. Am. Medical Informatics Assoc..

[45]  C Prieto,et al.  Improved UTE-based attenuation correction for cranial PET-MR using dynamic magnetic field monitoring. , 2013, Medical physics.

[46]  Lei Xing,et al.  A unifying probabilistic Bayesian approach to derive electron density from MRI for radiation therapy treatment planning , 2014, Physics in medicine and biology.

[47]  H. Kjer,et al.  A voxel-based investigation for MRI-only radiotherapy of the brain using ultra short echo times , 2014, Physics in medicine and biology.

[48]  Dinggang Shen,et al.  Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis , 2014, MICCAI.

[49]  Mary Feng,et al.  Investigation of a method for generating synthetic CT models from MRI scans of the head and neck for radiation therapy , 2013, Physics in medicine and biology.

[50]  Eduard Schreibmann,et al.  MR-based attenuation correction for hybrid PET-MR brain imaging systems using deformable image registration. , 2010, Medical physics.

[51]  J. Keyriläinen,et al.  Influence of MRI-based bone outline definition errors on external radiotherapy dose calculation accuracy in heterogeneous pseudo-CT images of prostate cancer patients , 2014, Acta oncologica.

[52]  Christopher M. Rank,et al.  MRI-based simulation of treatment plans for ion radiotherapy in the brain region. , 2013, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[53]  Hans Knutsson,et al.  Skull Segmentation in MRI by a Support Vector Machine Combining Local and Global Features , 2014, 2014 22nd International Conference on Pattern Recognition.

[54]  J. Jonsson,et al.  Treatment planning of intracranial targets on MRI derived substitute CT data. , 2013, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.