Pseudo CT Estimation using Patch-based Joint Dictionary Learning

Magnetic resonance (MR) simulators have recently gained popularity; it avoids the unnecessary radiation exposure associated with Computed Tomography (CT) when used for radiation therapy planning. We propose a method for pseudo CT estimation from MR images based on joint dictionary learning. Patient-specific anatomical features were extracted from the aligned training images and adopted as signatures for each voxel. The most relevant and informative features were identified to train the joint dictionary learning-based model. The well-trained dictionary was used to predict the pseudo CT of a new patient. This prediction technique was validated with a clinical study of 12 patients with MR and CT images of the brain. The mean absolute error (MAE), peak signal-to-noise ratio (PSNR), normalized cross correlation (NCC) indexes were used to quantify the prediction accuracy. We compared our proposed method with a state-of-the-art dictionary learning method. Overall our proposed method significantly improves the prediction accuracy over the state-of-the-art dictionary learning method. We have investigated a novel joint dictionary Iearning- based approach to predict CT images from routine MRIs and demonstrated its reliability. This CT prediction technique could be a useful tool for MRI-based radiation treatment planning or attenuation correction for quantifying PET images for PET/MR imaging.

[1]  Mattias P. Heinrich,et al.  Multi-Atlas Based Pseudo-CT Synthesis Using Multimodal Image Registration and Local Atlas Fusion Strategies , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Tian Liu,et al.  Improving image quality of cone-beam CT using alternating regression forest , 2018, Medical Imaging.

[3]  J. A. Noble,et al.  Investigation of the Role of Feature Selection and Weighted Voting in Random Forests for 3-D Volumetric Segmentation , 2014, IEEE Transactions on Medical Imaging.

[4]  Benyong Liu,et al.  Image Denoising and Magnification via Kernel Fitting and Modified SVD , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[5]  Yves Grandvalet,et al.  Sparse conditional logistic regression for analyzing large-scale matched data from epidemiological studies: a simple algorithm , 2015, BMC Bioinformatics.

[6]  Wotao Yin,et al.  Group sparse optimization by alternating direction method , 2013, Optics & Photonics - Optical Engineering + Applications.

[7]  Hakan Bagci,et al.  Nonlinear microwave imaging using Levenberg-Marquardt method with iterative shrinkage thresholding , 2014, 2014 USNC-URSI Radio Science Meeting (Joint with AP-S Symposium).

[8]  Nguyen Thanh Binh,et al.  Edge detection based on Fuzzy C Means in medical image processing system , 2017, 2017 International Conference on System Science and Engineering (ICSSE).

[9]  Dinggang Shen,et al.  Reconstruction of 7T-Like Images From 3T MRI , 2016, IEEE Transactions on Medical Imaging.

[10]  Delu Zeng,et al.  A novel nonlocal MRI reconstruction algorithm with patch-based low rank regularization , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[11]  Xiangtao Zheng,et al.  Joint Dictionary Learning for Multispectral Change Detection , 2017, IEEE Transactions on Cybernetics.

[12]  Shutao Li,et al.  Group-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion , 2012, IEEE Transactions on Biomedical Engineering.

[13]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[14]  J. Edmund,et al.  Patch-based generation of a pseudo CT from conventional MRI sequences for MRI-only radiotherapy of the brain. , 2015, Medical physics.

[15]  Slobodan Devic,et al.  MRI simulation for radiotherapy treatment planning. , 2012, Medical physics.

[16]  Hamid R. Tizhoosh,et al.  Medical Image Classification via SVM Using LBP Features from Saliency-Based Folded Data , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[17]  Jorge S. Marques,et al.  3D brain image-based diagnosis of Alzheimer's disease: Bringing medical vision into feature selection , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[18]  Ling Shao,et al.  Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images Using Weakly-Supervised Joint Convolutional Sparse Coding , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  I. Sechopoulos,et al.  Cupping artifact correction and automated classification for high-resolution dedicated breast CT images. , 2012, Medical physics.

[20]  Bin Song,et al.  Compressed sensing with partial support information: coherence-based performance guarantees and alternative direction method of multiplier reconstruction algorithm , 2014, IET Signal Process..

[21]  Anestis Antoniadis,et al.  A sparse version of the ridge logistic regression for large-scale text categorization , 2011, Pattern Recognit. Lett..

[22]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[23]  Adam Johansson,et al.  Improved quality of computed tomography substitute derived from magnetic resonance (MR) data by incorporation of spatial information – potential application for MR-only radiotherapy and attenuation correction in positron emission tomography , 2013, Acta oncologica.

[24]  Yang Lei,et al.  Pseudo CT estimation from MRI using patch-based random forest , 2017, Medical Imaging.

[25]  Xiaohua Zhu,et al.  MRI-Driven PET Image Optimization for Neurological Applications , 2019, Front. Neurosci..

[26]  Shu Liao,et al.  Sparse Patch-Based Label Propagation for Accurate Prostate Localization in CT Images , 2013, IEEE Transactions on Medical Imaging.

[27]  Myeongsu Kang,et al.  Fuzzy C-means clustering with spatially weighted information for medical image segmentation , 2014, 2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP).

[28]  Vipin Chaudhary,et al.  Composite features for automatic diagnosis of intervertebral disc herniation from lumbar MRI , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Cuntai Guan,et al.  Compressed sensing MRI with total variation and frame balanced regularization , 2017, 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP).

[30]  Yang Lei,et al.  ePoster SessionsA Learning-Based Approach to Derive Electron Density from Anatomical MRI for Radiation Therapy Treatment Planning , 2017 .

[31]  Alexander Hammers,et al.  Evaluation of several multi-atlas methods for PSEUDO-CT generation in brain MRI-PET attenuation correction , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[32]  Habib Zaidi,et al.  MRI-based pseudo-CT generation using sorted atlas images in whole-body PET/MRI , 2014, 2014 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC).

[33]  Ling Shao,et al.  Cross-Modality Image Synthesis via Weakly Coupled and Geometry Co-Regularized Joint Dictionary Learning , 2018, IEEE Transactions on Medical Imaging.

[34]  Aimin Hao,et al.  Multi-scale, multi-level, heterogeneous features extraction and classification of volumetric medical images , 2013, 2013 IEEE International Conference on Image Processing.

[35]  Tian Liu,et al.  MRI-based Treatment Planning for Proton Radiotherapy: Dosimetric Validation of a Deep Learning-based Liver Synthetic CT Generation Method , 2019, Physics in medicine and biology.

[36]  Ender M. Eksioglu,et al.  Decoupled Algorithm for MRI Reconstruction Using Nonlocal Block Matching Model: BM3D-MRI , 2016, Journal of Mathematical Imaging and Vision.

[37]  Hans Herzog,et al.  Skull segmentation of UTE MR images by probabilistic neural network for attenuation correction in PET/MR , 2013 .

[38]  Baowei Fei,et al.  A wavelet multiscale denoising algorithm for magnetic resonance (MR) images , 2011, Measurement science & technology.

[39]  Xiaofeng Yang,et al.  A MR Brain Classification Method Based on Multiscale and Multiblock Fuzzy C-Means , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.