mDixon-based synthetic CT generation via transfer and patch learning

Abstract We propose a practicable method for generating synthetic CT images from modified Dixon (mDixon) MR data for the challenging body section of the abdomen and extending into the pelvis. Attenuation correction is necessary to make quantitatively accurate PET but is problematic withPET/MR scanning as MR data lack the information of photon attenuation. Multiple methods were proposed to generate synthetic CT from MR images. However, due to the challenge to distinguish bone and air in MR signals, most existing methods require advanced MR sequences that entail long acquisition time and have limited availablity. To address this problem, we propose a voxel-oriented method for synthetic CT generation using both the transfer and patch learning (SCG-TPL). The overall framework of SCG-TPL includes three stages. Stage I extracts seven-dimensional texture features from mDixon MR images using the weighted convolutional sum; Stage II enlists the knowledge-leveraged transfer fuzzy c-means (KL-TFCM) clustering as well as the patch learning-oriented semi-supervised LapSVM classification to train multiple candidate four-tissue-type-identifiers (FTTIs); Stage III synthesizes CT for new patients’ mDixon images using the candidate FTTIs and voting principle. The significance of our method is threefold: (1) As the global model for patch learning, guiding by the referenced knowledge, KL-TFCM can credibly initialize MR data with overcoming the individual diversity. As the local complement, LapSVM can adaptively model each patch with low time and labor costs. (2) Jointly using the transfer KL-TFCM clustering and patch learning-oriented LapSVM classification, SCG-TPL is able to output accurate synthetic CT in the abdomen. (3) SCG-TPL synthesizes CT only using easily-obtainable mDixon MR images, which greatly facilitates its clinical practicability. Experimental studies on ten subjects’ mDixon MR data verified the superiority of our proposed method.

[1]  Melanie Traughber,et al.  Generation of brain pseudo-CTs using an undersampled, single-acquisition UTE-mDixon pulse sequence and unsupervised clustering. , 2015, Medical physics.

[2]  B. Schölkopf,et al.  Towards quantitative PET/MRI: a review of MR-based attenuation correction techniques , 2009, European Journal of Nuclear Medicine and Molecular Imaging.

[3]  B. Fallone,et al.  First MR images obtained during megavoltage photon irradiation from a prototype integrated linac-MR system. , 2009, Medical physics.

[4]  A. McMillan,et al.  Deep learning Mr imaging–based attenuation correction for PeT/Mr imaging 1 , 2017 .

[5]  A. Buck,et al.  Clinical Evaluation of Zero-Echo-Time Attenuation Correction for Brain 18F-FDG PET/MRI: Comparison with Atlas Attenuation Correction , 2016, The Journal of Nuclear Medicine.

[6]  Yudong Zhang,et al.  MJaya-ELM: A Jaya algorithm with mutation and extreme learning machine based approach for sensorineural hearing loss detection , 2019, Appl. Soft Comput..

[7]  Christopher J Watchman,et al.  Chord-based versus voxel-based methods of electron transport in the skeletal tissues. , 2005, Medical physics.

[8]  Yizhang Jiang,et al.  Semi-Automatic Synthetic Computed Tomography Generation for Abdomens Using Transfer Learning and Semi-Supervised Classification , 2019 .

[9]  Anna Barnes,et al.  A comparison of CT- and MR-based attenuation correction in neurological PET , 2014, European Journal of Nuclear Medicine and Molecular Imaging.

[10]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, ICPR 2004.

[11]  Marco De Spirito,et al.  On the accuracy of bulk synthetic CT for MR-guided online adaptive radiotherapy , 2019, La radiologia medica.

[12]  Bin Liu,et al.  Unilateral sensorineural hearing loss identification based on double-density dual-tree complex wavelet transform and multinomial logistic regression , 2019, Integr. Comput. Aided Eng..

[13]  Partha Niyogi,et al.  Manifold regularization and semi-supervised learning: some theoretical analyses , 2013, J. Mach. Learn. Res..

[14]  Jeffrey A Fessler,et al.  A female pelvic bone shape model for air/bone separation in support of synthetic CT generation for radiation therapy , 2016, Physics in medicine and biology.

[15]  Mary Feng,et al.  Investigation of a method for generating synthetic CT models from MRI scans of the head and neck for radiation therapy , 2013, Physics in medicine and biology.

[16]  Nassir Navab,et al.  Tissue Classification as a Potential Approach for Attenuation Correction in Whole-Body PET/MRI: Evaluation with PET/CT Data , 2009, Journal of Nuclear Medicine.

[17]  Jun Yu,et al.  Voxel-wise uncertainty in CT substitute derived from MRI. , 2012, Medical physics.

[18]  J. Edmund,et al.  Patch-based generation of a pseudo CT from conventional MRI sequences for MRI-only radiotherapy of the brain. , 2015, Medical physics.

[19]  Tang Yongchuan,et al.  Improved evidential fuzzy c-means method , 2018 .

[20]  Junding Sun,et al.  High Performance Multiple Sclerosis Classification by Data Augmentation and AlexNet Transfer Learning Model , 2019, J. Medical Imaging Health Informatics.

[21]  Andrew P. Leynes,et al.  Zero-Echo-Time and Dixon Deep Pseudo-CT (ZeDD CT): Direct Generation of Pseudo-CT Images for Pelvic PET/MRI Attenuation Correction Using Deep Convolutional Neural Networks with Multiparametric MRI , 2017, The Journal of Nuclear Medicine.

[22]  T. Bortfeld,et al.  Correlation between CT numbers and tissue parameters needed for Monte Carlo simulations of clinical dose distributions. , 2000, Physics in medicine and biology.

[23]  G. Delso,et al.  Clinical Evaluation of Zero-Echo-Time MR Imaging for the Segmentation of the Skull , 2015, The Journal of Nuclear Medicine.

[24]  Koen Van Leemput,et al.  A patch-based pseudo-CT approach for MRI-only radiotherapy in the pelvis. , 2016, Medical physics.

[25]  Bernhard Schölkopf,et al.  MRI-Based Attenuation Correction for PET/MRI: A Novel Approach Combining Pattern Recognition and Atlas Registration , 2008, Journal of Nuclear Medicine.

[26]  Steven M. LaValle,et al.  On the Relationship between Classical Grid Search and Probabilistic Roadmaps , 2004, Int. J. Robotics Res..

[27]  Laurent Jacques,et al.  Diffeomorphic Registration of Images with Variable Contrast Enhancement , 2010, Int. J. Biomed. Imaging.

[28]  Gudrun Wagenknecht,et al.  MRI for attenuation correction in PET: methods and challenges , 2012, Magnetic Resonance Materials in Physics, Biology and Medicine.

[29]  Shuyuan Yang,et al.  Sparse Spatio-Spectral LapSVM With Semisupervised Kernel Propagation for Hyperspectral Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  D A Jaffray,et al.  Characterization of tissue magnetic susceptibility-induced distortions for MRIgRT. , 2012, Medical physics.

[31]  Raymond F. Muzic,et al.  Knowledge-leveraged transfer fuzzy C-Means for texture image segmentation with self-adaptive cluster prototype matching , 2017, Knowl. Based Syst..

[32]  Jie Liu,et al.  Detecting cerebral microbleeds with transfer learning , 2019, Machine Vision and Applications.

[33]  C. Kuhl,et al.  MRI-Based Attenuation Correction for Hybrid PET/MRI Systems: A 4-Class Tissue Segmentation Technique Using a Combined Ultrashort-Echo-Time/Dixon MRI Sequence , 2012, The Journal of Nuclear Medicine.

[34]  T. Nyholm,et al.  A review of substitute CT generation for MRI-only radiation therapy , 2017, Radiation oncology.

[35]  Pengjiang Qian,et al.  Cross-domain, soft-partition clustering with diversity measure and knowledge reference , 2016, Pattern Recognit..

[36]  Koenraad Van Leemput,et al.  Computed tomography synthesis from magnetic resonance images in the pelvis using multiple random forests and auto-context features , 2016, SPIE Medical Imaging.

[37]  Jerry M. Mendel,et al.  Patch Learning , 2020, IEEE Transactions on Fuzzy Systems.

[38]  A. Cuocolo,et al.  FGD‐PET in the follow‐up of recurrent colorectal cancer , 2003, Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland.

[39]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[40]  Ling Shao,et al.  Cross-Modality Image Synthesis via Weakly Coupled and Geometry Co-Regularized Joint Dictionary Learning , 2018, IEEE Transactions on Medical Imaging.

[41]  Pengjiang Qian,et al.  Multi-View Maximum Entropy Clustering by Jointly Leveraging Inter-View Collaborations and Intra-View-Weighted Attributes , 2018, IEEE Access.

[42]  H. Eggers,et al.  Dual‐echo Dixon imaging with flexible choice of echo times , 2011, Magnetic resonance in medicine.

[43]  Christoph Palm,et al.  MR-based attenuation correction for torso-PET/MR imaging: pitfalls in mapping MR to CT data , 2008, European Journal of Nuclear Medicine and Molecular Imaging.

[44]  Habib Zaidi,et al.  Current Trends in PET and Combined (PET/CT and PET/MR) Systems Design. , 2007, PET clinics.

[45]  Hans Herzog,et al.  Template based attenuation correction for PET in MR-PET scanners , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[46]  J. Deasy,et al.  Dosimetric evaluation of an atlas‐based synthetic CT generation approach for MR‐only radiotherapy of pelvis anatomy , 2018, Journal of applied clinical medical physics.

[47]  Habib Zaidi,et al.  Point/counterpoint. Simultaneous PET/MR will replace PET/CT as the molecular multimodality imaging platform of choice. , 2007, Medical physics.

[48]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[49]  Pengjiang Qian,et al.  Cluster Prototypes and Fuzzy Memberships Jointly Leveraged Cross-Domain Maximum Entropy Clustering , 2016, IEEE Transactions on Cybernetics.

[50]  Atallah Baydoun,et al.  mDixon-Based Synthetic CT Generation for PET Attenuation Correction on Abdomen and Pelvis Jointly Using Transfer Fuzzy Clustering and Active Learning-Based Classification , 2020, IEEE Transactions on Medical Imaging.

[51]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.