Deep learning-based synthetic-CT generation in radiotherapy and PET: a review

Recently, deep learning (DL)-based methods for the generation of synthetic computed tomography (sCT) have received significant research attention as an alternative to classical ones. We present here a systematic review of these methods by grouping them into three categories, according to their clinical applications: I) to replace CT in magnetic resonance (MR)-based treatment planning, II) facilitate cone-beam computed tomography (CBCT)-based image-guided adaptive radiotherapy, and III) derive attenuation maps for the correction of positron emission tomography (PET). Appropriate database searching was performed on journal articles published between January 2014 and December 2020. The DL methods' key characteristics were extracted from each eligible study, and a comprehensive comparison among network architectures and metrics was reported. A detailed review of each category was given, highlighting essential contributions, identifying specific challenges, and summarising the achievements. Lastly, the statistics of all the cited works from various aspects were analysed, revealing the popularity and future trends and the potential of DL-based sCT generation. The current status of DL-based sCT generation was evaluated, assessing the clinical readiness of the presented methods.

[1]  Tufve Nyholm,et al.  Systematisation of spatial uncertainties for comparison between a MR and a CT-based radiotherapy workflow for prostate treatments , 2009, Radiation oncology.

[2]  Stuart Crozier,et al.  The Australian magnetic resonance imaging-linac program. , 2014, Seminars in radiation oncology.

[3]  Aaron Carass,et al.  Unsupervised MR-to-CT Synthesis Using Structure-Constrained CycleGAN , 2020, IEEE Transactions on Medical Imaging.

[4]  James Denham,et al.  A Multi-center Prospective Study for Implementation of an MRI-Only Prostate Treatment Planning Workflow , 2019, Front. Oncol..

[5]  Gregory C Sharp,et al.  Proton dose calculation on scatter-corrected CBCT image: Feasibility study for adaptive proton therapy. , 2014, Medical physics.

[6]  Tommy Löfstedt,et al.  Latent Space Manipulation for High-Resolution Medical Image Synthesis via the StyleGAN. , 2020, Zeitschrift fur medizinische Physik.

[7]  Osamu Suzuki,et al.  Feasibility of synthetic computed tomography generated with an adversarial network for multi-sequence magnetic resonance-based brain radiotherapy , 2019, Journal of radiation research.

[8]  Minsong Cao,et al.  Generation of abdominal synthetic CTs from 0.35T MR images using generative adversarial networks for MR-only liver radiotherapy , 2019, Biomedical physics & engineering express.

[9]  Xuenan Cui,et al.  Deep CT to MR Synthesis Using Paired and Unpaired Data , 2018, Sensors.

[10]  M. Gaze,et al.  How rapid advances in imaging are defining the future of precision radiation oncology , 2019, British Journal of Cancer.

[11]  Konstantinos Kamnitsas,et al.  DeepMedic for Brain Tumor Segmentation , 2016, BrainLes@MICCAI.

[12]  W. V. Elmpt,et al.  Overview of artificial intelligence-based applications in radiotherapy: recommendations for implementation and quality assurance. , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[13]  W. Curran,et al.  Paired cycle-GAN-based image correction for quantitative cone-beam computed tomography , 2020 .

[14]  Young Lee,et al.  Deep Generative Model for Synthetic-CT Generation with Uncertainty Predictions , 2020, MICCAI.

[15]  Cai Grau,et al.  Evaluation of image quality for different kV cone-beam CT acquisition and reconstruction methods in the head and neck region , 2011, Acta oncologica.

[16]  Ian S. Boon,et al.  Assessing the Role of Artificial Intelligence (AI) in Clinical Oncology: Utility of Machine Learning in Radiotherapy Target Volume Delineation , 2018, Medicines.

[17]  Gregory C Sharp,et al.  Numerical solutions of the γ-index in two and three dimensions , 2012, Physics in medicine and biology.

[18]  Guoyan Zheng,et al.  Novel adversarial semantic structure deep learning for MRI-guided attenuation correction in brain PET/MRI , 2019, European Journal of Nuclear Medicine and Molecular Imaging.

[19]  Harini Veeraraghavan,et al.  Patch-Based Generative Adversarial Neural Network Models for Head and Neck MR-Only Planning. , 2019, Medical physics.

[20]  Josien P. W. Pluim,et al.  Not‐so‐supervised: A survey of semi‐supervised, multi‐instance, and transfer learning in medical image analysis , 2018, Medical Image Anal..

[21]  Jan-Jakob Sonke,et al.  Recurrent inference machines for reconstructing heterogeneous MRI data , 2019, Medical Image Anal..

[22]  H. Zaidi,et al.  Vision 20/20: Magnetic resonance imaging-guided attenuation correction in PET/MRI: Challenges, solutions, and opportunities. , 2016, Medical physics.

[23]  Rob H.N. Tijssen,et al.  Feasibility of magnetic resonance imaging-only rectum radiotherapy with a commercial synthetic computed tomography generation solution , 2018, Physics and imaging in radiation oncology.

[24]  Li Liu,et al.  A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges , 2020, Inf. Fusion.

[25]  Quanzheng Li,et al.  MR-Based Attenuation Correction for Brain PET Using 3-D Cycle-Consistent Adversarial Network , 2021, IEEE Transactions on Radiation and Plasma Medical Sciences.

[26]  Ting Song,et al.  Multi-sequence MR image-based synthetic CT generation using a generative adversarial network for head and neck MRI-only radiotherapy. , 2020, Medical physics.

[27]  Qian Wang,et al.  Deep embedding convolutional neural network for synthesizing CT image from T1‐Weighted MR image , 2018, Medical Image Anal..

[28]  Jun Xia,et al.  Comparison of Supervised and Unsupervised Deep Learning Methods for Medical Image Synthesis between Computed Tomography and Magnetic Resonance Images , 2020, BioMed research international.

[29]  D. Jaffray Image-guided radiotherapy: from current concept to future perspectives , 2012, Nature Reviews Clinical Oncology.

[30]  Xin Tie,et al.  Pseudo-CT generation from multi-parametric MRI using a novel multi-channel multi-path conditional generative adversarial network for nasopharyngeal carcinoma patients. , 2020, Medical physics.

[31]  Marc Modat,et al.  Cone-Beam Computed Tomography and Deformable Registration-Based “Dose of the Day” Calculations for Adaptive Proton Therapy , 2015 .

[32]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[33]  Jelmer M. Wolterink,et al.  MR-Only Brain Radiation Therapy: Dosimetric Evaluation of Synthetic CTs Generated by a Dilated Convolutional Neural Network. , 2018, International journal of radiation oncology, biology, physics.

[34]  Bo Chen,et al.  CNN-Based Quality Assurance for Automatic Segmentation of Breast Cancer in Radiotherapy , 2020, Frontiers in Oncology.

[35]  Timothy D. Solberg,et al.  Attention-Aware Discrimination for MR-to-CT Image Translation Using Cycle-Consistent Generative Adversarial Networks. , 2020, Radiology. Artificial intelligence.

[36]  Lei Zhu,et al.  Noise suppression in scatter correction for cone-beam CT. , 2009, Medical physics.

[37]  Ben Glocker,et al.  Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images , 2018, Medical Image Anal..

[38]  David Izquierdo-Garcia,et al.  Comparison of MR-based attenuation correction and CT-based attenuation correction of whole-body PET/MR imaging , 2014, European Journal of Nuclear Medicine and Molecular Imaging.

[39]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[40]  S. Kida,et al.  Visual enhancement of Cone-beam CT by use of CycleGAN. , 2019, Medical physics.

[41]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  D. Buckley,et al.  A Systematic Review of the Clinical Implementation of Pelvic Magnetic Resonance Imaging-Only Planning for External Beam Radiation Therapy , 2022 .

[43]  T. Bortfeld,et al.  MR-guided proton therapy: a review and a preview , 2020, Radiation oncology.

[44]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[45]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[46]  Carri K Glide-Hurst,et al.  MRI-only treatment planning: benefits and challenges , 2018, Physics in medicine and biology.

[47]  Christine DeLorenzo,et al.  Synthesis of Patient-Specific Transmission Data for PET Attenuation Correction for PET/MRI Neuroimaging Using a Convolutional Neural Network , 2018, The Journal of Nuclear Medicine.

[48]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[49]  M. Viergever,et al.  Deep learning–based MR‐to‐CT synthesis: The influence of varying gradient echo–based MR images as input channels , 2019, Magnetic resonance in medicine.

[50]  Slobodan Devic,et al.  MRI simulation for radiotherapy treatment planning. , 2012, Medical physics.

[51]  Christopher Kurz,et al.  Feasibility of automated proton therapy plan adaptation for head and neck tumors using cone beam CT images , 2016, Radiation oncology.

[52]  M. Philippens,et al.  Deep learning-based synthetic CT generation for paediatric brain MR-only photon and proton radiotherapy. , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[53]  Jordan Clark,et al.  Challenges in the clinical implementation of precision medicine companion diagnostics , 2020, Expert review of molecular diagnostics.

[54]  Jan Kautz,et al.  Loss Functions for Neural Networks for Image Processing , 2015, ArXiv.

[55]  Matteo Maspero,et al.  A single neural network for cone-beam computed tomography-based radiotherapy of head-and-neck, lung and breast cancer , 2020, Physics and imaging in radiation oncology.

[56]  Maria Francesca Spadea,et al.  Imaging in particle therapy: State of the art and future perspective , 2015, Acta oncologica.

[57]  R Mohan,et al.  Dose-volume histograms. , 1991, International journal of radiation oncology, biology, physics.

[58]  Nicole Nesvacil,et al.  Investigating conditional GAN performance with different generator architectures, an ensemble model, and different MR scanners for MR-sCT conversion , 2020, Physics in medicine and biology.

[59]  F. Verhaegen,et al.  Revisiting the single-energy CT calibration for proton therapy treatment planning: a critical look at the stoichiometric method , 2018, Physics in medicine and biology.

[60]  P M Evans,et al.  Assessing the effect of electron density in photon dose calculations. , 2006, Medical physics.

[61]  Sasa Mutic,et al.  The ViewRay system: magnetic resonance-guided and controlled radiotherapy. , 2014, Seminars in radiation oncology.

[62]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[63]  Dirk Verellen,et al.  Innovations in image-guided radiotherapy , 2008, Nature Reviews Cancer.

[64]  Yoshihiro Takai,et al.  Feasibility of CBCT-based proton dose calculation using a histogram-matching algorithm in proton beam therapy. , 2017, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[65]  Jonathan J Wyatt,et al.  Systematic Review of Synthetic Computed Tomography Generation Methodologies for Use in Magnetic Resonance Imaging-Only Radiation Therapy. , 2018, International journal of radiation oncology, biology, physics.

[66]  Christopher Kurz,et al.  ScatterNet: A convolutional neural network for cone‐beam CT intensity correction , 2018, Medical physics.

[67]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[68]  Steve B. Jiang,et al.  Synthetic CT Generation from CBCT images via Deep Learning. , 2019, Medical physics.

[69]  W. Vandertop,et al.  Magnetic resonance imaging-based synthetic computed tomography of the lumbar spine for surgical planning: a clinical proof-of-concept. , 2021, Neurosurgical focus.

[70]  Chenbin Liu,et al.  Synthetic CT Generation Based on T2 Weighted MRI of Nasopharyngeal Carcinoma (NPC) Using a Deep Convolutional Neural Network (DCNN) , 2019, Front. Oncol..

[71]  J. Jonsson,et al.  Counterpoint: Opportunities and challenges of a magnetic resonance imaging-only radiotherapy work flow. , 2014, Seminars in radiation oncology.

[72]  R. Steenbakkers,et al.  Comparison of the suitability of CBCT- and MR-based synthetic CTs for daily adaptive proton therapy in head and neck patients , 2020, Physics in medicine and biology.

[73]  J. McClelland,et al.  MRI-guidance for motion management in external beam radiotherapy: current status and future challenges , 2018, Physics in medicine and biology.

[74]  Karen A. Vineberg,et al.  Generation of Synthetic CT Images From MRI for Treatment Planning and Patient Positioning Using a 3-Channel U-Net Trained on Sagittal Images , 2019, Front. Oncol..

[75]  M Hussein,et al.  Challenges in calculation of the gamma index in radiotherapy - Towards good practice. , 2017, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[76]  S. Jolly,et al.  Assessment of dosimetric impact of system specific geometric distortion in an MRI only based radiotherapy workflow for prostate , 2017, Physics in medicine and biology.

[77]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[78]  Florian Wiesinger,et al.  Attenuation correction using 3D deep convolutional neural network for brain 18F-FDG PET/MR: Comparison with Atlas, ZTE and CT based attenuation correction , 2019, PloS one.

[79]  D. Buckley,et al.  Multicentre, deep learning, synthetic-CT generation for ano-rectal MR-only radiotherapy treatment planning , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[80]  Luca Boldrini,et al.  Deep Learning: A Review for the Radiation Oncologist , 2019, Front. Oncol..

[81]  Peter Metcalfe,et al.  MRI geometric distortion: Impact on tangential whole‐breast IMRT , 2016, Journal of applied clinical medical physics.

[82]  J. Balter,et al.  Abdominal synthetic CT generation from MR Dixon images using a U-net trained with ‘semi-synthetic’ CT data , 2020, Physics in medicine and biology.

[83]  Yang Lei,et al.  Synthetic CT generation from non-attenuation corrected PET images for whole-body PET imaging , 2019, Physics in medicine and biology.

[84]  J. Jaremko,et al.  MRI-based Synthetic CT in the Detection of Structural Lesions in Patients with Suspected Sacroiliitis: Comparison with MRI. , 2020, Radiology.

[85]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[86]  Ciprian Catana,et al.  Proton range shift analysis on brain pseudo-CT generated from T1 and T2 MR , 2018, Acta oncologica.

[87]  Yang Lei,et al.  MRI-only based synthetic CT generation using dense cycle consistent generative adversarial networks. , 2019, Medical physics.

[88]  Haley Massa,et al.  Comparison of deep learning synthesis of synthetic CTs using clinical MRI inputs , 2020, Physics in medicine and biology.

[89]  Kun Xu,et al.  A survey of image synthesis and editing with generative adversarial networks , 2017 .

[90]  A Runz,et al.  The ADAM-pelvis phantom—an anthropomorphic, deformable and multimodal phantom for MRgRT , 2019, Physics in medicine and biology.

[91]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[92]  Quan Chen,et al.  Convolutional neural network enhancement of fast-scan low-dose cone-beam CT images for head and neck radiotherapy , 2019, Physics in medicine and biology.

[93]  Keith A. Johnson,et al.  Attenuation Correction Using Deep Learning and Integrated UTE/Multi-Echo Dixon Sequence: Evaluation in Amyloid and Tau PET Imaging , 2020, European Journal of Nuclear Medicine and Molecular Imaging.

[94]  Steve B. Jiang,et al.  MRI-only brain radiotherapy: Assessing the dosimetric accuracy of synthetic CT images generated using a deep learning approach. , 2019, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[95]  Habib Zaidi,et al.  A new deep convolutional neural network design with efficient learning capability: Application to CT image synthesis from MRI. , 2020, Medical physics.

[96]  M. Jorge Cardoso,et al.  Uncertainty in multitask learning: joint representations for probabilistic MR-only radiotherapy planning , 2018, MICCAI.

[97]  Zhaolin Chen,et al.  Augmented deep learning model for improved quantitative accuracy of MR-based PET attenuation correction in PSMA PET-MRI prostate imaging , 2020, European Journal of Nuclear Medicine and Molecular Imaging.

[98]  Jae Sung Lee A Review of Deep-Learning-Based Approaches for Attenuation Correction in Positron Emission Tomography , 2021, IEEE Transactions on Radiation and Plasma Medical Sciences.

[99]  Bjoern H Menze,et al.  Common Limitations of Image Processing Metrics: A Picture Story , 2021, ArXiv.

[100]  Yang Lei,et al.  MRI-Based Proton Treatment Planning for Base of Skull Tumors. , 2019, International journal of particle therapy.

[101]  Yang Lei,et al.  A review on medical imaging synthesis using deep learning and its clinical applications , 2020, Journal of applied clinical medical physics.

[102]  T. Nyholm,et al.  A review of substitute CT generation for MRI-only radiation therapy , 2017, Radiation oncology.

[103]  Quanzheng Li,et al.  Attenuation correction for brain PET imaging using deep neural network based on Dixon and ZTE MR images , 2017, Physics in medicine and biology.

[104]  Marc Kachelrieß,et al.  Synthetic 4D-CT of the thorax for treatment plan adaptation on MR-guided radiotherapy systems , 2019, Physics in medicine and biology.

[105]  Daisuke Kawahara,et al.  Image synthesis with deep convolutional generative adversarial networks for material decomposition in dual-energy CT from a kilovoltage CT , 2020, Comput. Biol. Medicine.

[106]  V. Valentini,et al.  A deep learning approach to generate synthetic CT in low tesla MR-guided adaptive radiotherapy for abdominal and pelvic cases. , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[107]  W. Curran,et al.  Evaluation of a deep learning-based pelvic synthetic CT generation technique for MRI-based prostate proton treatment planning , 2019, Physics in medicine and biology.

[108]  A. Aisen,et al.  Integration of magnetic resonance imaging into radiation therapy treatment planning: I. Technical considerations. , 1987, International journal of radiation oncology, biology, physics.

[109]  G. Delso,et al.  Effect of Attenuation Correction on Regional Quantification Between PET/MR and PET/CT: A Multicenter Study Using a 3-Dimensional Brain Phantom , 2016, The Journal of Nuclear Medicine.

[110]  B. van Asselen,et al.  Synthetic CT for single-fraction neoadjuvant partial breast irradiation on an MRI-linac , 2021, Physics in medicine and biology.

[111]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[112]  Ke Li,et al.  Learning to Reconstruct Computed Tomography Images Directly From Sinogram Data Under A Variety of Data Acquisition Conditions , 2019, IEEE Transactions on Medical Imaging.

[113]  Daniel A Low,et al.  Gamma Dose Distribution Evaluation Tool , 2010 .

[114]  K. Parodi,et al.  Developments in deep learning based corrections of cone beam computed tomography to enable dose calculations for adaptive radiotherapy , 2020, Physics and imaging in radiation oncology.

[115]  Xiaofeng Zhu,et al.  Artificial Intelligence in Radiotherapy Treatment Planning: Present and Future , 2019, Technology in cancer research & treatment.

[116]  Zhiwei Huang,et al.  BPGAN: Bidirectional CT-to-MRI prediction using multi-generative multi-adversarial nets with spectral normalization and localization , 2020, Neural Networks.

[117]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[118]  Abdelouahab Moussaoui,et al.  A review on methods to estimate a CT from MRI data in the context of MRI-alone RT , 2018 .

[119]  Weilin Fu,et al.  Learning with known operators reduces maximum error bounds , 2019, Nat. Mach. Intell..

[120]  Clifton D. Fuller,et al.  Artificial intelligence in radiation oncology treatment planning: a brief overview , 2019, Journal of Medical Artificial Intelligence.

[121]  O. Acosta,et al.  Comparison of CBCT-based dose calculation methods in head and neck cancer radiotherapy: from Hounsfield unit to density calibration curve to deep learning. , 2020, Medical physics.

[122]  Pengjiang Qian,et al.  Dixon-based thorax synthetic CT generation using Generative Adversarial Network , 2020 .

[123]  Alex Lallement,et al.  Survey on deep learning for radiotherapy , 2018, Comput. Biol. Medicine.

[124]  Ciprian Catana,et al.  Deep Convolution Neural Network (DCNN) multi-plane approach to synthetic CT generation from MR images - application in brain proton therapy. , 2019, International journal of radiation oncology, biology, physics.

[125]  K. Nikolaou,et al.  Independent attenuation correction of whole body [18F]FDG-PET using a deep learning approach with Generative Adversarial Networks , 2020, EJNMMI Research.

[126]  John Klein,et al.  MR to CT synthesis with multicenter data in the pelvic area using a conditional generative adversarial network , 2020, Physics in medicine and biology.

[127]  Maria A Schmidt,et al.  Radiotherapy planning using MRI , 2015, Physics in medicine and biology.

[128]  Xiangyang Tang,et al.  CBCT-based Synthetic CT Generation using Deep-attention CycleGAN for Pancreatic Adaptive Radiotherapy. , 2020, Medical physics.

[129]  Jan J W Lagendijk,et al.  MR guidance in radiotherapy , 2014, Physics in medicine and biology.

[130]  O. Acosta,et al.  Head-and-Neck MRI-only radiotherapy treatment planning: From acquisition in treatment position to pseudo-CT generation. , 2020, Cancer radiotherapie : journal de la Societe francaise de radiotherapie oncologique.

[131]  Frank Zijlstra,et al.  The impact of MRI-CT registration errors on deep learning-based synthetic CT generation , 2019, Medical Imaging: Image Processing.

[132]  Steve Webb,et al.  Radiotherapy treatment planning of prostate cancer using magnetic resonance imaging alone. , 2003, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[133]  Fang Liu,et al.  Technical Note: Deep learning based MRAC using rapid ultrashort echo time imaging , 2018, Medical physics.

[134]  Joseph O. Deasy,et al.  Cross-modality (CT-MRI) prior augmented deep learning for robust lung tumor segmentation from small MR datasets , 2019, Medical physics.

[135]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[136]  D. Low,et al.  Technical Challenges of Real-Time Adaptive MR-Guided Radiotherapy , 2021, Frontiers in Oncology.

[137]  Karin Haustermans,et al.  The value of magnetic resonance imaging for radiotherapy planning. , 2014, Seminars in radiation oncology.

[138]  T. R. Goodman,et al.  Pediatric CT radiation exposure: where we were, and where we are now , 2019, Pediatric Radiology.

[139]  Aaron Carass,et al.  Evaluating the Impact of Intensity Normalization on MR Image Synthesis , 2018, Medical Imaging: Image Processing.

[140]  B. Zackrisson,et al.  Dedicated magnetic resonance imaging in the radiotherapy clinic. , 2009, International journal of radiation oncology, biology, physics.

[141]  Lei Zhu,et al.  Scatter correction for cone-beam CT in radiation therapy. , 2009 .

[142]  Christopher Kurz,et al.  Comparing Unet training with three different datasets to correct CBCT images for prostate radiotherapy dose calculations , 2019, Physics in medicine and biology.

[143]  A. Soricelli,et al.  Dixon-VIBE Deep Learning (DIVIDE) Pseudo-CT Synthesis for Pelvis PET/MR Attenuation Correction , 2018, The Journal of Nuclear Medicine.

[144]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[145]  Paul Babyn,et al.  Generative Adversarial Network in Medical Imaging: A Review , 2018, Medical Image Anal..

[146]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[147]  N. Reynaert,et al.  [Radiotherapy treatment planning of prostate cancer using magnetic resonance imaging]. , 2019, Cancer radiotherapie : journal de la Societe francaise de radiotherapie oncologique.

[148]  Xiaowei Liu,et al.  A preliminary study of using a deep convolution neural network to generate synthesized CT images based on CBCT for adaptive radiotherapy of nasopharyngeal carcinoma , 2019, Physics in medicine and biology.

[149]  H. Paganetti Range uncertainties in proton therapy and the role of Monte Carlo simulations , 2012, Physics in medicine and biology.

[150]  Jung In Kim,et al.  Preliminary Application of Synthetic Computed Tomography Image Generation from Magnetic Resonance Image Using Deep-Learning in Breast Cancer Patients , 2019 .

[151]  Peter R Seevinck,et al.  Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy , 2018, Physics in medicine and biology.

[152]  Bo Liu,et al.  Improving CBCT Quality to CT Level using Deep-Learning with Generative Adversarial Network. , 2020, Medical physics.

[153]  Steve B. Jiang,et al.  Synthesizing CT images from MR images with deep learning: model generalization for different datasets through transfer learning , 2021, Biomedical physics & engineering express.

[154]  L G W Kerkmeijer,et al.  Magnetic Resonance Imaging only Workflow for Radiotherapy Simulation and Planning in Prostate Cancer. , 2018, Clinical oncology (Royal College of Radiologists (Great Britain)).

[155]  Cristina Garibaldi,et al.  Patterns of practice for adaptive and real-time radiation therapy (POP-ART RT) part II: Offline and online plan adaption for interfractional changes , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[156]  Kaijian Xia,et al.  Multichannel Residual Conditional GAN-Leveraged Abdominal Pseudo-CT Generation via Dixon MR Images , 2019, IEEE Access.

[157]  J. Boda-Heggemann,et al.  Evaluation of a cycle-generative adversarial network-based cone-beam CT to synthetic CT conversion algorithm for adaptive radiation therapy. , 2020, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[158]  B. Fallone,et al.  The rotating biplanar linac-magnetic resonance imaging system. , 2014, Seminars in radiation oncology.

[159]  Fang Liu,et al.  MR‐based treatment planning in radiation therapy using a deep learning approach , 2019, Journal of applied clinical medical physics.

[160]  Christopher Kurz,et al.  CBCT correction using a cycle-consistent generative adversarial network and unpaired training to enable photon and proton dose calculation , 2019, Physics in medicine and biology.

[161]  Tufve Nyholm,et al.  Treatment planning using MRI data: an analysis of the dose calculation accuracy for different treatment regions , 2010, Radiation oncology.

[162]  Fredrik Nordström,et al.  MR-OPERA: A Multicenter/Multivendor Validation of Magnetic Resonance Imaging-Only Prostate Treatment Planning Using Synthetic Computed Tomography Images. , 2017, International journal of radiation oncology, biology, physics.

[163]  Steve B. Jiang,et al.  Dosimetric evaluation of synthetic CT generated with GANs for MRI‐only proton therapy treatment planning of brain tumors , 2020, Journal of applied clinical medical physics.

[164]  Atallah Baydoun,et al.  Estimating CT from MR Abdominal Images Using Novel Generative Adversarial Networks , 2020, Journal of Grid Computing.

[165]  Tiina Seppälä,et al.  Commissioning of MRI‐only based treatment planning procedure for external beam radiotherapy of prostate , 2013, Magnetic resonance in medicine.

[166]  Maysam Abbod,et al.  MR Image-Based Attenuation Correction of Brain PET Imaging: Review of Literature on Machine Learning Approaches for Segmentation , 2020, Journal of Digital Imaging.

[167]  Lei Wang,et al.  Medical Image Synthesis via Deep Learning. , 2020, Advances in experimental medicine and biology.

[168]  Ming Dong,et al.  Generating synthetic CTs from magnetic resonance images using generative adversarial networks , 2018, Medical physics.

[169]  A. Rahmim,et al.  Deep-JASC: joint attenuation and scatter correction in whole-body 18F-FDG PET using a deep residual network , 2020, European Journal of Nuclear Medicine and Molecular Imaging.

[170]  Tian Liu,et al.  MRI-based Treatment Planning for Proton Radiotherapy: Dosimetric Validation of a Deep Learning-based Liver Synthetic CT Generation Method , 2019, Physics in medicine and biology.

[171]  Renaud de Crevoisier,et al.  Comparison of deep learning-based and patch-based methods for pseudo-CT generation in MRI-based prostate dose planning. , 2019, International journal of radiation oncology, biology, physics.

[172]  B Stemkens,et al.  Nuts and bolts of 4D-MRI for radiotherapy , 2018, Physics in medicine and biology.

[173]  Uwe Oelfke,et al.  Cross-modality deep learning: Contouring of MRI data from annotated CT data only. , 2020, Medical physics.

[174]  Shupeng Chen,et al.  Magnetic resonance-based synthetic computed tomography images generated using generative adversarial networks for nasopharyngeal carcinoma radiotherapy treatment planning. , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[175]  M. Ljungberg,et al.  Synthetic computed tomography data allows for accurate absorbed dose calculations in a magnetic resonance imaging only workflow for head and neck radiotherapy , 2021, Physics and imaging in radiation oncology.

[176]  Steffen Greilich,et al.  An anthropomorphic multimodality (CT/MRI) head phantom prototype for end-to-end tests in ion radiotherapy. , 2015, Zeitschrift fur medizinische Physik.

[177]  Maria Francesca Spadea,et al.  Automatic segmentation and online virtualCT in head-and-neck adaptive radiation therapy. , 2012, International journal of radiation oncology, biology, physics.

[178]  B. Raaymakers,et al.  Deep learning-enabled MRI-only photon and proton therapy treatment planning for paediatric abdominal tumours. , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[179]  A. Lomax,et al.  Anthropomorphic phantom for deformable lung and liver CT and MR imaging for radiotherapy. , 2020, Physics in medicine and biology.

[180]  Cynthia H McCollough,et al.  Quality assurance for computed-tomography simulators and the computed-tomography-simulation process: report of the AAPM Radiation Therapy Committee Task Group No. 66. , 2003, Medical physics.

[181]  David A Jaffray,et al.  The transformation of radiation oncology using real-time magnetic resonance guidance: A review. , 2019, European journal of cancer.

[182]  Paolo Zaffino,et al.  Comparison of CBCT based synthetic CT methods suitable for proton dose calculations in adaptive proton therapy , 2020, Physics in medicine and biology.

[183]  R. Gullapalli,et al.  Transcranial MR Imaging–Guided Focused Ultrasound Interventions Using Deep Learning Synthesized CT , 2020, American Journal of Neuroradiology.

[184]  Konstantinos Kamnitsas,et al.  Overfitting of neural nets under class imbalance: Analysis and improvements for segmentation , 2019, MICCAI.

[185]  Yaozong Gao,et al.  Estimating CT Image from MRI Data Using 3D Fully Convolutional Networks , 2016, LABELS/DLMIA@MICCAI.

[186]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[187]  L. Marner,et al.  Deep Learning Based Attenuation Correction of PET/MRI in Pediatric Brain Tumor Patients: Evaluation in a Clinical Setting , 2019, Front. Neurosci..

[188]  Kenneth Ulin,et al.  Results of a multi-institutional benchmark test for cranial CT/MR image registration. , 2010, International journal of radiation oncology, biology, physics.

[189]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[190]  Berkman Sahiner,et al.  Deep learning in medical imaging and radiation therapy. , 2018, Medical physics.

[191]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[192]  F. Zanca,et al.  The EU medical device regulation: Implications for artificial intelligence-based medical device software in medical physics. , 2021, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[193]  Ciprian Catana,et al.  Attenuation correction for human PET/MRI studies , 2020, Physics in medicine and biology.

[194]  Minsong Cao,et al.  Multimodality Image Registration in the Head-and-Neck using a Deep Learning Derived Synthetic CT as a Bridge. , 2019, Medical physics.

[195]  Jason A Dowling,et al.  Investigating the generalisation of an atlas-based synthetic-CT algorithm to another centre and MR scanner for prostate MR-only radiotherapy. , 2017, Physics in medicine and biology.

[196]  Christopher Kurz,et al.  Evaluation of proton and photon dose distributions recalculated on 2D and 3D Unet-generated pseudoCTs from T1-weighted MR head scans , 2019, Acta oncologica.

[197]  N. Paragios,et al.  Dosimetry-driven quality measure of brain pseudo Computed Tomography generated from deep learning for MRI-only radiotherapy treatment planning. , 2020, International journal of radiation oncology, biology, physics.

[198]  A. McMillan,et al.  Deep learning Mr imaging–based attenuation correction for PeT/Mr imaging 1 , 2017 .

[199]  Sasa Mutic,et al.  Synthetic CT reconstruction using a deep spatial pyramid convolutional frame-work for MR-only breast radiotherapy. , 2019, Medical physics.

[200]  Jing Wang,et al.  Generating synthesized computed tomography (CT) from cone-beam computed tomography (CBCT) using CycleGAN for adaptive radiation therapy , 2018, Physics in medicine and biology.

[201]  Marco Riboldi,et al.  "Patient-specific validation of deformable image registration in radiation therapy: Overview and caveats". , 2018, Medical physics.

[202]  Yang Lei,et al.  Cone-beam CT-derived relative stopping power map generation via deep learning for proton radiotherapy. , 2020, Medical physics.

[203]  Richard Kijowski,et al.  A deep learning approach for 18F-FDG PET attenuation correction , 2018, EJNMMI Physics.

[204]  Gary S Collins,et al.  Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI Extension , 2020, BMJ.

[205]  Ninon Burgos,et al.  Comparative study of algorithms for synthetic CT generation from MRI: Consequences for MRI‐guided radiation planning in the pelvic region , 2018, Medical physics.

[206]  A. McMillan,et al.  Feasibility of Deep Learning–Based PET/MR Attenuation Correction in the Pelvis Using Only Diagnostic MR Images , 2018, Tomography.

[207]  Matthias Guckenberger,et al.  Technology‐driven research for radiotherapy innovation , 2020, Molecular oncology.