Intensity non-uniformity correction in MR imaging using residual cycle generative adversarial network

Correcting or reducing the effects of voxel intensity non-uniformity (INU) within a given tissue type is a crucial issue for quantitative magnetic resonance (MR) image analysis in daily clinical practice. Although having no severe impact on visual diagnosis, the INU can highly degrade the performance of automatic quantitative analysis such as segmentation, registration, feature extraction and radiomics. In this study, we present an advanced deep learning based INU correction algorithm called residual cycle generative adversarial network (res-cycle GAN), which integrates the residual block concept into a cycle-consistent GAN (cycle-GAN). In cycle-GAN, an inverse transformation was implemented between the INU uncorrected and corrected magnetic resonance imaging (MRI) images to constrain the model through forcing the calculation of both an INU corrected MRI and a synthetic corrected MRI. A fully convolution neural network integrating residual blocks was applied in the generator of cycle-GAN to enhance end-to-end raw MRI to INU corrected MRI transformation. A cohort of 55 abdominal patients with T1-weighted MR INU images and their corrections with a clinically established and commonly used method, namely, N4ITK were used as a pair to evaluate the proposed res-cycle GAN based INU correction algorithm. Quantitatively comparisons of normalized mean absolute error (NMAE), peak signal-to-noise ratio (PSNR), normalized cross-correlation (NCC) indices, and spatial non-uniformity (SNU) were made among the proposed method and other approaches. Our res-cycle GAN based method achieved an NMAE of 0.011 ± 0.002, a PSNR of 28.0 ± 1.9 dB, an NCC of 0.970 ± 0.017, and a SNU of 0.298 ± 0.085. Our proposed method has significant improvements (p < 0.05) in NMAE, PSNR, NCC and SNU over other algorithms including conventional GAN and U-net. Once the model is well trained, our approach can automatically generate the corrected MR images in a few minutes, eliminating the need for manual setting of parameters.

[1]  G. Johnson,et al.  Fat suppression in MR imaging: techniques and pitfalls. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[2]  Zujun Hou,et al.  A Review on MR Image Intensity Inhomogeneity Correction , 2006, Int. J. Biomed. Imaging.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[5]  J. Haselgrove,et al.  An algorithm for compensation of surface-coil images for sensitivity of the surface coil , 1986 .

[6]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[7]  A. PraylinSelvaBlessyS.,et al.  Enhanced Homomorphic Unsharp Masking method for intensity inhomogeneity correction in brain MR images , 2020, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[8]  R. Low,et al.  Abdominal MRI advances in the detection of liver tumours and characterisation. , 2007, The Lancet. Oncology.

[9]  J W Murakami,et al.  Intensity correction of phased‐array surface coil images , 1996, Magnetic resonance in medicine.

[10]  Yuanjie Zheng,et al.  Liver MRI segmentation with edge-preserved intensity inhomogeneity correction , 2018, Signal Image Video Process..

[11]  O. Nalcioglu,et al.  A new bias field correction method combining N3 and FCM for improved segmentation of breast density on MRI. , 2010, Medical physics.

[12]  Baowei Fei,et al.  A wavelet multiscale denoising algorithm for magnetic resonance (MR) images , 2011, Measurement science & technology.

[13]  S. Brandão,et al.  Comparing T1-weighted and T2-weighted three-point Dixon technique with conventional T1-weighted fat-saturation and short-tau inversion recovery (STIR) techniques for the study of the lumbar spine in a short-bore MRI machine. , 2013, Clinical radiology.

[14]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[15]  R Turner,et al.  RF inhomogeneity compensation in structural brain imaging , 2002, Magnetic resonance in medicine.

[16]  Ashish Ghosh,et al.  Context Dependent Fuzzy Associated Statistical Model for Intensity Inhomogeneity Correction From Magnetic Resonance Images , 2019, IEEE Journal of Translational Engineering in Health and Medicine.

[17]  Tian Liu,et al.  MRI-based treatment planning for brain stereotactic radiosurgery: Dosimetric validation of a learning-based pseudo-CT generation method. , 2019, Medical dosimetry : official journal of the American Association of Medical Dosimetrists.

[18]  Kirby G. Vosburgh,et al.  3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support , 2014 .

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  Örjan Smedby,et al.  Simultaneous MR knee image segmentation and bias field correction using deep learning and partial convolution , 2019, Medical Imaging: Image Processing.

[21]  Lin Yang,et al.  Abdominal MRI at 3.0 T: LAVA‐flex compared with conventional fat suppression T1‐weighted images , 2014, Journal of magnetic resonance imaging : JMRI.

[22]  M. Stasi,et al.  Texture features on T2-weighted magnetic resonance imaging: new potential biomarkers for prostate cancer aggressiveness , 2015, Physics in medicine and biology.

[23]  Tian Liu,et al.  Paired cycle-GAN based image correction for quantitative cone-beam CT. , 2019, Medical physics.

[24]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[25]  Christian Stroszczynski,et al.  Evaluation of two-point Dixon water-fat separation for liver specific contrast-enhanced assessment of liver maximum capacity , 2018, Scientific Reports.

[26]  Yang Lei,et al.  Automatic Multi-Catheter Detection using Deeply Supervised Convolutional Neural Network in MRI-guided HDR Prostate Brachytherapy. , 2020, Medical physics.

[27]  Yang Lei,et al.  Dose evaluation of MRI-based synthetic CT generated using a machine learning method for prostate cancer radiotherapy. , 2019, Medical dosimetry : official journal of the American Association of Medical Dosimetrists.

[28]  Rangaraj M. Rangayyan,et al.  Registration, Lesion Detection, and Discrimination for Breast Dynamic Contrast-Enhanced Magnetic Resonance Imaging , 2013 .

[29]  L. Axel,et al.  Intensity correction in surface-coil MR imaging. , 1987, AJR. American journal of roentgenology.

[30]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[31]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[32]  Donald B. Plewes,et al.  Physics of MRI: A primer , 2012, Journal of magnetic resonance imaging : JMRI.

[33]  Hugues Benoit-Cattin,et al.  Intensity non-uniformity correction in MRI: Existing methods and their validation , 2006, Medical Image Anal..

[34]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Zhengyang Zhou,et al.  Automated segmentation of the parotid gland based on atlas registration and machine learning: a longitudinal MRI study in head-and-neck radiation therapy. , 2014, International journal of radiation oncology, biology, physics.

[36]  Scott B Reeder,et al.  Quantification of liver fat with magnetic resonance imaging. , 2010, Magnetic resonance imaging clinics of North America.

[37]  A W Beavis,et al.  Radiotherapy treatment planning of brain tumours using MRI alone. , 1998, The British journal of radiology.

[38]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[39]  Weili Lin,et al.  Principles of magnetic resonance imaging: a signal processing perspective [Book Review] , 2000 .

[40]  Yang Lei,et al.  Synthetic MRI-aided multi-organ segmentation on male pelvic CT using cycle consistent deep attention network. , 2019, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[41]  Charles R. Meyer,et al.  Retrospective correction of intensity inhomogeneities in MRI , 1995, IEEE Trans. Medical Imaging.

[42]  W. Curran,et al.  Evaluation of a deep learning-based pelvic synthetic CT generation technique for MRI-based prostate proton treatment planning , 2019, Physics in medicine and biology.

[43]  P. V. Sridevi,et al.  Intensity Inhomogeneity Correction for Magnetic Resonance Imaging of Automatic Brain Tumor Segmentation , 2018, Lecture Notes in Electrical Engineering.

[44]  A. Simk'o,et al.  A Generalized Network for MRI Intensity Normalization , 2019 .

[45]  Maria A Schmidt,et al.  Radiotherapy planning using MRI , 2015, Physics in medicine and biology.

[46]  Yang Lei,et al.  MRI-based attenuation correction for brain PET/MRI based on anatomic signature and machine learning , 2019, Physics in medicine and biology.

[47]  Tian Liu,et al.  MRI-based Treatment Planning for Proton Radiotherapy: Dosimetric Validation of a Deep Learning-based Liver Synthetic CT Generation Method , 2019, Physics in medicine and biology.

[48]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[49]  H Cramer,et al.  Magnetic resonance imaging. Basic principles. , 1986, Minnesota medicine.

[50]  Olivier Salvado,et al.  An atlas-based electron density mapping method for magnetic resonance imaging (MRI)-alone treatment planning and adaptive MRI-based prostate radiation therapy. , 2012, International journal of radiation oncology, biology, physics.

[51]  M. Bronskill,et al.  Phase and sensitivity of receiver coils in magnetic resonance imaging. , 1986, Medical physics.

[52]  Yang Lei,et al.  MRI-only based synthetic CT generation using dense cycle consistent generative adversarial networks. , 2019, Medical physics.

[53]  Uwe D. Hanebeck,et al.  Template matching using fast normalized cross correlation , 2001, SPIE Defense + Commercial Sensing.

[54]  Bostjan Likar,et al.  Retrospective correction of MR intensity inhomogeneity by information minimization , 2000, IEEE Transactions on Medical Imaging.

[55]  A Vignati,et al.  Computer-aided diagnosis for dynamic contrast-enhanced breast MRI of mass-like lesions using a multiparametric model combining a selection of morphological, kinetic, and spatiotemporal features. , 2012, Medical physics.

[56]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[57]  J. Gore,et al.  Multiplicative intrinsic component optimization (MICO) for MRI bias field estimation and tissue segmentation. , 2014, Magnetic resonance imaging.

[58]  Yang Lei,et al.  MRI-based treatment planning for liver stereotactic body radiotherapy: validation of a deep learning-based synthetic CT generation method. , 2019, The British journal of radiology.

[59]  Munendra Singh,et al.  Intensity inhomogeneity correction of MRI images using InhomoNet , 2020, Comput. Medical Imaging Graph..

[60]  Yang Lei,et al.  Whole-body PET estimation from low count statistics using cycle-consistent generative adversarial networks , 2019, Physics in medicine and biology.

[61]  S R Arridge,et al.  A simple method for investigating the effects of non-uniformity of radiofrequency transmission and radiofrequency reception in MRI. , 1998, The British journal of radiology.

[62]  Bostjan Likar,et al.  A Review of Methods for Correction of Intensity Inhomogeneity in MRI , 2007, IEEE Transactions on Medical Imaging.

[63]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[64]  Marco Ganzetti,et al.  Intensity Inhomogeneity Correction of Structural MR Images: A Data-Driven Approach to Define Input Algorithm Parameters , 2016, Front. Neuroinform..

[65]  Maik Stille,et al.  Residual U-Net Convolutional Neural Network Architecture for Low-Dose CT Denoising , 2018, Current Directions in Biomedical Engineering.

[66]  Yang Lei,et al.  Multiparametric MRI-guided high-dose-rate prostate brachytherapy with focal dose boost to dominant intraprostatic lesions , 2020, Medical Imaging: Biomedical Applications in Molecular, Structural, and Functional Imaging.

[67]  Marco Ganzetti,et al.  Quantitative Evaluation of Intensity Inhomogeneity Correction Methods for Structural MR Brain Images , 2015, Neuroinformatics.

[68]  A. Bert,et al.  Performance of a fully automatic lesion detection system for breast DCE‐MRI , 2011, Journal of magnetic resonance imaging : JMRI.

[69]  Evis Sala,et al.  T1-weighted fat-suppressed imaging of the pelvis with a dual-echo Dixon technique: initial clinical experience. , 2011, Radiology.

[70]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.