A Universal Intensity Standardization Method Based on a Many-to-One Weak-Paired Cycle Generative Adversarial Network for Magnetic Resonance Images

In magnetic resonance imaging (MRI), different imaging settings lead to various intensity distributions for a specific imaging object, which brings huge diversity to data-driven medical applications. To standardize the intensity distribution of magnetic resonance (MR) images from multiple centers and multiple machines using one model, a cycle generative adversarial network (CycleGAN)-based framework is proposed. It utilizes a unified forward generative adversarial network (GAN) path and multiple independent backward GAN paths to transform images in different groups into a single reference one. To preserve image details and prevent resolution loss, two jump connections are applied in the CycleGAN generators. A weak-pair strategy is designed to fully utilize the prior knowledge of the organ structure and promote the performance of the GANs. The experiments were conducted on a T2-FLAIR image database with 8192 slices from 489 patients. The database was obtained from four hospitals and five MRI scanners and was divided into nine groups with different imaging parameters. Compared with the representative algorithms, the peak signal-to-noise ratio, the histogram correlation, and the structural similarity were increased by 3.7%, 5.1%, and 0.1% on average, respectively; the gradient magnitude similarity deviation, the mean square error, and the average disparity were reduced by 19.0%, 15.7%, and 9.9% on average, respectively. Experiments also showed the robustness of the proposed model with a different training set configuration and effectiveness of the proposed framework over the original CycleGAN. Therefore, the MR images with different imaging settings could be efficiently standardized by the proposed method, which would benefit various data-driven applications.

[1]  Anant Madabhushi,et al.  Radiomics based targeted radiotherapy planning (Rad-TRaP): a computational framework for prostate cancer treatment planning with MRI , 2016, Radiation Oncology.

[2]  D. Dong,et al.  Radiomics Features of Multiparametric MRI as Novel Prognostic Factors in Advanced Nasopharyngeal Carcinoma , 2017, Clinical Cancer Research.

[3]  Andre Dekker,et al.  Radiomics: the process and the challenges. , 2012, Magnetic resonance imaging.

[4]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[5]  Jun Zhang,et al.  Optimised MRI intensity standardisation based on multi-dimensional sub-regional point cloud registration , 2019, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[6]  G. Collewet,et al.  Influence of MRI acquisition protocols and image intensity normalization methods on texture classification. , 2004, Magnetic resonance imaging.

[7]  F. Wacker,et al.  A New Method for MRI Intensity Standardization with Application to Lesion Detection in the Brain , 2006 .

[8]  Nick C Fox,et al.  Automatic classification of MR scans in Alzheimer's disease. , 2008, Brain : a journal of neurology.

[9]  P. Lambin,et al.  Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach , 2014, Nature Communications.

[10]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[11]  Lin Shi,et al.  Histogram-based normalization technique on human brain magnetic resonance images from different acquisitions , 2015, Biomedical engineering online.

[12]  Chuan Li,et al.  Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks , 2016, ECCV.

[13]  Joachim Hornegger,et al.  Nonrigid Registration of Joint Histograms for Intensity Standardization in Magnetic Resonance Imaging , 2009, IEEE Transactions on Medical Imaging.

[14]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  Yuanyuan Wang,et al.  Noninvasive IDH1 mutation estimation based on a quantitative radiomics approach for grade II glioma , 2017, European Radiology.

[16]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Jayaram K. Udupa,et al.  New methods of MR image intensity standardization via generalized scale , 2005, SPIE Medical Imaging.

[18]  M. Weiner,et al.  A Network Diffusion Model of Disease Progression in Dementia , 2012, Neuron.

[19]  Maximilian Reiser,et al.  Radiomic Analysis Reveals Prognostic Information in T1-Weighted Baseline Magnetic Resonance Imaging in Patients With Glioblastoma , 2017, Investigative radiology.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Christos Davatzikos,et al.  Radiomic signature of infiltration in peritumoral edema predicts subsequent recurrence in glioblastoma: implications for personalized radiotherapy planning , 2018, Journal of medical imaging.

[22]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[23]  G. Reifenberger,et al.  The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary , 2016, Acta Neuropathologica.

[24]  Bernd Hamm,et al.  Response to neoadjuvant treatment of invasive ductal breast carcinomas including outcome evaluation: MRI analysis by an automatic CAD system in comparison to visual evaluation , 2014, Acta oncologica.

[25]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[26]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[27]  Dinggang Shen,et al.  Multi-Label Nonlinear Matrix Completion With Transductive Multi-Task Feature Selection for Joint MGMT and IDH1 Status Prediction of Patient With High-Grade Gliomas , 2018, IEEE Transactions on Medical Imaging.

[28]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[29]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[30]  Simon Duchesne,et al.  Tissue-Based MRI Intensity Standardization: Application to Multicentric Datasets , 2012, Int. J. Biomed. Imaging.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Jayaram K. Udupa,et al.  New variants of a method of MRI scale standardization , 2000, IEEE Transactions on Medical Imaging.

[33]  Rosella Cataldo,et al.  Robust Intensity Standardization in Brain Magnetic Resonance Images , 2015, Journal of Digital Imaging.

[34]  Boudewijn P. F. Lelieveldt,et al.  Inter‐station intensity standardization for whole‐body MR data , 2016, Magnetic resonance in medicine.