Noise Characteristics Modeled Unsupervised Network for Robust CT Image Reconstruction

Deep learning (DL)-based methods show great potential in computed tomography (CT) imaging field. The DL-based reconstruction methods are usually evaluated on the training and testing datasets which are obtained from the same distribution, i.e., the same CT scan protocol (i.e., the region setting, kVp, mAs, etc.). In this work, we focus on analyzing the robustness of the DL-based methods against protocol-specific distribution shifts (i.e., the training and testing datasets are from different region settings, different kVp settings, or different mAs settings, respectively). The results show that the DL-based reconstruction methods are sensitive to the protocol-specific perturbations which can be attributed to the noise distribution shift between the training and testing datasets. Based on these findings, we presented a low-dose CT reconstruction method using an unsupervised strategy with the consideration of noise distribution to address the issue of protocol-specific perturbations. Specifically, unpaired sinogram data is enrolled into the network training, which represents unique information for specific imaging protocol, and a Gaussian mixture model (GMM) is introduced to characterize the noise distribution in CT images. It can be termed as GMM based unsupervised CT reconstruction network (GMM-unNet) method. Moreover, an expectation-maximization algorithm is designed to optimize the presented GMM-unNet method. Extensive experiments are performed on three datasets from different scan protocols, which demonstrate that the presented GMM-unNet method outperforms the competing methods both qualitatively and quantitatively.

[1]  Jiliu Zhou,et al.  CT Reconstruction With PDF: Parameter-Dependent Framework for Data From Multiple Geometries and Dose Levels , 2021, IEEE Transactions on Medical Imaging.

[2]  Rebecca Willett,et al.  Model Adaptation for Inverse Problems in Imaging , 2020, IEEE Transactions on Computational Imaging.

[3]  João F. C. Mota,et al.  Overcoming Measurement Inconsistency In Deep Learning For Linear Inverse Problems: Applications In Medical Imaging , 2020, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Hengyong Yu,et al.  Stabilizing Deep Tomographic Reconstruction , 2020, SSRN Electronic Journal.

[5]  Yan Liu,et al.  MAGIC: Manifold and Graph Integrative Convolutional Network for Low-Dose CT Reconstruction , 2020, IEEE Transactions on Medical Imaging.

[6]  Chen Zhang,et al.  Quantifying Model Uncertainty in Inverse Problems via Bayesian Deep Gradient Descent , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[7]  Zongben Xu,et al.  ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Bo Li,et al.  Improving Robustness of Deep-Learning-Based Image Reconstruction , 2020, ICML.

[9]  Jason Cong,et al.  SACNN: Self-Attention Convolutional Neural Network for Low-Dose CT Denoising With Self-Supervised Perceptual Loss Network , 2020, IEEE Transactions on Medical Imaging.

[10]  Jian Lu,et al.  A deep network for sinogram and CT image reconstruction , 2020, ArXiv.

[11]  Alexander Krull,et al.  Fully Unsupervised Probabilistic Noise2Void , 2019, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[12]  Huazhong Shu,et al.  Domain Progressive 3D Residual Convolution Network to Improve Low-Dose CT Imaging , 2019, IEEE Transactions on Medical Imaging.

[13]  W. Clem Karl,et al.  Fast Enhanced CT Metal Artifact Reduction Using Data Domain Deep Learning , 2019, IEEE Transactions on Computational Imaging.

[14]  Francesco Renna,et al.  On instabilities of deep learning in image reconstruction and the potential costs of AI , 2019, Proceedings of the National Academy of Sciences.

[15]  Zhaoying Bian,et al.  Optimizing a Parameterized Plug-and-Play ADMM for Iterative Low-Dose CT Reconstruction , 2019, IEEE Transactions on Medical Imaging.

[16]  Tingting Zhao,et al.  Ultra‐low‐dose CT image denoising using modified BM3D scheme tailored to data statistics , 2018, Medical physics.

[17]  Dong Zeng,et al.  Regularization strategies in statistical image reconstruction of low‐dose x‐ray CT: A review , 2018, Medical physics.

[18]  Jianhua Ma,et al.  Radon inversion via deep learning , 2018, Medical Imaging.

[19]  Jaejun Yoo,et al.  Deep Convolutional Framelet Denosing for Low-Dose CT via Wavelet Residual Network , 2017, IEEE Transactions on Medical Imaging.

[20]  Uwe Kruger,et al.  3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network , 2018, IEEE Transactions on Medical Imaging.

[21]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[22]  Zhengrong Liang,et al.  Robust Low-Dose CT Sinogram Preprocessing via Exploiting Noise-Generating Mechanism , 2017, IEEE Transactions on Medical Imaging.

[23]  Baiyu Chen,et al.  Low‐dose CT for the detection and classification of metastatic liver lesions: Results of the 2016 Low Dose CT Grand Challenge , 2017, Medical physics.

[24]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[25]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[26]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[27]  J. Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[28]  Jianhua Ma,et al.  Iterative reconstruction for dual energy CT with an average image-induced nonlocal means regularization , 2017, Physics in medicine and biology.

[29]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[30]  Jong Chul Ye,et al.  Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis , 2016, ArXiv.

[31]  Jan Sijbers,et al.  Fast and flexible X-ray tomography using the ASTRA toolbox. , 2016, Optics express.

[32]  Jing Huang,et al.  Penalized weighted least-squares approach for multienergy computed tomography image reconstruction via structure tensor total variation regularization , 2016, Comput. Medical Imaging Graph..

[33]  Jing Huang,et al.  Low-dose cerebral perfusion computed tomography image restoration via low-rank and total variation regularizations , 2016, Neurocomputing.

[34]  John Schulman,et al.  Concrete Problems in AI Safety , 2016, ArXiv.

[35]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[36]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[38]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[39]  Luo Ouyang,et al.  Few-view cone-beam CT reconstruction with deformed prior image. , 2014, Medical physics.

[40]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[41]  Ehsan Samei,et al.  Model-based CT performance assessment and optimization for iodinated and noniodinated imaging tasks as a function of kVp and body size. , 2014, Medical physics.

[42]  M. Shiung,et al.  Development and Validation of a Practical Lower-Dose-Simulation Tool for Optimizing Computed Tomography Scan Protocols , 2012, Journal of computer assisted tomography.

[43]  Gengsheng Lawrence Zeng,et al.  Medical Image Reconstruction: A Conceptual Tutorial , 2010 .

[44]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[45]  Jing Wang,et al.  Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for low-dose X-ray computed tomography , 2006, IEEE Transactions on Medical Imaging.

[46]  A. Bovik,et al.  Image information and visual quality , 2006, IEEE Transactions on Image Processing.

[47]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[48]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[49]  C. Bouman,et al.  Modeling and Pre-Treatment of Photon-Starved CT Data for Iterative Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[50]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .