Deep Interactive Denoiser (DID) for X-Ray Computed Tomography

Low-dose computed tomography (LDCT) is desirable for both diagnostic imaging and image-guided interventions. Denoisers are widely used to improve the quality of LDCT. Deep learning (DL)-based denoisers have shown state-of-the-art performance and are becoming mainstream methods. However, there are two challenges to using DL-based denoisers: 1) a trained model typically does not generate different image candidates with different noise-resolution tradeoffs, which are sometimes needed for different clinical tasks; and 2) the model’s generalizability might be an issue when the noise level in the testing images differs from that in the training dataset. To address these two challenges, in this work, we introduce a lightweight optimization process that can run on top of any existing DL-based denoiser during the testing phase to generate multiple image candidates with different noise-resolution tradeoffs suitable for different clinical tasks in real time. Consequently, our method allows users to interact with the denoiser to efficiently review various image candidates and quickly pick the desired one; thus, we termed this method deep interactive denoiser (DID). Experimental results demonstrated that DID can deliver multiple image candidates with different noise-resolution tradeoffs and shows great generalizability across various network architectures, as well as training and testing datasets with various noise levels.

[1]  Jeffrey A. Fessler,et al.  Statistical image reconstruction for polyenergetic X-ray computed tomography , 2002, IEEE Transactions on Medical Imaging.

[2]  Zhengrong Liang,et al.  Sinogram noise reduction for low-dose CT by statistics-based nonlinear filters , 2005, SPIE Medical Imaging.

[3]  Jing Wang,et al.  Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for low-dose X-ray computed tomography , 2006, IEEE Transactions on Medical Imaging.

[4]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[5]  Jie Tang,et al.  Prior image constrained compressed sensing (PICCS): a method to accurately reconstruct dynamic CT images from highly undersampled projection data sets. , 2008, Medical physics.

[6]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[7]  L. Xing,et al.  Iterative image reconstruction for CBCT using edge-preserving prior. , 2008, Medical physics.

[8]  Cynthia M. McCollough,et al.  Projection space denoising with bilateral filtering and CT noise modeling for dose reduction in CT. , 2009, Medical physics.

[9]  Steve B. Jiang,et al.  GPU-based iterative cone-beam CT reconstruction using tight frame regularization , 2010, Physics in medicine and biology.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Lei Zhu,et al.  Accelerated barrier optimization compressed sensing (ABOCS) reconstruction for cone-beam CT: Phantom studies. , 2012, Medical physics.

[12]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[13]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Xinhui Duan,et al.  Technical Note: Development and validation of an open data format for CT projection data. , 2015, Medical physics.

[20]  M. Diwakar,et al.  A New Locally Adaptive Patch Variation Based CT Image Denoising , 2016 .

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[23]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[24]  Manoj Kumar,et al.  Edge preservation based CT image denoising using Wiener filtering and thresholding in wavelet domain , 2016, 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC).

[25]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[27]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Steve B. Jiang,et al.  Z-Index Parameterization for Volumetric CT Image Reconstruction via 3-D Dictionary Learning , 2017, IEEE Transactions on Medical Imaging.

[29]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[30]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[31]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[32]  Hongming Shan,et al.  3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network , 2018, IEEE Transactions on Medical Imaging.

[33]  Ge Wang,et al.  Structurally-Sensitive Multi-Scale Deep Neural Network for Low-Dose CT Denoising , 2018, IEEE Access.

[34]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[36]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[37]  Arthur Jacot,et al.  Neural tangent kernel: convergence and generalization in neural networks (invited paper) , 2018, NeurIPS.

[38]  Uwe Kruger,et al.  Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction , 2019, Nat. Mach. Intell..

[39]  Ke Li,et al.  Learning to Reconstruct Computed Tomography Images Directly From Sinogram Data Under A Variety of Data Acquisition Conditions , 2019, IEEE Transactions on Medical Imaging.

[40]  Guang Li,et al.  CT Super-Resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble (GAN-CIRCLE) , 2018, IEEE Transactions on Medical Imaging.

[41]  Junqi Tang,et al.  The Neural Tangent Link Between CNN Denoisers and Non-Local Filters , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Quanzheng Li,et al.  Self-Supervised Dynamic CT Perfusion Image Denoising With Deep Neural Networks , 2020, IEEE Transactions on Radiation and Plasma Medical Sciences.