An Improved Iterative Neural Network for High-Quality Image-Domain Material Decomposition in Dual-Energy CT

Dual-energy computed tomography (DECT) has been widely used in many applications that need material decomposition. Image-domain methods directly decompose material images from high- and low-energy attenuation images, and thus, are susceptible to noise and artifacts on attenuation images. To obtain high-quality material images, various data-driven methods have been proposed. Iterative neural network (INN) methods combine regression NNs and model-based image reconstruction algorithm. INNs reduced the generalization error of (noniterative) deep regression NNs, and achieved high-quality reconstruction in diverse medical imaging applications. BCD-Net is a recent INN architecture that incorporates imaging refining NNs into the block coordinate descent (BCD) model-based image reconstruction algorithm. We propose a new INN architecture, distinct cross-material BCD-Net, for DECT material decomposition. The proposed INN architecture uses distinct cross-material convolutional neural network (CNN) in image refining modules, and uses image decomposition physics in image reconstruction modules. The distinct cross-material CNN refiners incorporate distinct encoding-decoding filters and cross-material model that captures correlations between different materials. We interpret the distinct cross-material CNN refiner with patch perspective. Numerical experiments with extended cardiactorso (XCAT) phantom and clinical data show that proposed distinct cross-material BCD-Net significantly improves the image quality over several image-domain material decomposition methods, including a conventional model-based image decomposition (MBID) method using an edge-preserving regularizer, a state-of-the-art MBID method using pre-learned material-wise sparsifying transforms, and a noniterative deep CNN denoiser.

[1]  W. D. Friedman,et al.  Review of dual-energy computed tomography techniques , 1990 .

[2]  W P Segars,et al.  Realistic CT simulation using the 4D XCAT phantom. , 2008, Medical physics.

[3]  Jeffrey A. Fessler,et al.  Statistical Sinogram Restoration in Dual-Energy CT for PET Attenuation Correction , 2009, IEEE Transactions on Medical Imaging.

[4]  Marc Kachelrieß,et al.  Image-based dual energy CT using optimized precorrection functions: A practical new approach of material decomposition in image domain. , 2009, Medical physics.

[5]  Zhiqiang Chen,et al.  Feasibility study: Low-cost dual energy CT for security inspection , 2009, 2009 IEEE Nuclear Science Symposium Conference Record (NSS/MIC).

[6]  Mitchell M Goodsitt,et al.  Accuracies of the synthesized monochromatic CT numbers and effective atomic numbers obtained with a rapid kVp switching dual energy CT scanner. , 2011, Medical physics.

[7]  Y Li,et al.  Iodine quantification with dual-energy CT: phantom study and preliminary experience with VX2 residual tumour in rabbits after radiofrequency ablation. , 2013, The British journal of radiology.

[8]  Ken D. Sauer,et al.  Model-Based Iterative Reconstruction for Dual-Energy X-Ray CT Using a Joint Quadratic Likelihood Model , 2014, IEEE Transactions on Medical Imaging.

[9]  Paulo R. S. Mendonça,et al.  A Flexible Method for Multi-Material Decomposition of Dual-Energy CT Images , 2014, IEEE Transactions on Medical Imaging.

[10]  Jian-Feng Cai,et al.  Data-driven tight frame construction and image denoising , 2014 .

[11]  Lei Zhu,et al.  Iterative image-domain decomposition for dual-energy CT. , 2014, Medical physics.

[12]  Jeffrey A. Fessler,et al.  Multi-Material Decomposition Using Statistical Image Reconstruction for Spectral CT , 2014, IEEE Transactions on Medical Imaging.

[13]  Daniele Marin,et al.  State of the art: dual-energy CT of the abdomen. , 2014, Radiology.

[14]  Ke Li,et al.  Statistical model based iterative reconstruction (MBIR) in clinical CT systems: experimental assessment of noise performance. , 2014, Medical physics.

[15]  Lei Zhu,et al.  Noise Suppression for Dual-Energy CT Through Entropy Minimization , 2015, IEEE Transactions on Medical Imaging.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  W. Clem Karl,et al.  Learning-Based Object Identification and Segmentation Using Dual-Energy CT Images for Security , 2015, IEEE Transactions on Image Processing.

[18]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[19]  Quanzheng Li,et al.  A Cascaded Convolutional Nerual Network for X-ray Low-dose CT Image Denoising , 2017, ArXiv.

[20]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[21]  T. Niu,et al.  Statistical image‐domain multimaterial decomposition for dual‐energy CT , 2017, Medical physics.

[22]  Jeffrey A. Fessler,et al.  Convolutional Dictionary Learning: Acceleration and Convergence , 2017, IEEE Transactions on Image Processing.

[23]  D. P. Clark,et al.  Multi-energy CT decomposition using convolutional neural networks , 2018, Medical Imaging.

[24]  Jeffrey A. Fessler,et al.  Fast and convergent iterative image recovery using trained convolutional neural networks , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[25]  Zhaoying Bian,et al.  Pseudo dual energy CT imaging using deep learning-based framework: basic material estimation , 2018, Medical Imaging.

[26]  Jeffrey A. Fessler,et al.  Deep BCD-Net Using Identical Encoding-Decoding CNN Structures for Iterative Image Recovery , 2018, 2018 IEEE 13th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[27]  S. Waldron An Introduction to Finite Tight Frames , 2018 .

[28]  Jeffrey A. Fessler,et al.  Image-domain material decomposition using data-driven sparsity models for dual-energy CT , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[29]  Bin Yan,et al.  Image Decomposition Algorithm for Dual-Energy Computed Tomography via Fully Convolutional Network , 2018, Comput. Math. Methods Medicine.

[30]  Jeffrey A. Fessler,et al.  BCD-Net for Low-dose CT Reconstruction: Acceleration, Convergence, and Generalization , 2019, MICCAI.

[31]  Jeffrey A. Fessler,et al.  Convolutional Analysis Operator Learning: Dependence on Training Data , 2019, IEEE Signal Processing Letters.

[32]  Ke Sheng,et al.  Accurate Multi-Material Decomposition in Dual-Energy CT: A Phantom Study , 2019, IEEE Transactions on Computational Imaging.

[33]  Xinhui Duan,et al.  Dual-Energy CT: Lower Limits of Iodine Detection and Quantification. , 2019, Radiology.

[34]  Simon Lennartz,et al.  Dose independent characterization of renal stones by means of dual energy computed tomography and machine learning: an ex-vivo study , 2019, European Radiology.

[35]  Saiprasad Ravishankar,et al.  Image-domain multi-material decomposition using a union of cross-material models , 2019 .

[36]  Yining Zhu,et al.  Block matching frame based material reconstruction for spectral CT , 2018, Physics in medicine and biology.

[37]  Bin Yan,et al.  Image domain dual material decomposition for dual-energy CT using butterfly network. , 2018, Medical physics.

[38]  Jeffrey A. Fessler,et al.  Convolutional Analysis Operator Learning: Acceleration and Convergence , 2018, IEEE Transactions on Image Processing.

[39]  Yining Zhu,et al.  Dictionary learning based image-domain material decomposition for spectral CT , 2019, Physics in medicine and biology.

[40]  Il Yong Chun,et al.  Image-Domain Material Decomposition Using an Iterative Neural Network for Dual-Energy CT , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[41]  Jeffrey A. Fessler,et al.  Improved Low-Count Quantitative PET Reconstruction With an Iterative Neural Network , 2019, IEEE Transactions on Medical Imaging.

[42]  Hengyong Yu,et al.  Stabilizing Deep Tomographic Reconstruction , 2020, SSRN Electronic Journal.

[43]  Jeffrey A. Fessler,et al.  Momentum-Net: Fast and Convergent Iterative Neural Network for Inverse Problems , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Il Yong Chun,et al.  Momentum-Net for Low-Dose CT Image Reconstruction , 2020, ArXiv.

[45]  Jeffrey A. Fessler,et al.  DECT-MULTRA: Dual-Energy CT Image Decomposition With Learned Mixed Material Models and Efficient Clustering , 2019, IEEE Transactions on Medical Imaging.

[46]  Hengyong Yu,et al.  Image-Domain Material Decomposition for Spectral CT Using a Generalized Dictionary Learning , 2021, IEEE Transactions on Radiation and Plasma Medical Sciences.

[47]  Weiwen Wu,et al.  A High-Quality Photon-Counting CT Technique Based on Weight Adaptive Total-Variation and Image-Spectral Tensor Factorization for Small Animals Imaging , 2021, IEEE Transactions on Instrumentation and Measurement.

[48]  Quanzheng Li,et al.  Iterative material decomposition for spectral CT using self-supervised Noise2Noise prior , 2021, Physics in medicine and biology.