Deep neural network for beam hardening artifacts removal in image reconstruction

Image reconstruction with limited angles projection data is a challenging task in computed tomography (CT). The amount of radiation associated with CT induces health implications to the patient. Besides, image reconstruction with limited-angles projection data distorts the image, thus emasculating the efficiency of diagnosis. Also, the poly-chromatic nature of the X-ray adds beam-hardening artifacts in the reconstruction. The state-of-the-art approaches available in the literature have proposed the solutions for beam-hardening artifacts correction in full span computed tomography. Most of the solutions are hardware based and need extra hardware to remove the beam hardening artifacts. The present manuscript proposes artificial intelligence based software solution for the beam hardening artifacts removal. This manuscript has presented a cascaded encoder-decoder architecture named cascaded deep neural network for image reconstruction (CDNN). The CDNN architecture has convolution neural network blocks that include convolution layers, rectified linear units ReLU, and batch normalization layers. The network has skip-connections for better learning of features between input and output. The network has been designed as a forward model. The stochastic gradient descent optimization method has been used for training the network. Image reconstructed from Fourier transform-based approach has been used as a prior. A novel approach for reduction of beam-hardening artifacts in case of limited-angles computed tomography using CDNN has been presented. The proposed approach is comparable to other hardware/software solutions for aforesaid purpose and does not require any extra hardware. The proposed approach has improved the image quality as compared to U-Net and the other state-of-the-art methods. It has been found from the experiments that the CDNN suppresses the artifacts and improves the reconstruction. The performance of the proposed CDNN has been tested with real-life data having beam hardening artifacts. It has been observed that the CDNN has improved the reconstruction quality by reducing streak, ring artifacts, and beam hardening artifacts and also preserving the profound structures.

[1]  Florian Knoll,et al.  Artificial Intelligence for MR Image Reconstruction: An Overview for Clinicians , 2020, Journal of magnetic resonance imaging : JMRI.

[2]  Phalguni Gupta,et al.  High resolution 3D image reconstruction using the algebraic method for cone-beam geometry over circular and helical trajectories , 2013 .

[3]  Prabhat Munshi,et al.  An improved algorithm for beam-hardening corrections in experimental X-ray tomography , 2008 .

[4]  Ehsan Samei,et al.  Noise and spatial resolution properties of a commercially available deep-learning based CT reconstruction algorithm. , 2020, Medical physics.

[5]  Manish Kumar Bajpai,et al.  RecDNN: deep neural network for image reconstruction from limited view projection data , 2020, Soft Computing.

[6]  Zeev Zalevsky,et al.  Reduction in Irradiation Dose in Aperture Coded Enhanced Computed Tomography Imager Using Super-Resolution Techniques , 2020, Sensors.

[7]  Hengyong Yu,et al.  A soft-threshold filtering approach for reconstruction from a limited number of projections , 2010, Physics in medicine and biology.

[8]  Phalguni Gupta,et al.  A Graphical Processing Unit–Based Parallel Implementation of Multiplicative Algebraic Reconstruction Technique Algorithm for Limited View Tomography , 2013 .

[9]  Frank Natterer,et al.  Mathematical methods in image reconstruction , 2001, SIAM monographs on mathematical modeling and computation.

[10]  Chang Min Hyun,et al.  A two-stage approach for beam hardening artifact reduction in low-dose dental CBCT , 2020, IEEE Access.

[11]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[12]  Tao Lin,et al.  Metal Artifact Reduction Method Based on Noncoplanar Scanning in CBCT Imaging , 2020, IEEE Access.

[13]  Gabor T. Herman,et al.  Fundamentals of Computerized Tomography: Image Reconstruction from Projections , 2009, Advances in Pattern Recognition.

[14]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[15]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[16]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[17]  Hongming Shan,et al.  3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network , 2018, IEEE Transactions on Medical Imaging.

[18]  R. Bartle The elements of integration and Lebesgue measure , 1995 .

[19]  Jean-Baptiste Thibault,et al.  Prior-Guided Metal Artifact Reduction for Iterative X-Ray Computed Tomography , 2019, IEEE Transactions on Medical Imaging.

[20]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Congbo Cai,et al.  Undersampled MR image reconstruction using an enhanced recursive residual network. , 2019, Journal of magnetic resonance.

[22]  Henry Arguello,et al.  Adaptive coded aperture design for compressive computed tomography , 2021, J. Comput. Appl. Math..

[23]  A. Kak,et al.  Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm , 1984, Ultrasonic imaging.

[24]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[25]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[26]  Russell A. Gordon The Integrals of Lebesgue, Denjoy, Perron, and Henstock , 1994 .

[27]  Robert Frysch,et al.  Beam Hardening Correction Using Cone Beam Consistency Conditions , 2018, IEEE Transactions on Medical Imaging.

[28]  Kazumi Murata,et al.  Maximum entropy image reconstruction from projections , 1981 .

[29]  Yan Han,et al.  Blind Separation Model of Multi-voltage Projections for the Hardening Artifact Correction in Computed Tomography , 2021, Biomed. Signal Process. Control..

[30]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[31]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[32]  Phalguni Gupta,et al.  Fast multi-processor multi-GPU based algorithm of tomographic inversion for 3D image reconstruction , 2015, Int. J. High Perform. Comput. Appl..

[33]  P. Noël,et al.  The evolution of image reconstruction for CT—from filtered back projection to artificial intelligence , 2018, European radiology.

[34]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[35]  Michael Elad,et al.  Spatially-Adaptive Reconstruction in Computed Tomography Using Neural Networks , 2013, IEEE Transactions on Medical Imaging.

[36]  P. Gilbert Iterative methods for the three-dimensional reconstruction of an object from projections. , 1972, Journal of theoretical biology.

[37]  Uwe Kruger,et al.  Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction , 2019, Nat. Mach. Intell..

[38]  Mannudeep K. Kalra,et al.  Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN) , 2017, ArXiv.

[39]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[40]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[41]  Huazhong Shu,et al.  Artifact Suppressed Dictionary Learning for Low-Dose CT Image Processing , 2014, IEEE Transactions on Medical Imaging.

[42]  Wei Zhao,et al.  Robust Beam Hardening Artifacts Reduction for Computed Tomography Using Spectrum Modeling , 2019, IEEE Transactions on Computational Imaging.

[43]  Pankaj Wahi,et al.  An empirical correction method for beam-hardening artifact in Computerized Tomography (CT) images , 2019, NDT & E International.

[44]  Andreas K. Maier,et al.  Deep Learning Computed Tomography , 2016, MICCAI.

[45]  Manuel Desco,et al.  Simplified Statistical Image Reconstruction for X-ray CT With Beam-Hardening Artifact Compensation , 2020, IEEE Transactions on Medical Imaging.

[46]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[47]  Kees Joost Batenburg,et al.  Fast Tomographic Reconstruction From Limited Data Using Artificial Neural Networks , 2013, IEEE Transactions on Image Processing.

[48]  Gao Liugang,et al.  Metal Artifact Reduction Method Based on Noncoplanar Scanning in CBCT Imaging , 2020, IEEE Access.

[49]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[50]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[51]  Francesco De Carlo,et al.  TomoPy: a framework for the analysis of synchrotron tomographic data , 2014, Journal of synchrotron radiation.

[52]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.