Multi-Scale Dilated Convolution Neural Network for Image Artifact Correction of Limited-Angle Tomography

Limited-angle computed tomography (CT) has arisen in some medical and industrial applications. It is also a challenging problem since some scan views are missing and the directly reconstructed images often suffer from severe distortions. For such kind of problems, we analyze the features of limited-angle CT images and propose a multi-scale dilated convolution neural network (MSD-CNN) to correct the artifacts and to restore the image. In this network, the dilated convolution layer and multi-scale pooling layer are combined to form a group and exited in the whole encoder-decoder process. Since the dilated convolutions support an exponential expansion of the receptive field without losing resolution and coverage, the obtained artifact features possess the multi-scale characteristic. Furthermore, to improve the effectiveness and accuracy of the training step, we employ a preprocessing method, which extracts image patches. Numerical experiments verify the out-performance of the proposed method compared with some conventional methods, such as Unet based deep learning,TV- and $L_{0}$ -based optimization methods.

[1]  Xiaochuan Pan,et al.  Evaluation of sparse-view reconstruction from flat-panel-detector cone-beam CT , 2010, Physics in medicine and biology.

[2]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[3]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[4]  Jin Liu,et al.  3D Feature Constrained Reconstruction for Low-Dose CT Imaging , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[6]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[7]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[8]  Rushil Anirudh,et al.  An Unsupervised Approach to Solving Inverse Problems using Generative Adversarial Networks , 2018, ArXiv.

[9]  Jiasong Wu,et al.  Improving Low-Dose CT Image Using Residual Convolutional Network , 2017, IEEE Access.

[10]  Jie Tang,et al.  Performance comparison between total variation (TV)-based compressed sensing and statistical iterative reconstruction algorithms , 2009, Physics in medicine and biology.

[11]  Jonas Adler,et al.  Solving ill-posed inverse problems using iterative deep neural networks , 2017, ArXiv.

[12]  Chengxiang Wang,et al.  Edge-preserving reconstruction from sparse projections of limited-angle computed tomography using ℓ0-regularized gradient prior. , 2017, The Review of scientific instruments.

[13]  Hengyong Yu,et al.  A soft-threshold filtering approach for reconstruction from a limited number of projections , 2010, Physics in medicine and biology.

[14]  Bin Yan,et al.  Image Prediction for Limited-angle Tomography via Deep Learning with Convolutional Neural Network , 2016, ArXiv.

[15]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[16]  A. Kak,et al.  Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm , 1984, Ultrasonic imaging.

[17]  Andreas K. Maier,et al.  A Deep Learning Architecture for Limited-Angle Computed Tomography Reconstruction , 2017, Bildverarbeitung für die Medizin.

[18]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[19]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jie Tang,et al.  Prior image constrained compressed sensing (PICCS): a method to accurately reconstruct dynamic CT images from highly undersampled projection data sets. , 2008, Medical physics.

[21]  Mathias Unberath,et al.  Deep Learning Computed Tomography: Learning Projection-Domain Weights From Image Domain in Limited Angle Problems , 2018, IEEE Transactions on Medical Imaging.

[22]  Jin Liu,et al.  Discriminative Feature Representation to Improve Projection Data Inconsistency for Low Dose CT Imaging , 2017, IEEE Transactions on Medical Imaging.

[23]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Li Zeng,et al.  ℓ 0 Gradient Minimization Based Image Reconstruction for Limited-Angle Computed Tomography , 2015, PloS one.

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  L. Feldkamp,et al.  Practical cone-beam algorithm , 1984 .

[27]  Mark A. Anastasio,et al.  Deep Learning-Guided Image Reconstruction from Incomplete Data , 2017, ArXiv.

[28]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[29]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[30]  Richard Kronland-Martinet,et al.  A real-time algorithm for signal analysis with the help of the wavelet transform , 1989 .

[31]  Hyojin Kim,et al.  Lose the Views: Limited Angle CT Reconstruction via Implicit Sinogram Completion , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Jong Chul Ye,et al.  Multi-Scale Wavelet Domain Residual Learning for Limited-Angle CT Reconstruction , 2017, ArXiv.

[33]  Huazhong Shu,et al.  Artifact Suppressed Dictionary Learning for Low-Dose CT Image Processing , 2014, IEEE Transactions on Medical Imaging.

[34]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..