Deep learning methods to guide CT image reconstruction and reduce metal artifacts

The rapidly-rising field of machine learning, including deep learning, has inspired applications across many disciplines. In medical imaging, deep learning has been primarily used for image processing and analysis. In this paper, we integrate a convolutional neural network (CNN) into the computed tomography (CT) image reconstruction process. Our first task is to monitor the quality of CT images during iterative reconstruction and decide when to stop the process according to an intelligent numerical observer instead of using a traditional stopping rule, such as a fixed error threshold or a maximum number of iterations. After training on ground truth images, the CNN was successful in guiding an iterative reconstruction process to yield high-quality images. Our second task is to improve a sinogram to correct for artifacts caused by metal objects. A large number of interpolation and normalization-based schemes were introduced for metal artifact reduction (MAR) over the past four decades. The NMAR algorithm is considered a state-of-the-art method, although residual errors often remain in the reconstructed images, especially in cases of multiple metal objects. Here we merge NMAR with deep learning in the projection domain to achieve additional correction in critical image regions. Our results indicate that deep learning can be a viable tool to address CT reconstruction challenges.

[1]  P. Keall,et al.  Dosimetric considerations for patients with HIP prostheses undergoing pelvic irradiation. Report of the AAPM Radiation Therapy Committee Task Group 63. , 2003, Medical physics.

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[4]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[5]  Rainer Raupach,et al.  Normalized metal artifact reduction (NMAR) in computed tomography. , 2010, Medical physics.

[6]  G. Ding,et al.  A study on beams passing through hip prosthesis for pelvic radiation treatment. , 2001, International journal of radiation oncology, biology, physics.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[9]  N. Ebraheim,et al.  Reduction of postoperative CT artifacts of pelvic fractures by use of titanium implants. , 1990, Orthopedics.

[10]  K Freeman,et al.  CT scans through metal scanning technique versus hardware composition. , 1994, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[11]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.