Unsupervised denoising for sparse multi-spectral computed tomography

—Multi-energy computed tomography (CT) with pho- ton counting detectors (PCDs) enables spectral imaging as PCDs can assign the incoming photons to specific energy channels. However, PCDs with many spectral channels drastically increase the computational complexity of the CT reconstruction, and bespoke reconstruction algorithms need fine-tuning to varying noise statistics. Especially if many projections are taken, a large amount of data has to be collected and stored. Sparse view CT is one solution for data reduction. However, these issues are especially exacerbated when sparse imaging scenarios are encountered due to a significant reduction in photon counts. In this work, we investigate the suitability of learning-based improvements to the challenging task of obtaining high-quality reconstructions from sparse measurements for a 64-channel PCD-CT. In particular, to overcome missing reference data for the training procedure, we propose an unsupervised denoising and artefact removal approach by exploiting different filter functions in the reconstruction and an explicit coupling of spectral channels with the nuclear norm. Performance is assessed on both simulated synthetic data and the openly available experimental Multi-Spectral Imaging via Computed Tomography (MUSIC) dataset. We compared the quality of our unsupervised method to iterative total nuclear variation regularized reconstructions and a supervised denoiser trained with reference data. We show that improved reconstruction quality can be achieved with flexibility on noise statistics and effective suppression of streaking artefacts when using unsupervised denoising with spectral coupling.

[1]  P. Maass,et al.  An Educated Warm Start For Deep Image Prior-Based Micro CT Reconstruction , 2021, 2111.11926.

[2]  F. Marone,et al.  Deep denoising for multi-dimensional synchrotron X-ray tomography without high-quality reference data , 2021, Scientific Reports.

[3]  Byeongjoon Kim,et al.  Weakly-supervised progressive denoising with unpaired CT images , 2021, Medical Image Anal..

[4]  Johannes R. Sveinsson,et al.  Hyperspectral Image Denoising Using SURE-Based Unsupervised Convolutional Neural Networks , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Simon R. Arridge,et al.  Material Decomposition in Spectral CT Using Deep Learning: A Sim2Real Transfer Approach , 2020, IEEE Access.

[6]  H. Poulsen,et al.  System-independent material classification through X-ray attenuation decomposition from spectral X-ray CT , 2020 .

[7]  Søren Kimmer Schou Gregersen,et al.  Sparse-View Spectral CT Reconstruction Using Deep Learning , 2020, ArXiv.

[8]  Se Young Chun,et al.  Unsupervised Training of Denoisers for Low-Dose CT Reconstruction Without Full-Dose Ground Truth , 2020, IEEE Journal of Selected Topics in Signal Processing.

[9]  J. Dudák High-resolution X-ray imaging applications of hybrid-pixel photon counting detectors Timepix , 2020 .

[10]  F. Becce,et al.  Detection and Characterization of Monosodium Urate and Calcium Hydroxyapatite Crystals Using Spectral Photon-Counting Radiography: A Proof-of-Concept Study. , 2020, European journal of radiology.

[11]  J Abascal,et al.  Material Decomposition Problem in Spectral CT: A Transfer Deep Learning Approach , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging Workshops (ISBI Workshops).

[12]  Maximilian Schmidt,et al.  Computed tomography reconstruction using deep image prior and learned reconstruction methods , 2020, Inverse Problems.

[13]  K. Batenburg,et al.  Noise2Inverse: Self-Supervised Deep Convolutional Denoising for Tomography , 2020, IEEE Transactions on Computational Imaging.

[14]  Matti Kauppinen,et al.  Framework for Photon Counting Quantitative Material Decomposition , 2020, IEEE Transactions on Medical Imaging.

[15]  Simon R. Arridge,et al.  Multi-Scale Learned Iterative Reconstruction , 2019, IEEE Transactions on Computational Imaging.

[16]  Ville Kolehmainen,et al.  Joint reconstruction in low dose multi-energy CT , 2019, Inverse Problems & Imaging.

[17]  Ge Wang,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With a Hybrid Loss Function for Noise Learning , 2020, IEEE Access.

[18]  U. L. Olsen,et al.  Method for system-independent material characterization from spectral X-ray CT , 2019, NDT & E International.

[19]  Shuai Leng,et al.  Photon-counting Detector CT: System Design and Clinical Applications of an Emerging Technology. , 2019, Radiographics : a review publication of the Radiological Society of North America, Inc.

[20]  Wail Mustafa,et al.  Multi-Spectral Imaging via Computed Tomography (MUSIC) - Comparing Unsupervised Spectral Segmentations for Material Differentiation , 2018, ArXiv.

[21]  Richard G. Baraniuk,et al.  Unsupervised Learning with Stein's Unbiased Risk Estimator , 2018, ArXiv.

[22]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[23]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[24]  D. P. Clark,et al.  Multi-energy CT decomposition using convolutional neural networks , 2018, Medical Imaging.

[25]  Hongming Shan,et al.  3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network , 2018, IEEE Transactions on Medical Imaging.

[26]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[27]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[28]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[29]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[30]  Philip J. Withers,et al.  TomoPhantom, a software package to generate 2D-4D analytical phantoms for CT image reconstruction algorithm benchmarks , 2018, SoftwareX.

[31]  Daniël M Pelt,et al.  A mixed-scale dense convolutional neural network for image analysis , 2017, Proceedings of the National Academy of Sciences.

[32]  Mark Lyksborg,et al.  Multispectral x-ray CT: multivariate statistical analysis for efficient reconstruction , 2017, Optical Engineering + Applications.

[33]  Katsuyuki Taguchi,et al.  Estimation of Basis Line-Integrals in a Spectral Distortion-Modeled Photon Counting Detector Using Low-Rank Approximation-Based X-Ray Transmittance Modeling: K-Edge Imaging Application , 2017, IEEE Transactions on Medical Imaging.

[34]  Jonas Adler,et al.  Solving ill-posed inverse problems using iterative deep neural networks , 2017, ArXiv.

[35]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[36]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[37]  Xuanqin Mou,et al.  Tensor-Based Dictionary Learning for Spectral CT Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[38]  Kristian Bredies,et al.  Joint MR-PET Reconstruction Using a Multi-Channel Image Regularizer , 2017, IEEE Transactions on Medical Imaging.

[39]  Jan Sijbers,et al.  Fast and flexible X-ray tomography using the ASTRA toolbox. , 2016, Optics express.

[40]  Amir Pourmorteza,et al.  Abdominal Imaging with Contrast-enhanced Photon-counting CT: First Human Experience. , 2016, Radiology.

[41]  Jan Sijbers,et al.  The ASTRA Toolbox: A platform for advanced algorithm development in electron tomography. , 2015, Ultramicroscopy.

[42]  Toby P. Breckon,et al.  Materials-based 3D segmentation of unknown objects from dual-energy computed tomography imagery in baggage security screening , 2015, Pattern Recognit..

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Taly Gilat Schmidt,et al.  Experimental comparison of empirical material decomposition methods for spectral CT , 2015, Physics in medicine and biology.

[45]  Mats Danielsson,et al.  Theoretical Comparison of a Dual Energy System and Photon Counting Silicon Detector Used for Material Quantification in Spectral CT , 2015, IEEE Transactions on Medical Imaging.

[46]  Patrick J La Rivière,et al.  Joint reconstruction of multi-channel, spectral CT data via constrained total nuclear variation minimization , 2014, Physics in medicine and biology.

[47]  David Atkinson,et al.  Joint reconstruction of PET-MRI by exploiting structural similarity , 2014, Inverse Problems.

[48]  Eric L. Miller,et al.  Tensor-Based Formulation and Nuclear Norm Regularization for Multienergy Computed Tomography , 2013, IEEE Transactions on Image Processing.

[49]  Charles A. Bouman,et al.  Model-based CT Reconstruction from Sparse Views , 2013 .