Shot Noise Reduction in Radiographic and Tomographic Multi-Channel Imaging with Self-Supervised Deep Learning

Noise is an important issue for radiographic and tomographic imaging techniques. It becomes particularly critical in applications where additional constraints force a strong reduction of the Signal-to-Noise Ratio (SNR) per image. These constraints may result from limitations on the maximum available flux or permissible dose and the associated restriction on exposure time. Often, a high SNR per image is traded for the ability to distribute a given total exposure capacity per pixel over multiple channels, thus obtaining additional information about the object by the same total exposure time. These can be energy channels in the case of spectroscopic imaging or time channels in the case of time-resolved imaging. In this paper, we report on a method for improving the quality of noisy multi-channel (time or energy-resolved) imaging datasets. The method relies on the recent Noise2Noise (N2N) self-supervised denoising approach that learns to predict a noise-free signal without access to noise-free data. N2N in turn requires drawing pairs of samples from a data distribution sharing identical signals while being exposed to different samples of random noise. The method is applicable if adjacent channels share enough information to provide images with similar enough information but independent noise. We demonstrate several representative case studies, namely spectroscopic (k-edge) X-ray tomography, in vivo X-ray cine-radiography, and energy-dispersive (Bragg edge) neutron tomography. In all cases, the N2N method shows dramatic improvement and outperforms conventional denoising methods. For such imaging techniques, the method can therefore significantly improve image quality, or maintain image quality with further reduced exposure time per image.

[1]  Florence Tupin,et al.  As If by Magic: Self-Supervised Training of Deep Despeckling Networks With MERLIN , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[2]  P. Milanfar,et al.  Interpretable Unsupervised Diversity Denoising and Artefact Removal , 2021, ICLR.

[3]  Ademola E. Ilesanmi,et al.  Methods for image denoising using convolutional neural network: a review , 2021, Complex & Intelligent Systems.

[4]  J. S. Jørgensen,et al.  Enhanced hyperspectral tomography for bioimaging by spatiospectral reconstruction , 2021, Scientific Reports.

[5]  William R B Lionheart,et al.  Crystalline phase discriminating neutron tomography using advanced reconstruction methods , 2021, Journal of Physics D: Applied Physics.

[6]  J. S. Jørgensen,et al.  Core Imaging Library - Part II: multichannel reconstruction for dynamic and spectral tomography , 2021, Philosophical Transactions of the Royal Society A.

[7]  Kris Thielemans,et al.  Core Imaging Library - Part I: a versatile Python framework for tomographic imaging , 2021, Philosophical Transactions of the Royal Society A.

[8]  Leopold Parts,et al.  Noise2Stack: Improving Image Restoration by Learning from Volumetric Data , 2020, MLMIR@MICCAI.

[9]  Phillip M Bentley,et al.  Instrument suite cost optimisation in a science megaproject , 2020, Journal of Physics Communications.

[10]  Tim Salditt,et al.  A phase-retrieval toolbox for X-ray holography and tomography , 2020, Journal of synchrotron radiation.

[11]  Fan Zhang,et al.  Brief review of image denoising techniques , 2019, Vis. Comput. Ind. Biomed. Art.

[12]  Loïc Royer,et al.  Noise2Self: Blind Denoising by Self-Supervision , 2019, ICML.

[13]  Florian Jug,et al.  Noise2Void - Learning Denoising From Single Noisy Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Radu Timofte,et al.  A Brief Review of Image Denoising Algorithms and Beyond , 2019, Inpainting and Denoising Challenges.

[15]  Ge Wang,et al.  Increased separability of K-edge nanoparticles by photon-counting detectors for spectral micro-CT. , 2018, Journal of X-ray science and technology.

[16]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[17]  Davide Micieli,et al.  Time-of-Flight Neutron Imaging on IMAT@ISIS: A New User Facility for Materials Science , 2018, J. Imaging.

[18]  Nuclear physics and reactor theory , 2014 .

[19]  Michael E. Fitzpatrick,et al.  Modelling of an imaging beamline at the ISIS pulsed neutron source , 2013 .

[20]  Tilo Baumbach,et al.  X-ray phase-contrast in vivo microtomography probes new aspects of Xenopus gastrulation , 2013, Nature.

[21]  J. V. Vallerga,et al.  High Resolution Photon Counting With MCP-Timepix Quad Parallel Readout Operating at $> 1~{\rm KHz}$ Frame Rates , 2013, IEEE Transactions on Nuclear Science.

[22]  Paul A. Rodríguez,et al.  Total Variation Regularization Algorithms for Images Corrupted with Different Noise Models: A Review , 2013, J. Electr. Comput. Eng..

[23]  Mirko Boin,et al.  nxs: a program library for neutron cross section calculations , 2012 .

[24]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[25]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[26]  John Banhart,et al.  Advances in neutron radiography and tomography , 2009 .

[27]  Graham R. Davis,et al.  A modelling approach to beam hardening correction , 2008, Optical Engineering + Applications.

[28]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[29]  Eberhard Lehmann,et al.  Energy-selective neutron transmission imaging at a pulsed source , 2007 .

[30]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[31]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[32]  A. Barty,et al.  Quantitative phase‐amplitude microscopy. III. The effects of noise , 2004, Journal of microscopy.

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[34]  Philip J. Withers,et al.  Engineering applications of Bragg-edge neutron transmission , 2002 .

[35]  S. Wilkins,et al.  Simultaneous phase and amplitude extraction from a single defocused image of a homogeneous object , 2002, Journal of microscopy.

[36]  Philip J. Withers,et al.  Time-of-flight neutron transmission diffraction , 2001 .

[37]  Richard J. Fitzgerald,et al.  Phase‐Sensitive X‐Ray Imaging , 2000 .

[38]  M. Glas,et al.  Principles of Computerized Tomographic Imaging , 2000 .

[39]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[40]  Sigurdur Helgason,et al.  The Radon transform on Euclidean spaces, compact two-point homogeneous spaces and Grassmann manifolds , 1965 .