Learning-based approaches for reconstructions with inexact operators in nanoCT applications

Imaging problems such as the one in nanoCT require the solution of an inverse problem, where it is often taken for granted that the forward operator, i.e., the underlying physical model, is properly known. In the present work we address the problem where the forward model is inexact due to stochastic or deterministic deviations during the measurement process. We particularly investigate the performance of non-learned iterative reconstruction methods dealing with inexactness and learned reconstruction schemes, which are based on U-Nets and conditional invertible neural networks. The latter also provide the opportunity for uncertainty quantification. A synthetic large data set in line with a typical nanoCT setting is provided and extensive numerical experiments are conducted evaluating the proposed methods.

[1]  Jenni Raitoharju,et al.  Computer Vision on X-Ray Data in Industrial Production and Security Applications: A Comprehensive Survey , 2022, IEEE Access.

[2]  F. Mücklich,et al.  A FIB-SEM Based Correlative Methodology for X-Ray Nanotomography and Secondary Ion Mass Spectrometry: An Application Example in Lithium Batteries Research , 2022, Microscopy and Microanalysis.

[3]  Brian Nett,et al.  A Review of Deep Learning CT Reconstruction: Concepts, Limitations, and Promise in Clinical Practice , 2022, Current Radiology Reports.

[4]  Masashi Sugiyama,et al.  Universal approximation property of invertible neural networks , 2022, J. Mach. Learn. Res..

[5]  Lars Omlor,et al.  Improving throughput and image quality of high-resolution 3D X-ray microscopes using deep learning reconstruction techniques , 2022, e-Journal of Nondestructive Testing.

[6]  Peter Maass,et al.  Conditional Invertible Neural Networks for Medical Imaging , 2021, J. Imaging.

[7]  Anne Wald,et al.  Inverse problems with inexact forward operator: iterative regularization and application in dynamic imaging , 2020, Inverse Problems.

[8]  Jong Chul Ye,et al.  Deep learning for tomographic image reconstruction , 2020, Nature Machine Intelligence.

[9]  Tianlin Liu,et al.  Learning Multiscale Convolutional Dictionaries for Image Reconstruction , 2020, IEEE Transactions on Computational Imaging.

[10]  Rihuan Ke,et al.  iUNets: Learnable Invertible Up- and Downsampling for Large-Scale Inverse Problems , 2020, 2020 IEEE 30th International Workshop on Machine Learning for Signal Processing (MLSP).

[11]  Nicholas Zabaras,et al.  Solving inverse problems using conditional invertible neural networks , 2020, J. Comput. Phys..

[12]  Masashi Sugiyama,et al.  Coupling-based Invertible Neural Networks Are Universal Diffeomorphism Approximators , 2020, NeurIPS.

[13]  Peter Maass,et al.  Conditional Normalizing Flows for Low-Dose Computed Tomography Image Reconstruction , 2020, 2006.06270.

[14]  Andreas Hauptmann,et al.  On Learned Operator Correction in Inverse Problems , 2020, SIAM J. Imaging Sci..

[15]  Tobias Kluth,et al.  Joint super-resolution image reconstruction and parameter identification in imaging operator: analysis of bilinear operator equations, numerical solution, and application to magnetic particle imaging , 2020, Inverse Problems.

[16]  Max Welling,et al.  Learning Likelihoods with Conditional Normalizing Flows , 2019, ArXiv.

[17]  Lei Zhu,et al.  Jitter correction for transmission X-ray microscopy via measurement of geometric moments. , 2019, Journal of synchrotron radiation.

[18]  Han Zhang,et al.  Approximation Capabilities of Neural ODEs and Invertible Residual Networks , 2019, ICML.

[19]  Ullrich Köthe,et al.  Guided Image Generation with Conditional Invertible Neural Networks , 2019, ArXiv.

[20]  T. Zikmund,et al.  Voxel size and calibration for CT measurements with a small field of view , 2019, e-Journal of Nondestructive Testing.

[21]  Jens Behrmann,et al.  Invertible Residual Networks , 2018, ICML.

[22]  Guang Li,et al.  CT Super-Resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble (GAN-CIRCLE) , 2018, IEEE Transactions on Medical Imaging.

[23]  Zhanxing Zhu,et al.  SIPID: A deep learning framework for sinogram interpolation and image denoising in low-dose CT reconstruction , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[24]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[25]  T Salditt,et al.  Four dimensional material movies: High speed phase-contrast tomography by backprojection along dynamically curved paths , 2017, Scientific Reports.

[26]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[27]  Kenji Suzuki,et al.  Overview of deep learning in medical imaging , 2017, Radiological Physics and Technology.

[28]  Jonas Adler,et al.  Solving ill-posed inverse problems using iterative deep neural networks , 2017, ArXiv.

[29]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[30]  Samy Bengio,et al.  Density estimation using Real NVP , 2016, ICLR.

[31]  Jan Sijbers,et al.  The ASTRA Toolbox: A platform for advanced algorithm development in electron tomography. , 2015, Ultramicroscopy.

[32]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[33]  Yoshua Bengio,et al.  NICE: Non-linear Independent Components Estimation , 2014, ICLR.

[34]  Ronny Ramlau,et al.  A double regularization approach for inverse problems with noisy data and inexact operator , 2013 .

[35]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[36]  Bernhard Gleich,et al.  Tomographic imaging using the nonlinear response of magnetic particles , 2005, Nature.

[37]  Gene H. Golub,et al.  Tikhonov Regularization and Total Least Squares , 1999, SIAM J. Matrix Anal. Appl..

[38]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[39]  Jenni Raitoharju,et al.  Computer Vision on X-ray Data in Industrial Production and Security Applications: A survey , 2022, ArXiv.

[40]  M. Zibulevsky,et al.  Sequential Subspace Optimization Method for Large-Scale Unconstrained Problems , 2005 .

[41]  A. Tarantola,et al.  Inverse problems = Quest for information , 1982 .