A Completion Network for Reconstruction from Compressed Acquisition

We consider here the problem of reconstructing an image from a few linear measurements. This problem has many biomedical applications, such as computerized tomography, magnetic resonance imaging and optical microscopy. While this problem has long been solved by compressed sensing methods, these are now outperformed by deep-learning approaches. However, understanding why a given network architecture works well is still an open question. In this study, we proposed to interpret the reconstruction problem as a Bayesian completion problem where the missing measurements are estimated from those acquired. From this point of view, a network emerges that includes a fully connected layer that provides the best linear completion scheme. This network has a lot fewer parameters to learn than direct networks, and it trains more rapidly than image-domain networks that correct pseudo inverse solutions. Although, this study focuses on computational optics, it might provide some insight for inverse problems that have similar formulations.

[1]  C. R. Henderson,et al.  Best linear unbiased estimation and prediction under a selection model. , 1975, Biometrics.

[2]  Roderick Murray-Smith,et al.  Deep learning for real-time single-pixel video , 2018, Scientific Reports.

[3]  Andrea Farina,et al.  Adaptive Basis Scan by Wavelet Prediction for Single-Pixel Imaging , 2017, IEEE Transactions on Computational Imaging.

[4]  Xavier Intes,et al.  Compressive hyperspectral time-resolved wide-field fluorescence lifetime imaging. , 2017, Nature photonics.

[5]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[6]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[7]  Andrea Farina,et al.  Time-resolved multispectral imaging based on an adaptive single-pixel camera. , 2018, Optics express.

[8]  Miles J. Padgett,et al.  Principles and prospects for single-pixel imaging , 2018, Nature Photonics.

[9]  Henry Arguello,et al.  Compressive Coded Aperture Spectral Imaging: An Introduction , 2014, IEEE Signal Processing Magazine.

[10]  Sylvain Gioux,et al.  Single snapshot imaging of optical properties using a single-pixel camera: a simulation study , 2019, Journal of biomedical optics.

[11]  E. Candès,et al.  Compressive fluorescence microscopy for biological and hyperspectral imaging , 2012, Proceedings of the National Academy of Sciences.

[12]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[13]  Jonas Adler,et al.  Deep Bayesian Inversion , 2018, ArXiv.

[14]  Jeffrey A. Fessler,et al.  Image Reconstruction: From Sparsity to Data-Adaptive Methods and Machine Learning , 2019, Proceedings of the IEEE.