Photon-limited imaging through scattering medium based on deep learning.

Imaging under ultra-weak light conditions is affected by Poisson noise heavily. The problem becomes worse if a scattering media is present in the optical path. Speckle patterns detected under ultra-weak light condition carry very little information which makes it difficult to reconstruct the image. Off-the-shelf methods are no longer available in this condition. In this paper, we experimentally demonstrate the use of a deep learning network to reconstruct images through scattering media under ultra-weak light illumination. The weak light limitation of this method is analyzed. The random Poisson detection under weak light condition obtains partial information of the object. Based on this property, we demonstrated better performance of our method by enlarging the training dataset with multiple detections of the speckle patterns. Our results demonstrate that our approach can reconstruct images through scattering media from close to 1 detected signal photon per pixel (PPP) per image.

[1]  J. Tanida,et al.  Learning-based imaging through scattering media. , 2016, Optics express.

[2]  George Barbastathis,et al.  Low Photon Count Phase Retrieval Using Deep Learning. , 2018, Physical review letters.

[3]  J. Tanida,et al.  Speckle-learning-based object recognition through scattering media. , 2015, Optics express.

[4]  E. Diamanti,et al.  High-efficiency photon-number detection for quantum information processing , 2003, quant-ph/0308054.

[5]  Wonjun Choi,et al.  Transmission matrix of a scattering medium and its applications in biophotonics. , 2015, Optics express.

[6]  George Barbastathis,et al.  Imaging through glass diffusers using densely connected convolutional networks , 2017, Optica.

[7]  W. Brockherde,et al.  100 000 Frames/s 64 × 32 Single-Photon Detector Array for 2-D Imaging and 3-D Ranging , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[8]  AMIR PORAT,et al.  Widefield lensless imaging through a fiber bundle via speckle correlations. , 2016, Optics express.

[9]  Navid Borhani,et al.  Learning to see through multimode fibers , 2018, Optica.

[10]  Raja Giryes,et al.  Class-Aware Fully Convolutional Gaussian and Poisson Denoising , 2018, IEEE Transactions on Image Processing.

[11]  Sylvain Gigan,et al.  Image transmission through an opaque material. , 2010, Nature communications.

[12]  Robert D. Nowak,et al.  Multiscale Modeling and Estimation of Poisson Processes with Application to Photon-Limited Imaging , 1999, IEEE Trans. Inf. Theory.

[13]  Changhuei Yang,et al.  Guidestar-assisted wavefront-shaping methods for focusing light into biological tissue , 2015, Nature Photonics.

[14]  M. Fink,et al.  Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations , 2014, Nature Photonics.

[15]  Robert W. Boyd,et al.  Imaging with a small number of photons , 2014, Nature Communications.

[16]  S. Popoff,et al.  Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. , 2009, Physical review letters.

[17]  Guihua Zeng,et al.  Image reconstruction through dynamic scattering media based on deep learning. , 2019, Optics express.

[18]  N. Engheta,et al.  Polarization-difference imaging: a biologically inspired technique for observation through scattering media. , 1995, Optics letters.

[19]  Yan Zhu,et al.  Photon-limited face image super-resolution based on deep learning. , 2018, Optics express.

[20]  R. R. Alfano,et al.  Methods for Detecting Weak Light Signals , 1968 .

[21]  Ivan Vishniakou,et al.  Light scattering control in transmission and reflection with neural networks. , 2018, Optics express.

[22]  Yibo Zhang,et al.  Deep Learning Microscopy , 2017, ArXiv.

[23]  A. Ozcan,et al.  Deep learning enables cross-modality super-resolution in fluorescence microscopy , 2018, Nature Methods.

[24]  Daniele Faccio,et al.  Transmission of natural scene images through a multimode fibre , 2019, Nature Communications.

[25]  Shuai Li,et al.  Lensless computational imaging through deep learning , 2017, ArXiv.

[26]  Ramesh Raskar,et al.  Object classification through scattering media with deep learning on time resolved measurement. , 2017, Optics express.

[27]  J. Bertolotti,et al.  Non-invasive imaging through opaque scattering layers , 2012, Nature.

[28]  Rebecca Willett,et al.  Poisson Noise Reduction with Non-local PCA , 2012, Journal of Mathematical Imaging and Vision.

[29]  Ioannis N. Papadopoulos,et al.  The generalized optical memory effect , 2017, 1705.01373.

[30]  Lei Tian,et al.  Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media , 2018, Optica.