Synchronous image reconstruction and depth information prediction through scattering media via multi-task network

Speckle signal is composed of a multitude of independently phased additive complex components. Because of scattering degradation, it is difficult to capture the object-related message. We present a novel deep learning method to reconstruct the object image and get depth information synchronously. The experimental result shows that our method can not only restore speckle patterns in a different position but also obtain over-rang object depth information accurately. Our method broadens the way to acquire multiple physical information about complex scattering conditions and accelerate the application of speckle in practice.

[1]  Lei Tian,et al.  Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media , 2018, Optica.

[2]  S R Arridge,et al.  Recent advances in diffuse optical imaging , 2005, Physics in medicine and biology.

[3]  S. Popoff,et al.  Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. , 2009, Physical review letters.

[4]  Xiangsheng Xie,et al.  Depth detection capability and ultra-large depth of field in imaging through a thin scattering layer , 2019, Journal of Optics.

[5]  M. Fink,et al.  Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations , 2014, Nature Photonics.

[6]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[7]  Florent Krzakala,et al.  Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques. , 2015, Optics express.

[8]  AMIR PORAT,et al.  Widefield lensless imaging through a fiber bundle via speckle correlations. , 2016, Optics express.

[9]  J. Bertolotti,et al.  Non-invasive imaging through opaque scattering layers , 2012, Nature.

[10]  Hao Wang,et al.  Exploit imaging through opaque wall via deep learning , 2017, ArXiv.

[11]  G Indebetouw,et al.  Imaging through scattering media with depth resolution by use of low-coherence gating in spatiotemporal digital holography. , 2000, Optics letters.

[12]  Xiaoqing Xu,et al.  Extended depth-resolved imaging through a thin scattering medium with PSF manipulation , 2018, Scientific Reports.

[13]  V. Ntziachristos.  Going deeper than microscopy: the optical imaging frontier in biology , 2010, Nature Methods.

[14]  Guihua Zeng,et al.  Image reconstruction through dynamic scattering media based on deep learning. , 2019, Optics express.