Research on optimal skip connection scale in learning-based scattering imaging

Strong scattering media bring difficulties to imaging in many fields such as medicine and astronomy. The deep learning method has a powerful fitting ability, which can be better applied in reconstructing the target behind the scattering medium. But the detail of the reconstructed target is often inaccurate. In this paper, the skip connection is added in the neural network to improve the accuracy of the reconstructed detail. This network can combine pixel-level information with high-level semantic information, and the information missed during the encoding process can be more involved in the final reconstruction process. 1100 handwritten characters are used as the targets hidden behind the ground glass. It is found that the quality of the reconstructed target is different when the skip connection is added to the network at different scales. The feature map visualization method is used to help us analyze the role of the skip connection. Meanwhile, PSNR (Peak Signal to Noise Ratio) is also used as an objective evaluation standard to evaluate the quality of reconstructed targets. According to subjective and objective evaluation criteria, conclusions can be drawn that the detail of targets can be better retained when the skip connection is added between the convolutional layer corresponding to the feature map of the size 64*64, and the average PSNR can be enhanced 1 dB compared with the network without skip connections. This work provides a reference for the fusion methods of different scale features in the computational optical imaging.

[1]  Jing Han,et al.  Learning-based method to reconstruct complex targets through scattering medium beyond the memory effect. , 2020, Optics express.

[2]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[3]  J. Bertolotti,et al.  Non-invasive imaging through opaque scattering layers , 2012, Nature.

[4]  Sundeep Rangan,et al.  Compressive Phase Retrieval via Generalized Approximate Message Passing , 2014, IEEE Transactions on Signal Processing.

[5]  Lei Tian,et al.  Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media , 2018, Optica.

[6]  George Barbastathis,et al.  Imaging through glass diffusers using densely connected convolutional networks , 2017, Optica.

[7]  M. Fink,et al.  Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations , 2014, Nature Photonics.

[8]  J. Tanida,et al.  Learning-based imaging through scattering media. , 2016, Optics express.

[9]  Wonjun Choi,et al.  Transmission matrix of a scattering medium and its applications in biophotonics. , 2015, Optics express.

[10]  Huichang Zhuang,et al.  Imaging of objects through a thin scattering layer using a spectrally and spatially separated reference. , 2018, Optics express.

[11]  J. Tanida,et al.  Speckle-learning-based object recognition through scattering media. , 2015, Optics express.

[12]  Brandon K. Harvey,et al.  Direct wavefront sensing for high-resolution in vivo imaging in scattering tissue , 2015, Nature Communications.

[13]  Wenqi He,et al.  Imaging dynamic objects hidden behind scattering medium by retrieving the point spread function , 2018, Speckle: International Conference on Speckle Metrology.

[14]  Xiangsheng Xie,et al.  Depth detection capability and ultra-large depth of field in imaging through a thin scattering layer , 2019, Journal of Optics.