SSR-PR: Single-shot Super-Resolution Phase Retrieval based two prior calibration tests

We propose a novel approach and algorithm based on two preliminary tests of the optical system elements to enhance the super-resolved complex-valued imaging. The approach is developed for inverse phase imaging in a single-shot lensless optical setup. Imaging is based on wavefront modulation by a single binary phase mask. The preliminary tests compensate errors in the optical system and correct a carrying wavefront, reducing the gap between real-life experiments and computational modeling, which improve imaging significantly both qualitatively and quantitatively. These two tests are performed for observation of the laser beam and phase mask along, and might be considered as a preliminary system calibration. The corrected carrying wavefront is embedded into the proposed iterative Single-shot Super-Resolution Phase Retrieval (SSR-PR) algorithm. Improved initial diffraction pattern upsampling, and a combination of sparse and deep learning based filters achieves the super-resolved reconstructions. Simulations and physical experiments demonstrate the high-quality super-resolution phase imaging. In the simulations, we showed that the SSR-PR algorithm corrects the errors of the proposed optical system and reconstructs phase details 4× smaller than the sensor pixel size. In physical experiment 2 μm thick lines of USAF phase-target were resolved, which is almost 2× smaller than the sensor pixel size and corresponds to the smallest resolvable group of used test target. For phase bio-imaging, we provide Buccal Epithelial Cells reconstructed in computational super-resolution and the quality was of the same level as a digital holographic system with 40× magnification objective. Furthermore, the single-shot advantage provides the possibility to record dynamic scenes, where the framerate is limited only by the used camera. We provide an amplitude-phase video clip of a moving alive single-celled eukaryote.

[1]  J. Astola,et al.  Sparse ptychographical coherent diffractive imaging from noisy measurements. , 2013, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  P. Nellist,et al.  Low-dose phase retrieval of biological specimens using cryo-electron ptychography , 2020, Nature Communications.

[3]  A. A. Zhikhoreva,et al.  Determination of the refractive index of dehydrated cells by means of digital holographic microscopy , 2017, Technical Physics Letters.

[4]  Luc Van Gool,et al.  Plug-and-Play Image Restoration With Deep Denoiser Prior , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  D. Sayre Some implications of a theorem due to Shannon , 1952 .

[6]  Alessandro Foi,et al.  Collaborative Filtering of Correlated Noise: Exact Transform-Domain Variance for Improved Shrinkage and Patch Matching , 2020, IEEE Transactions on Image Processing.

[7]  H. Johnson,et al.  A comparison of 'traditional' and multimedia information systems development practices , 2003, Inf. Softw. Technol..

[8]  Vladimir Katkovnik,et al.  Extended DoF and achromatic inverse imaging for lens and lensless MPM camera based on Wiener filtering of defocused OTFs , 2021 .

[9]  Vladimir Katkovnik,et al.  Single exposure lensless subpixel phase imaging: optical system design, modelling, and experimental study. , 2020, Optics express.

[10]  B. N. Madhukar,et al.  Lanczos Resampling for the Digital Processing of Remotely Sensed Images , 2013 .

[11]  James R. Fienup,et al.  Phase retrieval with continuous version of hybrid input-output , 2003 .

[12]  R. Gerchberg Super-resolution through Error Energy Reduction , 1974 .

[13]  Jacob T. Robinson,et al.  PhlatCam: Designed Phase-Mask Based Thin Lensless Camera , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Changhuei Yang,et al.  Concept, implementations and applications of Fourier ptychography , 2021, Nature Reviews Physics.

[15]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[16]  Chao Zuo,et al.  Lensfree dynamic super-resolved phase imaging based on active micro-scanning. , 2018, Optics letters.

[17]  Gonçalo Valadão,et al.  PUMA : Phase Unwrapping via MAx flows , 2007 .

[18]  Jun Tanida,et al.  Subpixel reconstruction for single-shot phase imaging with coded diffraction. , 2017, Applied optics.

[19]  J. Miao,et al.  Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens , 1999, Nature.

[20]  Ladimir,et al.  Computational super-resolution phase retrieval from multiple phase-coded diffraction patterns : simulation study and experiments , 2017 .

[21]  Shaowei Jiang,et al.  Wide-field, high-resolution lensless on-chip microscopy via near-field blind ptychographic modulation. , 2020, Lab on a chip.

[22]  Xiao-lu Ge,et al.  High-resolution quantitative phase imaging based on a spatial light modulator and incremental binary random sampling. , 2020, Applied optics.

[23]  Thomas Strohmer,et al.  The numerics of phase retrieval , 2020, Acta Numerica.

[24]  Ick,et al.  DiffuserCam : Lensless Single-exposure 3 D Imaging , 2017 .

[25]  A. Yacoot,et al.  Phase calibration target for quantitative phase imaging with ptychography. , 2016, Optics express.

[26]  Lei Su,et al.  Characterization of an imaging multimode optical fiber using a digital micro-mirror device based single-beam system. , 2018, Optics express.

[27]  J. Goodman Introduction to Fourier optics , 1969 .

[28]  Extreme ultraviolet lensless imaging without object support through rotational diversity in diffractive shearing interferometry. , 2020, Optics express.

[29]  Hangjian Ling Three-dimensional measurement of a particle field using phase retrieval digital holography. , 2020, Applied optics.

[30]  Hanfei Yan Ptychographic phase-retrieval by proximal algorithms , 2019 .

[31]  Alessandro Foi,et al.  Joint Removal of Random and Fixed-Pattern Noise Through Spatiotemporal Video Filtering , 2014, IEEE Transactions on Image Processing.

[32]  Yonina C. Eldar,et al.  Phase Retrieval with Application to Optical Imaging: A contemporary overview , 2015, IEEE Signal Processing Magazine.

[33]  Karen O. Egiazarian,et al.  Single exposure lensless subpixel phase imaging , 2019, Other Conferences.

[34]  T. Tahara,et al.  Multiwavelength three-dimensional microscopy with spatially incoherent light, based on computational coherent superposition. , 2020, Optics letters.

[35]  Ronald M. Berndt,et al.  A Contemporary Overview , 1988 .

[36]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Fucai Zhang,et al.  Phase retrieval by coherent modulation imaging , 2016, Nature Communications.

[38]  Nikolay V. Petrov,et al.  Comparison of digital holography and iterative phase retrieval methods for wavefront reconstruction , 2014, Photonics Asia.

[39]  Paulo Amorim,et al.  Medical image interpolation based on 3D Lanczos filtering , 2020, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[40]  Guoan Zheng,et al.  Subsampled phase retrieval for temporal resolution enhancement in lensless on-chip holographic video. , 2017, Biomedical optics express.

[41]  Bahram Javidi,et al.  Single exposure super-resolution compressive imaging by double phase encoding. , 2010, Optics express.

[42]  Jianqiang Zhu,et al.  Single shot multi-wavelength phase retrieval with coherent modulation imaging. , 2018, Optics letters.

[43]  Guofan Jin,et al.  Single-shot lensless imaging with fresnel zone aperture and incoherent illumination , 2020, Light, science & applications.

[44]  D. Gabor A New Microscopic Principle , 1948, Nature.

[45]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[46]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[47]  Yukio Takahashi,et al.  Single-frame coherent diffraction imaging of extended objects using triangular aperture. , 2021, Optics express.

[48]  Andy Lambrechts,et al.  Color lens-free imaging using multi-wavelength illumination based phase retrieval. , 2020, Optics express.

[49]  Vladimir Katkovnik,et al.  High-accuracy off-axis wavefront reconstruction from noisy data: local least square with multiple adaptive windows. , 2016, Optics express.

[50]  J. Astola,et al.  High-accuracy wave field reconstruction: decoupled inverse imaging with sparse modeling of phase and amplitude. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[51]  Zhengjun Liu,et al.  A coherent diffraction imaging by using an iterative phase retrieval with multiple patterns at several directions , 2019, Optical and Quantum Electronics.