Perceptually Driven Conditional GAN for Fourier Ptychography

Fourier Ptychography (FP) is a computational imaging technique which artificially increases the effective numerical aperture of an imaging system. In FP, the object is imaged using an array of Light Emitting Diodes (LEDs), each from a different illumination angle. A high resolution image is synthesized from this low resolution stack, typically using iterative phase retrieval algorithms. However, such algorithms are time consuming and fail when the overlap between the spectra of images is low, leading to high data requirements. At the crux of FP lies a phase retrieval problem. In this paper, we propose a Deep Learning (DL) algorithm to perform this synthesis under low spectral overlap between samples, and show a significant improvement in phase reconstruction over existing DL algorithms.

[1]  Ashok Veeraraghavan,et al.  Toward Long-Distance Subdiffraction Imaging Using Coherent Camera Arrays , 2015, IEEE Transactions on Computational Imaging.

[2]  Zeev Zalevsky,et al.  Space–bandwidth product of optical signals and systems , 1996 .

[3]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[4]  Brendan Ames,et al.  Solving ptychography with a convex relaxation , 2014, New journal of physics.

[5]  Michael Elad,et al.  The Little Engine That Could: Regularization by Denoising (RED) , 2016, SIAM J. Imaging Sci..

[6]  Richard G. Baraniuk,et al.  A Field Guide to Forward-Backward Splitting with a FASTA Implementation , 2014, ArXiv.

[7]  Aggelos K. Katsaggelos,et al.  Ptychnet: CNN based fourier ptychography , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[8]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[9]  Gene Cheung,et al.  SiGAN: Siamese Generative Adversarial Network for Identity-Preserving Face Hallucination , 2018, IEEE Transactions on Image Processing.

[10]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Lei Tian,et al.  A deep-learning approach for high-speed Fourier ptychographic microscopy , 2018 .

[13]  Vidya Ganapati,et al.  Illumination pattern design with deep learning for single-shot Fourier ptychographic microscopy. , 2018, Optics express.

[14]  Cordelia Schmid,et al.  Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search , 2008, ECCV.

[15]  Kaushik Mitra,et al.  Phase retrieval for Fourier Ptychography under varying amount of measurements , 2018, BMVC.

[16]  Naif Alajlan,et al.  Siamese-GAN: Learning Invariant Representations for Aerial Vehicle Image Categorization , 2018, Remote. Sens..

[17]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Richard G. Baraniuk,et al.  prDeep: Robust Phase Retrieval with a Flexible Deep Network , 2018, ICML.

[20]  R. Horstmeyer,et al.  Wide-field, high-resolution Fourier ptychographic microscopy , 2013, Nature Photonics.

[21]  David Berthelot,et al.  BEGAN: Boundary Equilibrium Generative Adversarial Networks , 2017, ArXiv.

[22]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[23]  Shaowei Jiang,et al.  Solving Fourier ptychographic imaging problems via neural network modeling and TensorFlow , 2018, Biomedical optics express.

[24]  R. Gerchberg.  A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .