Classification and reconstruction of spatially overlapping phase images using diffractive optical networks

Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report the design of diffractive optical networks for the classification and reconstruction of spatially overlapping, phase-encoded objects. When two different phase-only objects spatially overlap, the individual object functions are perturbed since their phase patterns are summed up. The retrieval of the underlying phase images from solely the overlapping phase distribution presents a challenging problem, the solution of which is generally not unique. We show that through a task-specific training process, passive diffractive networks composed of successive transmissive layers can all-optically and simultaneously classify two different randomly-selected, spatially overlapping phase images at the input. After trained with ~550 million unique combinations of phase-encoded handwritten digits from the MNIST dataset, our blind testing results reveal that the diffractive network achieves an accuracy of >85.8% for alloptical classification of two overlapping phase images of new handwritten digits. In addition to all-optical classification of overlapping phase objects, we also demonstrate the reconstruction of these phase images based on a shallow electronic neural network that uses the highly compressed output of the diffractive network as its input (with e.g., ~20-65 times less number of pixels) to rapidly reconstruct both of the phase images, despite their spatial overlap and related phase ambiguity. The presented phase image classification and reconstruction framework might find applications in e.g., computational imaging, microscopy and quantitative phase imaging fields.

[1]  Qionghai Dai,et al.  Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit , 2020, Nature Photonics.

[2]  B. Sensale‐Rodriguez,et al.  Real-time multi-task diffractive deep neural networks via hardware-software co-design , 2021, Scientific Reports.

[3]  John L. Wyatt,et al.  The Softmax Nonlinearity: Derivation Using Statistical Mechanics and Useful Properties as a Multiterminal Analog Circuit Element , 1993, NIPS.

[4]  A. Ozcan,et al.  Misalignment resilient diffractive optical networks , 2020, Nanophotonics.

[5]  Yi Luo,et al.  Class-specific differential detection in diffractive optical neural networks improves inference accuracy , 2019, Advanced Photonics.

[6]  Yang Gao,et al.  Optical machine learning with incoherent light and a single-pixel detector , 2019, Optics letters.

[7]  Feng Xu,et al.  Fourier-space Diffractive Deep Neural Network. , 2019, Physical review letters.

[8]  A. Ozcan,et al.  Spectrally encoded single-pixel machine vision using diffractive networks , 2021, Science Advances.

[9]  Qiming Zhang,et al.  Nanoprinted high-neuron-density optical linear perceptrons performing near-infrared inference on a CMOS chip , 2021, Light: Science & Applications.

[10]  Yi Luo,et al.  Design of task-specific optical systems using broadband diffractive neural networks , 2019, Light, science & applications.

[11]  Gordon Wetzstein,et al.  Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification , 2018, Scientific Reports.

[12]  Aydogan Ozcan,et al.  All-Optical Information Processing Capacity of Diffractive Surfaces , 2020, ArXiv.

[13]  Jian Xu,et al.  Performing optical logic operations by a diffractive neural network , 2020, Light: Science & Applications.

[14]  Md Sadman Sakib Rahman,et al.  Computer-Free, All-Optical Reconstruction of Holograms Using Diffractive Networks , 2021, ACS Photonics.

[15]  Yi Luo,et al.  Analysis of Diffractive Optical Neural Networks and Their Integration With Electronic Neural Networks , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[16]  Aydogan Ozcan,et al.  Computational imaging without a computer: seeing through random diffusers at the speed of light , 2021, eLight.

[17]  Eli Shlizerman,et al.  An Optical Frontend for a Convolutional Neural Network , 2018, Applied optics.

[18]  Muhammed Veli,et al.  Terahertz pulse shaping using diffractive surfaces , 2020, Nature communications.

[19]  Shuqing Chen,et al.  All-Optical Signal Processing of Vortex Beams with Diffractive Deep Neural Networks , 2021 .

[20]  Aydogan Ozcan,et al.  Ensemble learning of diffractive optical networks , 2020, Light: Science & Applications.

[21]  A. Ozcan,et al.  Scale-, shift- and rotation-invariant diffractive optical networks , 2020, ACS Photonics.

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Mingce Chen,et al.  Anti-noise diffractive neural network for constructing an intelligent imaging detector array. , 2020, Optics express.

[24]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[25]  Soon Thor Lim,et al.  Photonic Convolutional Neural Networks Using Integrated Diffractive Optics , 2020, IEEE Journal of Selected Topics in Quantum Electronics.