Fourier-space Diffractive Deep Neural Network.

In this Letter we propose the Fourier-space diffractive deep neural network (F-D^{2}NN) for all-optical image processing that performs advanced computer vision tasks at the speed of light. The F-D^{2}NN is achieved by placing the extremely compact diffractive modulation layers at the Fourier plane or both Fourier and imaging planes of an optical system, where the optical nonlinearity is introduced from ferroelectric thin films. We demonstrated that F-D^{2}NN can be trained with deep learning algorithms for all-optical saliency detection and high-accuracy object classification.

[1]  Joni Dambre,et al.  Trainable hardware for dynamical computing using error backpropagation through physical media , 2014, Nature Communications.

[2]  Ata Chizari,et al.  Analog optical computing based on a dielectric meta-reflect array. , 2016, Optics letters.

[3]  D. J. Moss,et al.  On-chip CMOS-compatible all-optical integrator , 2010, Nature communications.

[4]  Ling Shao,et al.  Video Salient Object Detection via Fully Convolutional Networks , 2017, IEEE Transactions on Image Processing.

[5]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[6]  Yong‐Lai Zhang,et al.  Designable 3D nanofabrication by femtosecond laser direct writing , 2010 .

[7]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[8]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[9]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[10]  Bahram Jalali,et al.  Analog optical computing , 2015, Nature Photonics.

[11]  N. Engheta,et al.  Inverse-designed metastructures that solve equations , 2019, Science.

[12]  Shanhui Fan,et al.  Photonic crystal slab Laplace operator for image differentiation , 2018 .

[13]  Anders Pors,et al.  Analog computing using reflective plasmonic metasurfaces. , 2015, Nano letters.

[14]  Indranil Chakraborty,et al.  Toward Fast Neural Computing using All-Photonic Phase Change Spiking Neurons , 2018, Scientific Reports.

[15]  D. Psaltis,et al.  Holography in artificial neural networks , 1990, Nature.

[16]  Shanhui Fan,et al.  Plasmonic computing of spatial differentiation , 2017, Nature Communications.

[17]  R. Horstmeyer,et al.  Wide-field, high-resolution Fourier ptychographic microscopy , 2013, Nature Photonics.

[18]  Ellen Zhou,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2017, Scientific Reports.

[19]  Shanhui Fan,et al.  Training of Photonic Neural Networks through In Situ Backpropagation , 2018, 2019 Conference on Lasers and Electro-Optics (CLEO).

[20]  Sae Woo Nam,et al.  Superconducting optoelectronic circuits for neuromorphic computing , 2016, ArXiv.

[21]  Shanhui Fan,et al.  A Photonic Crystal Slab Laplace Differentiator , 2017, 2018 Conference on Lasers and Electro-Optics (CLEO).

[22]  David J. Brady,et al.  Multiscale gigapixel photography , 2012, Nature.

[23]  Bhavin J. Shastri,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2016, Scientific Reports.

[24]  Min Gu,et al.  Three-dimensional femtosecond laser nanolithography of crystals , 2018, Nature Photonics.

[25]  L. Waller,et al.  Phase-space measurement and coherence synthesis of optical beams , 2012, Nature Photonics.

[26]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[27]  Laurent Larger,et al.  Reinforcement Learning in a large scale photonic Recurrent Neural Network , 2017, Optica.

[28]  Andrea Alù,et al.  Nonlocal Metasurfaces for Optical Signal Processing. , 2018, Physical review letters.

[29]  M. Segev,et al.  Theory Of Incoherent Self-focusing In Biased Photorefractive Media , 1997, QELS '97., Summaries of Papers Presented at the Quantum Electronics and Laser Science Conference.

[30]  Gordon Wetzstein,et al.  Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification , 2018, Scientific Reports.

[31]  Deming Liu,et al.  High-speed all-optical differentiator based on a semiconductor optical amplifier and an optical filter. , 2007, Optics letters.

[32]  Andrea Alù,et al.  Performing Mathematical Operations with Metamaterials , 2014, Science.

[33]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[34]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Xiaochun Cao,et al.  Cluster-Based Co-Saliency Detection , 2013, IEEE Transactions on Image Processing.