All-Optical Information Processing Capacity of Diffractive Surfaces

Precise engineering of materials and surfaces has been at the heart of some of the recent advances in optics and photonics. These advances around the engineering of materials with new functionalities have also opened up exciting avenues for designing trainable surfaces that can perform computation and machine learning tasks through light-matter interaction and diffraction. Here, we analyze the information processing capacity of coherent optical networks formed by diffractive surfaces that are trained to perform an all-optical computational task between a given input and output field-of-view. We prove that the dimensionality of the all-optical solution space covering the complex-valued transformations between the input and output fields-of-view is linearly proportional to the number of diffractive surfaces within the optical network, up to a limit that is dictated by the extent of the input and output fields-of-view. Deeper diffractive networks that are composed of larger numbers of trainable surfaces can cover a higher dimensional subspace of the complex-valued linear transformations between a larger input field-of-view and a larger output field-of-view, and exhibit depth advantages in terms of their statistical inference, learning and generalization capabilities for different image classification tasks, when compared with a single trainable diffractive surface. These analyses and conclusions are broadly applicable to various forms of diffractive surfaces, including e.g., plasmonic and/or dielectric-based metasurfaces and flat optics that can be used to form all-optical processors.

[1]  Muhammed Veli,et al.  Terahertz pulse shaping using diffractive surfaces , 2020, Nature communications.

[2]  Yi Luo,et al.  Machine Vision using Diffractive Spectral Encoding , 2020, ArXiv.

[3]  Harry A. Atwater,et al.  Local detection of electromagnetic energy transport below the diffraction limit in metal nanoparticle plasmon waveguides , 2003, Nature materials.

[4]  Federico Capasso,et al.  Flat Optics: Controlling Wavefronts With Optical Antenna Metasurfaces , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[5]  N. Engheta,et al.  Inverse-designed metastructures that solve equations , 2019, Science.

[6]  J. Feldmann,et al.  All-optical spiking neurosynaptic networks with self-learning capabilities , 2019, Nature.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Levent Onural,et al.  Diffraction field computation from arbitrarily distributed data points in space , 2007, Signal Process. Image Commun..

[9]  Yi Luo,et al.  Analysis of Diffractive Optical Neural Networks and Their Integration With Electronic Neural Networks , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[10]  Yi Luo,et al.  Class-specific differential detection in diffractive optical neural networks improves inference accuracy , 2019, Advanced Photonics.

[11]  X. Zhang,et al.  Dielectric Optical Cloak , 2009, 0904.3602.

[12]  Xiang Zhang,et al.  Plasmon lasers at deep subwavelength scale , 2009, Nature.

[13]  Shanhui Fan,et al.  Wave physics as an analog recurrent neural network , 2019, Science Advances.

[14]  Paul R. Prucnal,et al.  Neuromorphic Photonics , Principles of , 2018 .

[15]  A. Kildishev,et al.  Optical black hole: Broadband omnidirectional light absorber , 2009 .

[16]  A. Alú,et al.  Twisted optical metamaterials for planarized ultrathin broadband circular polarizers , 2012, Nature Communications.

[17]  D. Psaltis,et al.  Holography in artificial neural networks , 1990, Nature.

[18]  Yi Luo,et al.  Terahertz Pulse Shaping Using Diffractive Legos , 2020, ArXiv.

[19]  Federico Capasso,et al.  Flat Optics: Controlling Wavefronts With Optical Antenna Metasurfaces , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[20]  Houtong Chen,et al.  A review of metasurfaces: physics and applications , 2016, Reports on progress in physics. Physical Society.

[21]  Leila Yousefi,et al.  Far-Field Imaging Beyond the Diffraction Limit Using Waves Interference , 2020, Journal of Lightwave Technology.

[22]  Armin Mehrabian,et al.  PCNNA: A Photonic Convolutional Neural Network Accelerator , 2018, 2018 31st IEEE International System-on-Chip Conference (SOCC).

[23]  Nader Engheta,et al.  Circuits with Light at Nanoscales: Optical Nanocircuits Inspired by Metamaterials , 2007, Science.

[24]  David R. Smith,et al.  Terahertz compressive imaging with metamaterial spatial light modulators , 2014, Nature Photonics.

[25]  Bhavin J. Shastri,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2016, Scientific Reports.

[26]  David R. Smith,et al.  Metamaterial Electromagnetic Cloak at Microwave Frequencies , 2006, Science.

[27]  David R. Smith,et al.  Controlling Electromagnetic Fields , 2006, Science.

[28]  N. Fang,et al.  Sub–Diffraction-Limited Optical Imaging with a Silver Superlens , 2005, Science.

[29]  Z. You,et al.  Fundamentals of phase-only liquid crystal on silicon (LCOS) devices , 2014, Light: Science & Applications.

[30]  B. Luk’yanchuk,et al.  Optically resonant dielectric nanostructures , 2016, Science.

[31]  Zhaowei Liu,et al.  Far-Field Optical Hyperlens Magnifying Sub-Diffraction-Limited Objects , 2007, Science.

[32]  N. Yu,et al.  Flat optics with designer metasurfaces. , 2014, Nature materials.

[33]  M. C. Soriano,et al.  Advances in photonic reservoir computing , 2017 .

[34]  Hongsheng Chen,et al.  Performing optical logic operations by a diffractive neural network , 2020, Light: Science & Applications.

[35]  Ellen Zhou,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2017, Scientific Reports.

[36]  N. Engheta,et al.  Achieving transparency with plasmonic and metamaterial coatings. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Z. Jacob,et al.  Optical Hyperlens: Far-field imaging beyond the diffraction limit. , 2006, Optics express.

[38]  Yi Luo,et al.  Design of task-specific optical systems using broadband diffractive neural networks , 2019, Light, science & applications.

[39]  Qiong Li L2 Chinese learners’ pragmatic developmental patterns in data-driven instruction and computer-mediated communication (CMC) , 2019, Applied Pragmatics.

[40]  Volker J. Sorger,et al.  Electrooptic nonlinear activation functions for vector matrix multiplications in optical neural networks , 2018 .

[41]  C. Soukoulis,et al.  Electromagnetic waves: Negative refraction by photonic crystals , 2003, Nature.

[42]  J. Pendry,et al.  Negative refraction makes a perfect lens , 2000, Physical review letters.

[43]  Jian Xu,et al.  Performing optical logic operations by a diffractive neural network , 2020, Light: Science & Applications.

[44]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[45]  J. Goodman Introduction to Fourier optics , 1969 .

[46]  Mario Miscuglio,et al.  All-optical nonlinear activation function for photonic neural networks [Invited] , 2018, Optical Materials Express.

[47]  Vladimir M. Shalaev,et al.  Optical cloaking with metamaterials , 2006, physics/0611242.

[48]  David R. Smith,et al.  Metamaterials and Negative Refractive Index , 2004, Science.

[49]  Erez Hasman,et al.  Dielectric gradient metasurface optical elements , 2014, Science.

[50]  G. Bartal,et al.  An optical cloak made of dielectrics. , 2009, Nature materials.

[51]  V. Shalaev Optical negative-index metamaterials , 2007 .

[52]  Laurent Larger,et al.  Reinforcement Learning in a large scale photonic Recurrent Neural Network , 2017, Optica.

[53]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[54]  A. Ozcan,et al.  Misalignment resilient diffractive optical networks , 2020, Nanophotonics.

[55]  Nikolay I. Zheludev,et al.  Ultrafast active plasmonics: transmission and control of femtosecond plasmon signals , 2008 .

[56]  T. Moon,et al.  Mathematical Methods and Algorithms for Signal Processing , 1999 .