Inverse design of an integrated-nanophotonics optical neural network.

Abstract Artificial neural networks have dramatically improved the performance of many machine-learning applications such as image recognition and natural language processing. However, the electronic hardware implementations of the above-mentioned tasks are facing performance ceiling because Moore’s Law is slowing down. In this article, we propose an optical neural network architecture based on optical scattering units to implement deep learning tasks with fast speed, low power consumption and small footprint. The optical scattering units allow light to scatter back and forward within a small region and can be optimized through an inverse design method. The optical scattering units can implement high-precision stochastic matrix multiplication with mean squared error 10 - 4 and a mere 4 × 4 μm2 footprint. Furthermore, an optical neural network framework based on optical scattering units is constructed by introducing “Kernel Matrix”, which can achieve 97.1% accuracy on the classic image classification dataset MNIST.

[1]  H. Zimmermann,et al.  Zero-bias 40Gbit/s germanium waveguide photodetector on silicon. , 2012, Optics express.

[2]  Brendan J. Frey,et al.  Deep learning of the tissue-regulated splicing code , 2014, Bioinform..

[3]  Michael Mrejen,et al.  Plasmonic nanostructure design and characterization via Deep Learning , 2018, Light: Science & Applications.

[4]  R I Macdonald,et al.  Design of phased-array wavelength division multiplexers using multimode interference couplers. , 1997, Applied optics.

[5]  P. Baldi,et al.  Searching for exotic particles in high-energy physics with deep learning , 2014, Nature Communications.

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Harish Bhaskaran,et al.  Integrated all-photonic non-volatile multi-level memory , 2015, Nature Photonics.

[8]  Yi Yang,et al.  Nanophotonic particle simulation and inverse design using artificial neural networks , 2018, Science Advances.

[9]  Michael J. Connelly,et al.  Semiconductor Optical Amplifiers , 2002 .

[10]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[11]  Gordon Wetzstein,et al.  Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification , 2018, Scientific Reports.

[12]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[13]  B. Shen,et al.  An integrated-nanophotonics polarization beamsplitter with 2.4 × 2.4 μm2 footprint , 2015, Nature Photonics.

[14]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[15]  Zongfu Yu,et al.  Training Deep Neural Networks for the Inverse Design of Nanophotonic Structures , 2017, 2019 Conference on Lasers and Electro-Optics (CLEO).

[16]  Kyu-Tae Lee,et al.  A Generative Model for Inverse Design of Metamaterials , 2018, Nano letters.

[17]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[18]  Yongmin Liu,et al.  Deep-Learning-Enabled On-Demand Design of Chiral Metamaterials. , 2018, ACS nano.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Zhenhua Ni,et al.  Monolayer graphene as a saturable absorber in a mode-locked laser , 2010, 1007.2243.

[21]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[22]  B. Frey,et al.  The human splicing code reveals new insights into the genetic determinants of disease , 2015, Science.

[23]  Robert P. Sheridan,et al.  Deep Neural Nets as a Method for Quantitative Structure-Activity Relationships , 2015, J. Chem. Inf. Model..

[24]  Chiho Kim,et al.  Machine learning in materials informatics: recent applications and prospects , 2017, npj Computational Materials.

[25]  Jacob biamonte,et al.  Quantum machine learning , 2016, Nature.

[26]  Gisbert Schneider,et al.  Deep Learning in Drug Discovery , 2016, Molecular informatics.

[27]  Shanhui Fan,et al.  Training of Photonic Neural Networks through In Situ Backpropagation , 2018, 2019 Conference on Lasers and Electro-Optics (CLEO).

[28]  Li Jing,et al.  Migrating Knowledge between Physical Scenarios based on Artificial Neural Networks , 2018, ACS Photonics.

[29]  Laurent Larger,et al.  Reinforcement Learning in a large scale photonic Recurrent Neural Network , 2017, Optica.

[30]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[31]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[32]  Alexander Y. Piggott,et al.  Inverse design and demonstration of a compact and broadband on-chip wavelength demultiplexer , 2015, Nature Photonics.

[33]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[34]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[35]  Shanhui Fan,et al.  Adjoint Method and Inverse Design for Nonlinear Nanophotonic Devices , 2018, ACS Photonics.

[36]  Lei Ying,et al.  Nanophotonic media for artificial neural inference , 2018, Photonics Research.

[37]  Qiang Li,et al.  Thermal camouflage based on the phase-changing material GST , 2018, Light: Science & Applications.

[38]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  A C Selden,et al.  Pulse transmission through a saturable absorber , 1967 .