Monolithic Silicon Photonic Architecture for Training Deep Neural Networks with Direct Feedback Alignment

Matthew J. Filipovich,1, ∗ Zhimu Guo,1 Mohammed Al-Qadasi,2 Bicky A. Marquez,1 Hugh D. Morison,1 Volker J. Sorger,3 Paul R. Prucnal,4 Sudip Shekhar,2 and Bhavin J. Shastri1, 5 Department of Physics, Engineering Physics and Astronomy, Queen’s University, Kingston, ON K7L 3N6, Canada Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC V6T 1Z4, Canada Department of Electrical and Computer Engineering, George Washington University, Washington, DC 20052, USA Department of Electrical Engineering, Princeton University, Princeton, NJ 08542, USA Vector Institute, Toronto, ON M5G 1M1, Canada

[1]  Farooq Ahmad Khanday,et al.  Resistive Random Access Memory (RRAM): an Overview of Materials, Switching Mechanism, Performance, Multilevel Cell (mlc) Storage, Modeling, and Applications , 2020, Nanoscale Research Letters.

[2]  David J. Thomson,et al.  Silicon optical modulators , 2010 .

[3]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[4]  Paul R. Prucnal,et al.  Microring Weight Banks , 2016, IEEE Journal of Selected Topics in Quantum Electronics.

[5]  Philip Y. Ma,et al.  Feedback control for microring weight banks. , 2018, Optics express.

[6]  F. Krzakala,et al.  Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures , 2020, NeurIPS.

[7]  C. Wright,et al.  Photonics for artificial intelligence and neuromorphic computing , 2020, ArXiv.

[8]  Paul R. Prucnal,et al.  Silicon Photonic Modulator Neuron , 2018, Physical Review Applied.

[9]  Xuan Li,et al.  Parallel convolutional processing using an integrated photonic tensor core , 2021, Nature.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[12]  J. De Coster,et al.  56Gb/s ring modulator on a 300mm silicon photonics platform , 2015, 2015 European Conference on Optical Communication (ECOC).

[13]  Ellen Zhou,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2017, Scientific Reports.

[14]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[15]  Yue Jiang,et al.  All-optical neural network with nonlinear activation functions , 2019, Optica.

[16]  Michal Lipson,et al.  Photonic-chip-based frequency combs , 2019, Nature Photonics.

[17]  Paul R. Prucnal,et al.  Digital Electronics and Analog Photonics for Convolutional Neural Networks (DEAP-CNNs) , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[18]  Paul R. Prucnal,et al.  Photonic Multiply-Accumulate Operations for Neural Networks , 2020, IEEE Journal of Selected Topics in Quantum Electronics.

[19]  Javier Ayala,et al.  300-mm Monolithic Silicon Photonics Foundry Technology , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[20]  John von Neumann,et al.  First draft of a report on the EDVAC , 1993, IEEE Annals of the History of Computing.

[21]  L. Chrostowski,et al.  Photoconductive heaters enable control of large-scale silicon photonic ring resonator circuits , 2018, Optica.

[22]  A. Amirkhany,et al.  A 12-GS/s Phase-Calibrated CMOS Digital-to-Analog Converter for Backplane Communications , 2008, IEEE Journal of Solid-State Circuits.

[23]  Andrew S. Cassidy,et al.  Convolutional networks for fast, energy-efficient neuromorphic computing , 2016, Proceedings of the National Academy of Sciences.

[24]  Paul R. Prucnal,et al.  Machine Learning With Neuromorphic Photonics , 2019, Journal of Lightwave Technology.

[25]  T. Sridarshini,et al.  Design and analysis of 1xN symmetrical optical splitters for photonic integrated circuits , 2018 .

[26]  L. Chrostowski,et al.  Wavelength tuning and stabilization of microring-based filters using silicon in-resonator photoconductive heaters. , 2015, Optics express.

[27]  Zhiping Zhou,et al.  On-chip light sources for silicon photonics , 2015, Light: Science & Applications.

[28]  Bhavin J. Shastri,et al.  Microring Weight Banks Control beyond 8.5-bits Accuracy , 2021, ArXiv.

[29]  Bastien Giraud,et al.  1.45-fJ/bit Access Two-Port SRAM Interfacing a Synchronous/Asynchronous IoT Platform for Energy-Efficient Normally Off Applications , 2018, IEEE Solid-State Circuits Letters.

[30]  N. Feng,et al.  Wavelength-tunable silicon microring modulator. , 2010, Optics express.

[31]  P. Prucnal,et al.  NEUROMORPHIC PHOTONICS , 2017 .

[32]  Mario Miscuglio,et al.  Artificial Synapse with Mnemonic Functionality using GSST-based Photonic Integrated Memory , 2019, 2020 International Applied Computational Electromagnetics Society Symposium (ACES).

[33]  Ruben Ohana,et al.  Align, then memorise: the dynamics of learning with feedback alignment , 2020, ICML.

[34]  P. Dumon,et al.  Silicon microring resonators , 2012 .

[35]  Andrew McCallum,et al.  Energy and Policy Considerations for Deep Learning in NLP , 2019, ACL.

[36]  Lukas Chrostowski,et al.  Silicon Photonics Circuit Design: Methods, Tools and Challenges , 2018 .

[37]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[38]  Wei-Zen Chen,et al.  A 20-Gb/s, 2.4 pJ/bit, Fully Integrated Optical Receiver with a Baud-Rate Clock and Data Recovery , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[39]  Sae Woo Nam,et al.  All-silicon light-emitting diodes waveguide-integrated with superconducting single-photon detectors. , 2017, Applied physics letters.

[40]  Eugenio Culurciello,et al.  An Analysis of Deep Neural Network Models for Practical Applications , 2016, ArXiv.

[41]  Arild Nøkland,et al.  Direct Feedback Alignment Provides Learning in Deep Neural Networks , 2016, NIPS.

[42]  Yi Zhang,et al.  Silicon Photonics: The Next Fabless Semiconductor Industry , 2013, IEEE Solid-State Circuits Magazine.

[43]  Bhavin J. Shastri,et al.  Neuromorphic Photonic Integrated Circuits , 2018, IEEE Journal of Selected Topics in Quantum Electronics.