Neuromorphic photonic networks using silicon photonic weight banks

Photonic systems for high-performance information processing have attracted renewed interest. Neuromorphic silicon photonics has the potential to integrate processing functions that vastly exceed the capabilities of electronics. We report first observations of a recurrent silicon photonic neural network, in which connections are configured by microring weight banks. A mathematical isomorphism between the silicon photonic circuit and a continuous neural network model is demonstrated through dynamical bifurcation analysis. Exploiting this isomorphism, a simulated 24-node silicon photonic neural network is programmed using “neural compiler” to solve a differential system emulation task. A 294-fold acceleration against a conventional benchmark is predicted. We also propose and derive power consumption analysis for modulator-class neurons that, as opposed to laser-class neurons, are compatible with silicon photonic platforms. At increased scale, Neuromorphic silicon photonics could access new regimes of ultrafast information processing for radio, control, and scientific computing.

[1]  P. R. Prucnal,et al.  A Leaky Integrate-and-Fire Laser Neuron for Ultrafast Cognitive Computing , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[2]  R Kuszelewicz,et al.  Relative refractory period in an excitable semiconductor laser. , 2014, Physical review letters.

[3]  Jens H. Schmid,et al.  Roadmap on silicon photonics , 2016 .

[4]  George C Valley,et al.  Photonic analog-to-digital converters. , 2007, Optics express.

[5]  Paul R. Prucnal,et al.  Scalable Wideband Principal Component Analysis via Microwave Photonics , 2016, IEEE Photonics Journal.

[6]  T. K. Woodward,et al.  Thermally-efficient reconfigurable narrowband RF-photonic filter. , 2010, Optics express.

[7]  Volker J. Sorger,et al.  MorphoNoC: Exploring the Design Space of a Configurable Hybrid NoC using Nanophotonics , 2016, Microprocess. Microsystems.

[8]  Thomas Nowotny,et al.  Comparing Neuromorphic Solutions in Action: Implementing a Bio-Inspired Solution to a Benchmark Classification Task on Three Parallel-Computing Platforms , 2019 .

[9]  Urbashi Mitra,et al.  Neural network techniques for adaptive multiuser demodulation , 1994, IEEE J. Sel. Areas Commun..

[10]  G. Lo,et al.  A compact and low loss Y-junction for submicron silicon waveguide. , 2013, Optics express.

[11]  Robert W. Keyes,et al.  Optical Logic-in the Light of Computer Technology , 1985 .

[12]  Xiaoke Yi,et al.  Microwave photonic signal processing , 2007, 2011 International Topical Meeting on Microwave Photonics jointly held with the 2011 Asia-Pacific Microwave Photonics Conference.

[13]  Chao Li,et al.  Review of Silicon Photonics Foundry Efforts , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[14]  Paul R. Prucnal,et al.  Broadcast and Weight: An Integrated Network For Scalable Photonic Spike Processing , 2014, Journal of Lightwave Technology.

[15]  Ue-Pyng Wen,et al.  A review of Hopfield neural networks for solving mathematical programming problems , 2009, Eur. J. Oper. Res..

[16]  Ingo Fischer,et al.  Reconfigurable semiconductor laser networks based on diffractive coupling. , 2015, Optics letters.

[17]  Ian O'Connor,et al.  Optical Ring Network-on-Chip (ORNoC): Architecture and design methodology , 2011, 2011 Design, Automation & Test in Europe.

[18]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[19]  Jianping Yao,et al.  Broadband Chaotic Signals and Breather Oscillations in an Optoelectronic Oscillator Incorporating a Microwave Photonic Filter , 2014, Journal of Lightwave Technology.

[20]  Dusit Niyato,et al.  A Neural Network Based Spectrum Prediction Scheme for Cognitive Radio , 2010, 2010 IEEE International Conference on Communications.

[21]  Nicolas Godbout,et al.  Z-scan measurement of the nonlinear refractive index of graphene. , 2012, Optics letters.

[22]  Jie Sun,et al.  Large-Scale Silicon Photonic Circuits for Optical Phased Arrays , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[23]  Chris Eliasmith,et al.  Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems , 2004, IEEE Transactions on Neural Networks.

[24]  Yurii A. Vlasov,et al.  Silicon CMOS-integrated nano-photonics for computer and data communications beyond 100G , 2012, IEEE Communications Magazine.

[25]  Zach DeVito,et al.  Opt , 2017 .

[26]  Shahriar Mirabbasi,et al.  A review of wireless-photonic systems: Design methodologies and topologies, constraints, challenges, and innovations in electronics and photonics , 2016 .

[27]  Frédéric E. Theunissen,et al.  A single microphone noise reduction algorithm based on the detection and reconstruction of spectro-temporal features , 2015, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[28]  Dimitris Syvridis,et al.  Micro ring resonators as building blocks for an all-optical high-speed reservoir-computing bit-pattern-recognition system , 2013 .

[29]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[30]  B. Schrauwen,et al.  Cascadable excitability in microrings. , 2012, Optics express.

[31]  N. Ratier Analog computing of partial differential equations , 2012, 2012 6th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT).

[32]  Paul R. Prucnal,et al.  Implementing a Novel Highly Scalable Adaptive Photonic Beamformer using “Blind” Guided Accelerated Random Search , 2014, Journal of Lightwave Technology.

[33]  A. N. Tait,et al.  Silicon microring weight banks for multivariate RF photonics , 2017, 2017 Conference on Lasers and Electro-Optics (CLEO).

[34]  Johannes Schemmel,et al.  Reward-based learning under hardware constraints—using a RISC processor embedded in a neuromorphic substrate , 2013, Front. Neurosci..

[35]  Sae Woo Nam,et al.  Superconducting optoelectronic circuits for neuromorphic computing , 2016, ArXiv.

[36]  Wei Shi,et al.  Focusing sub-wavelength grating couplers with low back reflections for rapid prototyping of silicon photonic circuits. , 2014, Optics express.

[37]  Andrea de Giorgio,et al.  Learning programs is better than learning dynamics: A programmable neural network hierarchical architecture in a multi-task scenario , 2016, Adapt. Behav..

[38]  Randall D. Beer,et al.  On the Dynamics of Small Continuous-Time Recurrent Neural Networks , 1995, Adapt. Behav..

[39]  Giacomo Indiveri,et al.  Memory and Information Processing in Neuromorphic Systems , 2015, Proceedings of the IEEE.

[40]  Nicolas Godbout,et al.  Large nonlinear Kerr effect in graphene , 2012, 1203.5527.

[41]  Paul R. Prucnal,et al.  Spike processing with a graphene excitable laser , 2016, Scientific Reports.

[42]  Paul R. Prucnal,et al.  An integrated analog O/E/O link for multi-channel laser neurons , 2016 .

[43]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[44]  Serge Massar,et al.  Fully analogue photonic reservoir computer , 2016, Scientific Reports.

[45]  Minoru Yamada,et al.  A theoretical analysis of self-sustained pulsation phenomena in narrow-stripe semiconductor lasers , 1993 .

[46]  Jing Li,et al.  Electron beam lithography writing strategies for low loss, high confinement silicon optical waveguides , 2011 .

[47]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[48]  Andrew G. Glen,et al.  APPL , 2001 .

[49]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[50]  Mohamad Sawan,et al.  IEEE Transactions on Biomedical Circuits and Systems , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[51]  Paul R. Prucnal,et al.  Silicon photonic weight bank control of integrated analog network dynamics , 2016, 2016 IEEE Optical Interconnects Conference (OI).

[52]  Jose Hugo Barron-Zambrano,et al.  FPGA implementation of a configurable neuromorphic CPG-based locomotion controller , 2013, Neural Networks.

[53]  Paul R. Prucnal,et al.  Recent progress in semiconductor excitable lasers for photonic spike processing , 2016 .

[54]  Benjamin Schrauwen,et al.  Toward optical signal processing using photonic reservoir computing. , 2008, Optics express.

[55]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[56]  Angelika Peer,et al.  Human-Inspired Neurorobotic System for Classifying Surface Textures by Touch , 2016, IEEE Robotics and Automation Letters.

[57]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[58]  Yi Zhang,et al.  Silicon Photonics: The Next Fabless Semiconductor Industry , 2013, IEEE Solid-State Circuits Magazine.

[59]  Huug de Waardt,et al.  All fiber-optic neural network using coupled SOA based ring lasers , 2002, IEEE Trans. Neural Networks.

[60]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[61]  Alan Y. Liu,et al.  Impact of fabrication non-uniformity on chip-scale silicon photonic integrated circuits , 2014 .

[62]  M. N. Shanmukha Swamy,et al.  Neural methods for antenna array signal processing: a review , 2002, Signal Process..

[63]  Trevor Bekolay,et al.  Nengo: a Python tool for building large-scale functional brain models , 2014, Front. Neuroinform..

[64]  Thomas Ferreira de Lima,et al.  Multi-channel control for microring weight banks. , 2016, Optics express.

[65]  L. Chrostowski,et al.  Silicon Photonics Design: From Devices to Systems , 2015 .

[66]  L. Chrostowski,et al.  Impact of fabrication non-uniformity on chip-scale silicon photonic integrated circuits , 2014, OFC 2014.

[67]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[68]  Paul R. Prucnal,et al.  Continuous Calibration of Microring Weights for Analog Optical Networks , 2016, IEEE Photonics Technology Letters.

[69]  B. Romeira,et al.  Regenerative memory in time-delayed neuromorphic photonic resonators , 2016, Scientific Reports.

[70]  Minghao Qi,et al.  Ultrabroad-bandwidth arbitrary radiofrequency waveform generation with a silicon photonic chip-based spectral shaper , 2010 .

[71]  T J Cloonan,et al.  Six-stage digital free-space optical switching network using symmetric self-electro-optic-effect devices. , 1993, Applied optics.

[72]  Miguel C. Soriano,et al.  Minimal approach to neuro-inspired information processing , 2015, Front. Comput. Neurosci..

[73]  Johannes Schemmel,et al.  Is a 4-Bit Synaptic Weight Resolution Enough? – Constraints on Enabling Spike-Timing Dependent Plasticity in Neuromorphic Hardware , 2012, Front. Neurosci..

[74]  Walter F. Kosonocky,et al.  Progress in optical computer research , 1965, IEEE Spectrum.

[75]  Chris G. H. Roeloffzen,et al.  Programmable photonic signal processor chip for radiofrequency applications , 2015, 1505.00094.

[76]  Paul R. Prucnal,et al.  Microring Weight Banks , 2016, IEEE Journal of Selected Topics in Quantum Electronics.

[77]  Stephen B. Furber,et al.  An efficient SpiNNaker implementation of the Neural Engineering Framework , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[78]  Geert Morthier,et al.  Experimental demonstration of reservoir computing on a silicon photonics chip , 2014, Nature Communications.

[79]  Giacomo Indiveri,et al.  Precise deep neural network computation on imprecise low-power analog hardware , 2016, ArXiv.

[80]  L. Chua,et al.  Simulating nonlinear waves and partial differential equations via CNN. I. Basic techniques , 1995 .

[81]  L. Chrostowski,et al.  Wavelength tuning and stabilization of microring-based filters using silicon in-resonator photoconductive heaters. , 2015, Optics express.

[82]  Luigi Fortuna,et al.  A CNN-based chip for robot locomotion control , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[83]  Ralph Etienne-Cummings,et al.  A Silicon Central Pattern Generator Controls Locomotion in Vivo , 2008, IEEE Transactions on Biomedical Circuits and Systems.

[84]  Francis T. S. Yu,et al.  Overview of hybrid optical neural networks , 1996 .

[85]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[86]  Raymond G. Beausoleil,et al.  Large-scale integrated photonics for high-performance interconnects , 2011, IEEE Photonics Conference 2012.

[87]  Terrence C. Stewart,et al.  Large-Scale Synthesis of Functional Spiking Neural Circuits , 2014, Proceedings of the IEEE.

[88]  Jie Sun,et al.  Open Foundry Platform for High-performance Electronic-photonic Integration References and Links , 2022 .