Progress in neuromorphic photonics

Abstract As society’s appetite for information continues to grow, so does our need to process this information with increasing speed and versatility. Many believe that the one-size-fits-all solution of digital electronics is becoming a limiting factor in certain areas such as data links, cognitive radio, and ultrafast control. Analog photonic devices have found relatively simple signal processing niches where electronics can no longer provide sufficient speed and reconfigurability. Recently, the landscape for commercially manufacturable photonic chips has been changing rapidly and now promises to achieve economies of scale previously enjoyed solely by microelectronics. By bridging the mathematical prowess of artificial neural networks to the underlying physics of optoelectronic devices, neuromorphic photonics could breach new domains of information processing demanding significant complexity, low cost, and unmatched speed. In this article, we review the progress in neuromorphic photonics, focusing on photonic integrated devices. The challenges and design rules for optoelectronic instantiation of artificial neurons are presented. The proposed photonic architecture revolves around the processing network node composed of two parts: a nonlinear element and a network interface. We then survey excitable lasers in the recent literature as candidates for the nonlinear node and microring-resonator weight banks as the network interface. Finally, we compare metrics between neuromorphic electronics and neuromorphic photonics and discuss potential applications.

[1]  Tymon Barwicz,et al.  Automated, self-aligned assembly of 12 fibers per nanophotonic chip with standard microelectronics assembly tooling , 2015, 2015 IEEE 65th Electronic Components and Technology Conference (ECTC).

[2]  Thomas Ferreira de Lima,et al.  Multi-channel control for microring weight banks. , 2016, Optics express.

[3]  Antonio Hurtado,et al.  Investigation of vertical cavity surface emitting laser dynamics for neuromorphic photonic systems , 2012 .

[4]  B Kelleher,et al.  Excitability in optically injected semiconductor lasers: contrasting quantum-well- and quantum-dot-based devices. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  B Krauskopf,et al.  Excitability and coherence resonance in lasers with saturable absorber. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[6]  L. Chrostowski,et al.  Silicon Photonics Design: From Devices to Systems , 2015 .

[7]  Blas Echebarria,et al.  Supernormal conduction in cardiac tissue promotes concordant alternans and action potential bunching. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  A. Biberman,et al.  Control of Integrated Micro-resonator Wavelength via Balanced Homodyne Locking References and Links Exploiting Cmos Manufacturing to Reduce Tuning Requirements for Resonant Optical Devices, " Ieee Photonics , 2022 .

[9]  M. C. Soriano,et al.  A Unified Framework for Reservoir Computing and Extreme Learning Machines based on a Single Time-delayed Neuron , 2015, Scientific Reports.

[10]  Di Liang,et al.  Hybrid Integrated Platforms for Silicon Photonics , 2010, Materials.

[11]  Gary J. Balas,et al.  Receding horizon control of an F-16 aircraft: A comparative study , 2006 .

[12]  Chris Eliasmith,et al.  A Unified Approach to Building and Controlling Spiking Attractor Networks , 2005, Neural Computation.

[13]  L Pesquera,et al.  Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. , 2012, Optics express.

[14]  J. Danckaert,et al.  Optical injection in semiconductor ring lasers , 2009 .

[15]  Ingo Fischer,et al.  Dynamics of semiconductor lasers subject to delayed optical feedback: the short cavity regime. , 2001 .

[16]  Karthikeyan Sankaralingam,et al.  Dark Silicon and the End of Multicore Scaling , 2012, IEEE Micro.

[17]  Wei Shi,et al.  Focusing sub-wavelength grating couplers with low back reflections for rapid prototyping of silicon photonic circuits. , 2014, Optics express.

[18]  M. Watts,et al.  Silicon microring modulator with integrated heater and temperature sensor for thermal control , 2010, CLEO/QELS: 2010 Laser Science to Photonic Applications.

[19]  Paul R. Prucnal,et al.  Spatiotemporal pattern recognition with cascadable graphene excitable lasers , 2014, 2014 IEEE Photonics Conference.

[20]  Di Liang,et al.  Recent progress in lasers on silicon , 2010 .

[21]  I. Sagnes,et al.  Excitability and self-pulsing in a photonic crystal nanocavity , 2012 .

[22]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[23]  M Giudici,et al.  Control of excitable pulses in an injection-locked semiconductor laser. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Youshen Xia,et al.  A new neural network for solving linear and quadratic programming problems , 1996, IEEE Trans. Neural Networks.

[25]  Salvador Balle,et al.  Excitability and optical pulse generation in semiconductor lasers driven by resonant tunneling diode photo-detectors. , 2013, Optics express.

[26]  Paul R. Prucnal,et al.  Recent progress in semiconductor excitable lasers for photonic spike processing , 2016 .

[27]  Nicolas A. F. Jaeger,et al.  Crosstalk in SOI Microring Resonator-Based Filters , 2016, Journal of Lightwave Technology.

[28]  P. Bienstman,et al.  Excitation transfer between optically injected microdisk lasers. , 2013, Optics express.

[29]  Jason C. C. Mak,et al.  Automatic Resonance Alignment of High-Order Microring Filters , 2015, IEEE Journal of Quantum Electronics.

[30]  Siva Yegnanarayanan,et al.  Toward ultimate miniaturization of high Q silicon traveling-wave microresonators. , 2010, Optics express.

[31]  K. Steinhubl.  Design of Ion-Implanted MOSFET'S with Very Small Physical Dimensions , 1974 .

[32]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[33]  Johannes Schemmel,et al.  Reward-based learning under hardware constraints—using a RISC processor embedded in a neuromorphic substrate , 2013, Front. Neurosci..

[34]  A. N. Tait,et al.  Continuous control of microring weight banks , 2015, 2015 IEEE Photonics Conference (IPC).

[35]  Rüdiger Paschotta,et al.  Experimentally confirmed design guidelines for passively Q-switched microchip lasers using semiconductor saturable absorbers , 2001 .

[36]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[37]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[38]  R. Avo,et al.  Stochastic induced dynamics in neuromorphic optoelectronic oscillators , 2014 .

[39]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[40]  Erik G. Larsson,et al.  Massive MIMO for next generation wireless systems , 2013, IEEE Communications Magazine.

[41]  R. Hansen.  Phased Array Antennas , 2009 .

[42]  Miguel A. Larotonda,et al.  Experimental investigation on excitability in a laser with a saturable absorber , 2002 .

[43]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[44]  Paul R Prucnal,et al.  Ultrafast all-optical implementation of a leaky integrate-and-fire neuron. , 2011, Optics express.

[45]  Thomas Ferreira de Lima,et al.  Excitable laser processing network node in hybrid silicon: analysis and simulation. , 2015, Optics express.

[46]  Paul R. Prucnal,et al.  Microring Weight Banks , 2016, IEEE Journal of Selected Topics in Quantum Electronics.

[47]  Geert Morthier,et al.  Experimental demonstration of reservoir computing on a silicon photonics chip , 2014, Nature Communications.

[48]  Mahmut T. Kandemir,et al.  Leakage Current: Moore's Law Meets Static Power , 2003, Computer.

[49]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[50]  R Kuszelewicz,et al.  Relative refractory period in an excitable semiconductor laser. , 2014, Physical review letters.

[51]  Robert W. Keyes,et al.  Optical Logic-in the Light of Computer Technology , 1985 .

[52]  Eric C. Kerrigan,et al.  An FPGA implementation of a sparse quadratic programming solver for constrained predictive control , 2011, FPGA '11.

[53]  B Kelleher,et al.  Incoherent optical triggering of excitable pulses in an injection-locked semiconductor laser. , 2014, Optics letters.

[54]  Bruno Romeira.  Dynamics of resonant tunneling diode optoelectronic oscillators , 2012 .

[55]  Antonio Hurtado,et al.  Controllable spiking patterns in long-wavelength vertical cavity surface emitting lasers for neuromorphic photonics systems , 2015, 1507.08176.

[56]  Paul R. Prucnal,et al.  Spike processing with a graphene excitable laser , 2016, Scientific Reports.

[57]  David Gesbert,et al.  From theory to practice: an overview of MIMO space-time coded wireless systems , 2003, IEEE J. Sel. Areas Commun..

[58]  Daan Lenstra,et al.  Full length article A unifying view of bifurcations in a semiconductor laser subject to optical injection , 1999 .

[59]  Paul R. Prucnal,et al.  Simulations of a graphene excitable laser for spike processing , 2014 .

[60]  Paul R. Prucnal,et al.  Demonstration of a silicon photonic neural network , 2016, 2016 IEEE Photonics Society Summer Topical Meeting Series (SUM).

[61]  Jinzhong Yu,et al.  Single-mode silicon-on-insulator elliptical microdisk resonators with high Q factors , 2011, Other Conferences.

[62]  Michal Lipson,et al.  Performance guidelines for WDM interconnects based on silicon microring resonators , 2011, CLEO: 2011 - Laser Science to Photonic Applications.

[63]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[64]  D.A.B. Miller,et al.  Rationale and challenges for optical interconnects to electronic chips , 2000, Proceedings of the IEEE.

[65]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[66]  J. Bowers,et al.  Hybrid Silicon Laser Technology: A Thermal Perspective , 2011, IEEE Journal of Selected Topics in Quantum Electronics.

[67]  Yi Zhang,et al.  Silicon Photonics: The Next Fabless Semiconductor Industry , 2013, IEEE Solid-State Circuits Magazine.

[68]  G. R. Luckhurst,et al.  Director alignment by crossed electric and magnetic fields: a deuterium NMR study. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[69]  R. Ramaswami,et al.  Multiwavelength lightwave networks for computer communication , 1993, IEEE Communications Magazine.

[70]  M. Lipson,et al.  Wide-bandwidth continuously tunable optical delay line using silicon microring resonators. , 2010, Optics express.

[71]  Antonio Hurtado,et al.  Optical neuron using polarisation switching in a 1550nm-VCSEL. , 2010, Optics express.

[72]  D Goulding,et al.  Excitability in a quantum dot semiconductor laser with optical injection. , 2007, Physical review letters.

[73]  Alejandro M. Yacomotti,et al.  All-optical bistable band-edge Bloch modes in a two-dimensional photonic crystal , 2006 .

[74]  Paul R. Prucnal,et al.  An integrated analog O/E/O link for multi-channel laser neurons , 2016 .

[75]  Qianfan Xu,et al.  Silicon microring resonators with 1.5-μm radius , 2008 .

[76]  Ata Mahjoubfar,et al.  Tailoring Wideband Signals With a Photonic Hardware Accelerator , 2015, Proceedings of the IEEE.

[77]  Michael R. Watts,et al.  Ultralow-loss silicon ring resonators , 2012 .

[78]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[79]  J. Danckaert,et al.  Excitability in semiconductor microring lasers: Experimental and theoretical pulse characterization , 2010, 1108.3704.

[80]  Daan Lenstra,et al.  Multipulse excitability in a semiconductor laser with optical injection. , 2002, Physical review letters.

[81]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[82]  P. R. Prucnal,et al.  A Leaky Integrate-and-Fire Laser Neuron for Ultrafast Cognitive Computing , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[83]  Michael Bedford Taylor,et al.  Is dark silicon useful? Harnessing the four horsemen of the coming dark silicon apocalypse , 2012, DAC Design Automation Conference 2012.

[84]  Mk Meint Smit.  Generic InP-based integration technology, today and tomorrow , 2012 .

[85]  Yurii A. Vlasov,et al.  Silicon CMOS-integrated nano-photonics for computer and data communications beyond 100G , 2012, IEEE Communications Magazine.

[86]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[87]  A. Driessen,et al.  Reconfigurable optical add-drop multiplexer using microring resonators , 2005, IEEE Photonics Technology Letters.

[88]  Sylvain Barbay,et al.  Excitability in a semiconductor laser with saturable absorber. , 2011, Optics letters.

[89]  Paul R. Prucnal,et al.  Continuous Calibration of Microring Weights for Analog Optical Networks , 2016, IEEE Photonics Technology Letters.

[90]  Sylvain Barbay,et al.  Control of cavity solitons and dynamical states in a monolithic vertical cavity laser with saturable absorber , 2010 .

[91]  Ioannis Tomkos,et al.  A Survey on Optical Interconnects for Data Centers , 2012, IEEE Communications Surveys & Tutorials.

[92]  L. Chrostowski,et al.  Wavelength tuning and stabilization of microring-based filters using silicon in-resonator photoconductive heaters. , 2015, Optics express.

[93]  J. Danckaert,et al.  Solitary and coupled semiconductor ring lasers as optical spiking neurons. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[94]  Serge Massar,et al.  All-optical Reservoir Computing , 2012, Optics express.

[95]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[96]  Cristina Masoller,et al.  Effects of periodic forcing on the temporally correlated spikes of a semiconductor laser with feedback. , 2015, Optics express.

[97]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[98]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[99]  Joni Dambre,et al.  Excitability in optically injected microdisk lasers with phase controlled excitatory and inhibitory response. , 2013, Optics express.

[100]  John E. Bowers,et al.  Energy Efficient and Energy Proportional Optical Interconnects for Multi-Core Processors: Driving the Need for On-Chip Sources , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[101]  J. Bowers,et al.  III‐V/silicon photonics for on‐chip and intra‐chip optical interconnects , 2010 .

[102]  Cristina Masoller,et al.  Unveiling the complex organization of recurrent patterns in spiking dynamical systems , 2014, Scientific Reports.

[103]  Paul R Prucnal,et al.  A high performance photonic pulse processing device. , 2009, Optics express.

[104]  Gabriel B. Mindlin,et al.  Interspike Time Distribution in Noise Driven Excitable Systems , 1999 .

[105]  Paul R. Prucnal,et al.  Physical modeling of photonic neural networks , 2016, 2016 IEEE Photonics Society Summer Topical Meeting Series (SUM).

[106]  Giovanni Giacomelli,et al.  Andronov bifurcation and excitability in semiconductor lasers with optical feedback , 1997 .

[107]  B. Schrauwen,et al.  Cascadable excitability in microrings. , 2012, Optics express.

[108]  Anders S. G. Andrae,et al.  On Global Electricity Usage of Communication Technology: Trends to 2030 , 2015 .

[109]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[110]  Paul R. Prucnal,et al.  Broadcast and Weight: An Integrated Network For Scalable Photonic Spike Processing , 2014, Journal of Lightwave Technology.

[111]  Paul R. Prucnal,et al.  Coincidence detection with graphene excitable laser , 2014, 2014 Conference on Lasers and Electro-Optics (CLEO) - Laser Science to Photonic Applications.

[112]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[113]  B Kelleher,et al.  Excitation regeneration in delay-coupled oscillators. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[114]  Salvador Balle,et al.  Experimental evidence of van der Pol-Fitzhugh-Nagumo dynamics in semiconductor optical amplifiers. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[115]  N. C. Singh,et al.  Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli , 2001 .

[116]  M Radziunas,et al.  Excitability of a semiconductor laser by a two-mode homoclinic bifurcation. , 2001, Physical review letters.

[117]  P. Monnier,et al.  Fast thermo-optical excitability in a two-dimensional photonic crystal. , 2006, Physical review letters.

[118]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[119]  Minoru Yamada,et al.  A theoretical analysis of self-sustained pulsation phenomena in narrow-stripe semiconductor lasers , 1993 .

[120]  Giacomelli,et al.  Experimental evidence of coherence resonance in an optical system , 2000, Physical review letters.

[121]  L. Gelens,et al.  Oscillations and multistability in two semiconductor ring lasers coupled by a single waveguide , 2013 .

[122]  Kwong-Sak Leung,et al.  A new gradient-based neural network for solving linear and quadratic programming problems , 2001, IEEE Trans. Neural Networks.

[123]  R Kuszelewicz,et al.  Temporal summation in a neuromimetic micropillar laser. , 2015, Optics letters.

[124]  J. Javaloyes,et al.  Topological solitons as addressable phase bits in a driven laser , 2014, Nature Communications.

[125]  David A. B. Miller.  Attojoule Optoelectronics for Low-Energy Information Processing and Communications , 2017, Journal of Lightwave Technology.

[126]  Paul R Prucnal,et al.  SIMPEL: circuit model for photonic spike processing laser neurons. , 2014, Optics express.

[127]  B. Krauskopf,et al.  Self-pulsations of lasers with saturable absorber: dynamics and bifurcations , 1999 .

[128]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[129]  Yue Tian,et al.  Signal feature recognition based on lightwave neuromorphic signal processing. , 2011, Optics letters.

[130]  Salvador Balle,et al.  Excitable optical waves in semiconductor microcavities. , 2005, Physical review letters.

[131]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[132]  Daan Lenstra,et al.  The dynamical complexity of optically injected semiconductor lasers , 2005 .