Collective and synchronous dynamics of photonic spiking neurons

Nonlinear dynamics of spiking neural networks has recently attracted much interest as an approach to understand possible information processing in the brain and apply it to artificial intelligence. Since information can be processed by collective spiking dynamics of neurons, the fine control of spiking dynamics is desirable for neuromorphic devices. Here we show that photonic spiking neurons implemented with paired nonlinear optical oscillators can be controlled to generate two modes of bio-realistic spiking dynamics by changing the optical pump amplitude. When they are coupled in a network, we found that the interaction between the photonic neurons induces an effective change in the pump amplitude depending on the order parameter that characterizes synchronization. The experimental results show that the effective change causes spontaneous modification of the spiking modes and firing rates of clustered neurons, and such collective dynamics can be utilized to realize efficient heuristics for solving NP-hard combinatorial optimization problems.

[1]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[2]  A. Hodgkin.  The local electric changes associated with repetitive action in a non‐medullated axon , 1948, The Journal of physiology.

[3]  Natalia G. Berloff,et al.  Computational complexity continuum within Ising formulation of NP problems , 2020, Communications Physics.

[4]  Robert A. Legenstein,et al.  Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets , 2019, ArXiv.

[5]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[6]  Jing Li,et al.  An FPGA-Based Silicon Neuronal Network with Selectable Excitability Silicon Neurons , 2012, Front. Neurosci..

[7]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[8]  J. Feldmann,et al.  All-optical spiking neurosynaptic networks with self-learning capabilities , 2019, Nature.

[9]  J. Danckaert,et al.  Solitary and coupled semiconductor ring lasers as optical spiking neurons. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Timothée Masquelier,et al.  Deep Learning in Spiking Neural Networks , 2018, Neural Networks.

[11]  Ken-ichi Kawarabayashi,et al.  Experimental investigation of performance differences between coherent Ising machines and a quantum annealer , 2018, Science Advances.

[12]  Anirban Das,et al.  Critical Neuronal Models with Relaxed Timescale Separation , 2018, Physical Review X.

[13]  R. Spigler,et al.  The Kuramoto model: A simple paradigm for synchronization phenomena , 2005 .

[14]  Michal Lipson,et al.  Demonstration of chip-based coupled degenerate optical parametric oscillators for realizing a nanophotonic spin-glass , 2020, Nature Communications.

[15]  Heiko Hoffmann,et al.  Optimization by Self-Organized Criticality , 2018, Scientific Reports.

[16]  Ryan Hamerly,et al.  Large-Scale Optical Neural Networks based on Photoelectric Multiplication , 2018, Physical Review X.

[17]  知秀 柴田.  5分で分かる!? 有名論文ナナメ読み：Jacob Devlin et al. : BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding , 2020 .

[18]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[19]  R. Byer,et al.  Network of time-multiplexed optical parametric oscillators as a coherent Ising machine , 2014, Nature Photonics.

[20]  Paul R Prucnal,et al.  A high performance photonic pulse processing device. , 2009, Optics express.

[21]  Bhavin J. Shastri,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2016, Scientific Reports.

[22]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[23]  Atsushi Takada,et al.  Phase sensitive degenerate parametric amplification using directly-bonded PPLN ridge waveguides. , 2011, Optics express.

[24]  T. Inagaki,et al.  Understanding dynamics of coherent Ising machines through simulation of large-scale 2D Ising models , 2018, Nature Communications.

[25]  Ken-ichi Kawarabayashi,et al.  A coherent Ising machine with quantum measurement and feedback control , 2015 .

[26]  E. Ising.  Beitrag zur Theorie des Ferromagnetismus , 1925 .

[27]  P. Monnier,et al.  Fast thermo-optical excitability in a two-dimensional photonic crystal. , 2006, Physical review letters.

[28]  Shoko Utsunomiya,et al.  Truncated Wigner theory of coherent Ising machines based on degenerate optical parametric oscillator network , 2016, 1605.08655.

[29]  Natalia G. Berloff,et al.  Polaritonic network as a paradigm for dynamics of coupled oscillators , 2019, Physical Review B.

[30]  R. Byer,et al.  Coherent Ising machine based on degenerate optical parametric oscillators , 2013, 1311.2696.

[31]  W. Kath,et al.  Pulsed degenerate optical parametric oscillator based on a nonlinear-fiber Sagnac interferometer. , 1998, Optics letters.

[32]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[33]  Drummond,et al.  Quantum dynamics of the parametric oscillator. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[34]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[35]  Ken-ichi Kawarabayashi,et al.  A coherent Ising machine for 2000-node optimization problems , 2016, Science.

[36]  Vladimir Pervak,et al.  Coherence properties of a broadband femtosecond mid-IR optical parametric oscillator operating at degeneracy. , 2012, Optics express.

[37]  Robert L. Byer,et al.  Coherence properties of a doubly resonant monolithic optical parametric oscillator , 1990 .

[38]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[39]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[40]  Ellen Zhou,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2017, Scientific Reports.

[41]  G. Bard Ermentrout,et al.  Noise-Induced Synchronization and Antiresonance in Interacting Excitable Systems: Applications to Deep Brain Stimulation in Parkinson’s Disease , 2020 .

[42]  Kazuyuki Aihara,et al.  A fully programmable 100-spin coherent Ising machine with all-to-all connections , 2016, Science.

[43]  Yoshiki Kuramoto,et al.  Self-entrainment of a population of coupled non-linear oscillators , 1975 .

[44]  K. McNeil,et al.  Non-equilibrium Transitions in Sub/second Harmonic Generation: II. Quantum Theory , 1980 .

[45]  Antonio Pflüger.  An energy and technology roadmap , 2006 .

[46]  Yoshihisa Yamamoto,et al.  Large-scale Ising spin network based on degenerate optical parametric oscillators , 2016, Nature Photonics.

[47]  D Goulding,et al.  Excitability in a quantum dot semiconductor laser with optical injection. , 2007, Physical review letters.

[48]  Paul R Prucnal,et al.  SIMPEL: circuit model for photonic spike processing laser neurons. , 2014, Optics express.