STDP-Based Unsupervised Spike Pattern Learning in a Photonic Spiking Neural Network With VCSELs and VCSOAs

We propose a photonic spiking neural network (SNN) consisting of photonic spiking neurons based on vertical-cavity surface-emitting lasers (VCSELs). The photonic spike timing dependent plasticity (STDP) is implemented in a vertical-cavity semiconductor optical amplifier (VCSOA). A versatile computational model of the photonic SNN is presented based on the rate equation models. Through numerical simulation, a spike pattern learning and recognition task is performed based on the photonic STDP. The results show that the post-synaptic spike timing (PST) is eventually converged iteratively to the first spike timing of the input spike pattern via unsupervised learning. Additionally, the convergence rate of the PST can be accelerated for a photonic SNN with more pre-synaptic neurons. The effects of VCSOA parameters on the convergence performance of the unsupervised spike learning are also considered. To the best of our knowledge, such a versatile computational model of photonic SNN for unsupervised learning and recognition of arbitrary spike pattern has not yet been reported, which would contribute one step forward toward numerical implementation of a large-scale energy-efficient photonic SNN, and hence is interesting for neuromorphic photonic systems and spiking information processing.

[1]  Larry A. Coldren,et al.  Vertical cavity semiconductor optical amplifiers: comparison of Fabry-Perot and rate equation approaches , 2002 .

[2]  Joshua Robertson,et al.  Controlled inhibition of spiking dynamics in VCSELs for neuromorphic photonics: theory and experiments. , 2017, Optics letters.

[3]  Harish Bhaskaran,et al.  On-chip photonic synapse , 2017, Science Advances.

[4]  Qing Wu,et al.  Efficient and self-adaptive in-situ learning in multilayer memristor neural networks , 2018, Nature Communications.

[5]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[6]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[7]  S. Thorpe,et al.  STDP-based spiking deep convolutional neural networks for object recognition , 2018 .

[8]  Tim Gollisch,et al.  Rapid Neural Coding in the Retina with Relative Spike Latencies , 2008, Science.

[9]  Paul R. Prucnal,et al.  Recent progress in semiconductor excitable lasers for photonic spike processing , 2016 .

[10]  O. Prospero-Garcia,et al.  Reliability of Spike Timing in Neocortical Neurons , 1995 .

[11]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[12]  Antonio Hurtado,et al.  Investigation of vertical cavity surface emitting laser dynamics for neuromorphic photonic systems , 2012 .

[13]  Joshua Robertson,et al.  Controlled Propagation of Spiking Dynamics in Vertical-Cavity Surface-Emitting Lasers: Towards Neuromorphic Photonic Networks , 2017, IEEE Journal of Selected Topics in Quantum Electronics.

[14]  B. Romeira,et al.  Regenerative memory in time-delayed neuromorphic photonic resonators , 2016, Scientific Reports.

[15]  R Kuszelewicz,et al.  Relative refractory period in an excitable semiconductor laser. , 2014, Physical review letters.

[16]  Robert A. Nawrocki,et al.  A Mini Review of Neuromorphic Architectures and Implementations , 2016, IEEE Transactions on Electron Devices.

[17]  Mable P. Fok,et al.  Photonic implementation of a neuronal algorithm applicable towards angle of arrival detection and localization. , 2015, Optics express.

[18]  Sadik Esener,et al.  Rate Equations for modeling dispersive nonlinearity in Fabry-Perot semiconductor optical amplifiers. , 2003, Optics express.

[19]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[20]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[21]  Timothée Masquelier,et al.  Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity , 2007, PLoS Comput. Biol..

[22]  Xiao-Dong Lin,et al.  Stable Propagation of Inhibited Spiking Dynamics in Vertical-Cavity Surface-Emitting Lasers for Neuromorphic Photonic Networks , 2018, IEEE Access.

[23]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[24]  B. Riou,et al.  Long wavelength vertical-cavity semiconductor optical amplifiers , 2001 .

[25]  Giacomo Indiveri,et al.  A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses , 2015, Front. Neurosci..

[26]  Antonio Hurtado,et al.  Effects of parallel and orthogonal polarization on nonlinear optical characteristics of a 1550 nm VCSOA. , 2007, Optics express.

[27]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[28]  Yue Hao,et al.  Numerical Implementation of Wavelength-Dependent Photonic Spike Timing Dependent Plasticity Based on VCSOA , 2018, IEEE Journal of Quantum Electronics.

[29]  Sadik C. Esener,et al.  Static and dynamic analysis of an all-optical inverter based on a Vertical Cavity Semiconductor Optical Amplifier (VCSOA) , 2011 .

[30]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[31]  Yue Tian,et al.  Pulse lead/lag timing detection for adaptive feedback and control based on optical spike-timing-dependent plasticity. , 2013, Optics letters.

[32]  Yue Hao,et al.  Photonic Generation of Neuron-Like Dynamics Using VCSELs Subject to Double Polarized Optical Injection , 2018, Journal of Lightwave Technology.

[33]  Qiang Li,et al.  Optical implementation of neural learning algorithms based on cross-gain modulation in a semiconductor optical amplifier , 2016, SPIE/COS Photonics Asia.

[34]  B. Schrauwen,et al.  Cascadable excitability in microrings. , 2012, Optics express.

[35]  Antonio Hurtado,et al.  Optical neuron using polarisation switching in a 1550nm-VCSEL. , 2010, Optics express.

[36]  P. R. Prucnal,et al.  A Leaky Integrate-and-Fire Laser Neuron for Ultrafast Cognitive Computing , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[37]  S. Thorpe,et al.  Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains , 2008, PloS one.

[38]  H.-S. Philip Wong,et al.  Face classification using electronic synapses , 2017, Nature Communications.

[39]  Pritish Narayanan,et al.  Experimental Demonstration and Tolerancing of a Large-Scale Neural Network (165 000 Synapses) Using Phase-Change Memory as the Synaptic Weight Element , 2014, IEEE Transactions on Electron Devices.

[40]  Michael J. Adams,et al.  Analysis of semiconductor laser optical amplifiers , 1985 .

[41]  Franck Mamalet,et al.  Unsupervised Feature Learning With Winner-Takes-All Based STDP , 2018, Front. Comput. Neurosci..

[42]  Behrad Gholipour,et al.  Amorphous Metal‐Sulphide Microfibers Enable Photonic Synapses for Brain‐Like Computing , 2015 .

[43]  Ming Zhang,et al.  Darwin: A neuromorphic hardware co-processor based on spiking neural networks , 2017, J. Syst. Archit..

[44]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[45]  Yue Hao,et al.  Polarization-resolved and polarization- multiplexed spike encoding properties in photonic neuron based on VCSEL-SA , 2018, Scientific Reports.

[46]  J Gautrais,et al.  Rate coding versus temporal order coding: a theoretical approach. , 1998, Bio Systems.

[47]  Jongin Kim,et al.  Electronic system with memristive synapses for pattern recognition , 2015, Scientific Reports.

[48]  Takaaki Mukai,et al.  Performance predictions for vertical-cavity semiconductor laser amplifiers , 1994 .

[49]  Yusuf Leblebici,et al.  Neuromorphic computing with multi-memristive synapses , 2017, Nature Communications.

[50]  Jianye Zhao,et al.  Optical spike-timing-dependent plasticity with weight-dependent learning window and reward modulation. , 2015, Optics express.

[51]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[52]  Jim D. Garside,et al.  SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation , 2013, IEEE Journal of Solid-State Circuits.

[53]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[54]  Rufin van Rullen,et al.  Neurons Tune to the Earliest Spikes Through STDP , 2005, Neural Computation.

[55]  Ammar Belatreche,et al.  An online supervised learning method for spiking neural networks with adaptive structure , 2014, Neurocomputing.

[56]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[57]  Paul R. Prucnal,et al.  Photonic Implementation of Spike-Timing-Dependent Plasticity and Learning Algorithms of Biological Neural Systems , 2016, Journal of Lightwave Technology.

[58]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[59]  Paul R. Prucnal,et al.  Spike processing with a graphene excitable laser , 2016, Scientific Reports.

[60]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[61]  Timothée Masquelier,et al.  Competitive STDP-Based Spike Pattern Learning , 2009, Neural Computation.

[62]  J. Danckaert,et al.  Solitary and coupled semiconductor ring lasers as optical spiking neurons. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[63]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[64]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[65]  John E. Bowers,et al.  Design and analysis of vertical-cavity semiconductor optical amplifiers , 2001 .

[66]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[67]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[68]  Antonio Hurtado,et al.  Two-wavelength switching with 1550 nm semiconductor laser amplifiers , 2007 .

[69]  Xinxing Guo,et al.  Spike encoding and storage properties in mutually coupled vertical-cavity surface-emitting lasers subject to optical pulse injection. , 2018, Applied optics.

[70]  Stefan Schliebs,et al.  Span: Spike Pattern Association Neuron for Learning Spatio-Temporal Spike Patterns , 2012, Int. J. Neural Syst..

[71]  Wei Pan,et al.  Cascadable Neuron-Like Spiking Dynamics in Coupled VCSELs Subject to Orthogonally Polarized Optical Pulse Injection , 2017, IEEE Journal of Selected Topics in Quantum Electronics.