A review: Photonics devices, architectures, and algorithms for optical neural computing

The explosive growth of data and information has motivated various emerging non-von Neumann computational approaches in the More-than-Moore era. Photonics neuromorphic computing has attracted lots of attention due to the fascinating advantages such as high speed, wide bandwidth, and massive parallelism. Here, we offer a review on the optical neural computing in our research groups at the device and system levels. The photonics neuron and photonics synapse plasticity are presented. In addition, we introduce several optical neural computing architectures and algorithms including photonic spiking neural network, photonic convolutional neural network, photonic matrix computation, photonic reservoir computing, and photonic reinforcement learning. Finally, we summarize the major challenges faced by photonic neuromorphic computing, and propose promising solutions and perspectives.

[1]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[2]  Xu Wang,et al.  Chip-Scale Optical Matrix Computation for PageRank Algorithm , 2020, IEEE Journal of Selected Topics in Quantum Electronics.

[3]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[4]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[5]  Yue Hao,et al.  Photonic Generation of Neuron-Like Dynamics Using VCSELs Subject to Double Polarized Optical Injection , 2018, Journal of Lightwave Technology.

[6]  Paul R. Prucnal,et al.  Recent progress in semiconductor excitable lasers for photonic spike processing , 2016 .

[7]  Harish Bhaskaran,et al.  On-chip photonic synapse , 2017, Science Advances.

[8]  Sailing He,et al.  Efficient Hybrid Integration of Long-Wavelength VCSELs on Silicon Photonic Circuits , 2020, Journal of Lightwave Technology.

[9]  M. Mitchell Waldrop,et al.  The chips are down for Moore’s law , 2016, Nature.

[10]  Wei Pan,et al.  Emulation of Spiking Response and Spiking Frequency Property in VCSEL-Based Photonic Neuron , 2016, IEEE Photonics Journal.

[11]  J. Feldmann,et al.  All-optical spiking neurosynaptic networks with self-learning capabilities , 2019, Nature.

[12]  An He,et al.  Recent advances of heterogeneously integrated III–V laser on Si , 2019, Journal of Semiconductors.

[13]  Yue Hao,et al.  Polarization-resolved and polarization- multiplexed spike encoding properties in photonic neuron based on VCSEL-SA , 2018, Scientific Reports.

[14]  Yue Hao,et al.  Photonic spiking neural network based on excitable VCSELs-SA for sound azimuth detection. , 2020, Optics express.

[15]  Yue Wang,et al.  Recent progress on optoelectronic synaptic devices , 2020 .

[16]  Xinxing Guo,et al.  Spike encoding and storage properties in mutually coupled vertical-cavity surface-emitting lasers subject to optical pulse injection. , 2018, Applied optics.

[17]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[18]  Shuiying Xiang,et al.  Real-time optical spike-timing dependent plasticity in a single VCSEL with dual-polarized pulsed optical injection , 2020, Science China Information Sciences.

[19]  C. Wright,et al.  Photonics for artificial intelligence and neuromorphic computing , 2020, ArXiv.

[20]  Weiwen Zou,et al.  Towards silicon photonic neural networks for artificial intelligence , 2020, Science China Information Sciences.

[21]  Jianji Dong,et al.  An optical processor for matrix computation on Silicon-On-Insulator , 2019, 2019 24th OptoElectronics and Communications Conference (OECC) and 2019 International Conference on Photonics in Switching and Computing (PSC).

[22]  M. C. Soriano,et al.  Advances in photonic reservoir computing , 2017 .

[23]  Yue Hao,et al.  High-Speed Neuromorphic Reservoir Computing Based on a Semiconductor Nanolaser With Optical Feedback Under Electrical Modulation , 2020, IEEE Journal of Selected Topics in Quantum Electronics.

[24]  Aijun Wen,et al.  The Winner-Take-All Mechanism for All-Optical Systems of Pattern Recognition and Max-Pooling Operation , 2020, Journal of Lightwave Technology.

[25]  Fei Zhuge,et al.  Photonic Synapses for Ultrahigh‐Speed Neuromorphic Computing , 2019, physica status solidi (RRL) – Rapid Research Letters.

[26]  W. A. Sasangka,et al.  A review of silicon-based wafer bonding processes, an approach to realize the monolithic integration of Si-CMOS and III–V-on-Si wafers , 2021, Journal of Semiconductors.

[27]  Weiwen Zou,et al.  Towards an intelligent photonic system , 2020, Science China Information Sciences.

[28]  Yue Hao,et al.  All-optical neuromorphic XOR operation with inhibitory dynamics of a single photonic spiking neuron based on a VCSEL-SA. , 2020, Optics letters.

[29]  Qiang Li,et al.  Optical implementation of neural learning algorithms based on cross-gain modulation in a semiconductor optical amplifier , 2016, SPIE/COS Photonics Asia.

[30]  G.E. Moore,et al.  Cramming More Components Onto Integrated Circuits , 1998, Proceedings of the IEEE.

[31]  Meng-Fan Chang,et al.  Neuro-inspired computing chips , 2020, Nature Electronics.

[32]  Shuiying Xiang,et al.  Enhanced memory capacity of a neuromorphic reservoir computing system based on a VCSEL with double optical feedbacks , 2020, Science China Information Sciences.

[33]  Henry Markram,et al.  Fading memory and kernel properties of generic cortical microcircuit models , 2004, Journal of Physiology-Paris.

[34]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[35]  Yang Wang,et al.  Generation of multi-channel chaotic signals with time delay signature concealment and ultrafast photonic decision making based on a globally-coupled semiconductor laser network , 2020 .

[36]  Yue Hao,et al.  Time-delay signature concealment of chaos and ultrafast decision making in mutually coupled semiconductor lasers with a phase-modulated Sagnac loop. , 2020, Optics express.

[37]  Joshua Robertson,et al.  Toward Neuromorphic Photonic Networks of Ultrafast Spiking Laser Neurons , 2020, IEEE Journal of Selected Topics in Quantum Electronics.

[38]  Dingshan Gao,et al.  Self-Configuring and Reconfigurable Silicon Photonic Signal Processor , 2020, ACS Photonics.

[39]  Paul R. Prucnal,et al.  Machine Learning With Neuromorphic Photonics , 2019, Journal of Lightwave Technology.

[40]  Mikio Hasegawa,et al.  Scalable photonic reinforcement learning by time-division multiplexing of laser chaos , 2018, Scientific Reports.

[41]  Jianping Chen,et al.  A DFB-LD-Based Photonic Neuromorphic Network for Spatiotemporal Pattern Recognition , 2020, 2020 Optical Fiber Communications Conference and Exhibition (OFC).

[42]  Joshua Robertson,et al.  Controlled inhibition of spiking dynamics in VCSELs for neuromorphic photonics: theory and experiments. , 2017, Optics letters.

[43]  Antonio Hurtado,et al.  Optical neuron using polarisation switching in a 1550nm-VCSEL. , 2010, Optics express.

[44]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[45]  Weiwen Zou,et al.  Demonstration of a distributed feedback laser diode working as a graded-potential-signaling photonic neuron and its application to neuromorphic information processing , 2020, Science China Information Sciences.

[46]  P. R. Prucnal,et al.  A Leaky Integrate-and-Fire Laser Neuron for Ultrafast Cognitive Computing , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[47]  Ru Huang,et al.  A comprehensive review on emerging artificial neuromorphic devices , 2020, Applied Physics Reviews.

[48]  Xinliang Zhang,et al.  All-in-one silicon photonic polarization processor , 2019, Nanophotonics.

[49]  Paul R. Prucnal,et al.  Progress in neuromorphic photonics , 2017 .

[50]  Wei Pan,et al.  Cascadable Neuron-Like Spiking Dynamics in Coupled VCSELs Subject to Orthogonally Polarized Optical Pulse Injection , 2017, IEEE Journal of Selected Topics in Quantum Electronics.

[51]  Y. Hao,et al.  Enhanced Prediction Performance of a Neuromorphic Reservoir Computing System Using a Semiconductor Nanolaser With Double Phase Conjugate Feedbacks , 2021, Journal of Lightwave Technology.

[52]  Toshiyuki Yamane,et al.  Recent Advances in Physical Reservoir Computing: A Review , 2018, Neural Networks.

[53]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[54]  Jianye Zhao,et al.  Optical spike-timing-dependent plasticity with weight-dependent learning window and reward modulation. , 2015, Optics express.

[55]  Antonio Hurtado,et al.  Investigation of vertical cavity surface emitting laser dynamics for neuromorphic photonic systems , 2012 .

[56]  Xiao-Dong Lin,et al.  Stable Propagation of Inhibited Spiking Dynamics in Vertical-Cavity Surface-Emitting Lasers for Neuromorphic Photonic Networks , 2018, IEEE Access.

[57]  Laurent Larger,et al.  Tutorial: Photonic Neural Networks in Delay Systems , 2018, Journal of Applied Physics.

[58]  Paul R. Prucnal,et al.  Photonic Implementation of Spike-Timing-Dependent Plasticity and Learning Algorithms of Biological Neural Systems , 2016, Journal of Lightwave Technology.

[59]  Y. Hao,et al.  Four-channels reservoir computing based on polarization dynamics in mutually coupled VCSELs system. , 2019, Optics express.

[60]  Kaushik Roy,et al.  Towards spike-based machine intelligence with neuromorphic computing , 2019, Nature.

[61]  Mable P. Fok,et al.  Photonic implementation of a neuronal algorithm applicable towards angle of arrival detection and localization. , 2015, Optics express.

[62]  Shuiying Xiang,et al.  STDP-Based Unsupervised Spike Pattern Learning in a Photonic Spiking Neural Network With VCSELs and VCSOAs , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[63]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[64]  Yue Hao,et al.  Numerical Implementation of Wavelength-Dependent Photonic Spike Timing Dependent Plasticity Based on VCSOA , 2018, IEEE Journal of Quantum Electronics.

[65]  Weiwen Zou,et al.  High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays. , 2019, Optics express.

[66]  Joshua Robertson,et al.  Controlled Propagation of Spiking Dynamics in Vertical-Cavity Surface-Emitting Lasers: Towards Neuromorphic Photonic Networks , 2017, IEEE Journal of Selected Topics in Quantum Electronics.

[67]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[68]  Lin Lin,et al.  Polarization Multiplexing Reservoir Computing Based on a VCSEL With Polarized Optical Feedback , 2020, IEEE Journal of Selected Topics in Quantum Electronics.

[69]  Yue Hao,et al.  Computing Primitive of Fully VCSEL-Based All-Optical Spiking Neural Network for Supervised Learning and Pattern Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[70]  Li Yu,et al.  Development trends in silicon photonics , 2013 .

[71]  Rajeev J Ram,et al.  Integrating photonics with silicon nanoelectronics for the next generation of systems on a chip , 2018, Nature.

[72]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[73]  Lei Yu,et al.  Deep-learning-powered photonic analog-to-digital conversion , 2019, Light, science & applications.

[74]  Yong-Hoon Kim,et al.  Recent Progress of Optoelectronic and All‐Optical Neuromorphic Devices: A Comprehensive Review of Device Structures, Materials, and Applications , 2020, Adv. Intell. Syst..

[75]  Genquan Han,et al.  Spike Sequence Learning in a Photonic Spiking Neural Network Consisting of VCSELs-SA With Supervised Training , 2020, IEEE Journal of Selected Topics in Quantum Electronics.

[76]  Zhiping Zhou,et al.  On-chip light sources for silicon photonics , 2015, Light: Science & Applications.

[77]  Gordon Wetzstein,et al.  Inference in artificial intelligence with deep optics and photonics , 2020, Nature.

[78]  Weiwen Zou,et al.  Optical patching scheme for optical convolutional neural networks based on wavelength-division multiplexing and optical delay lines. , 2020, Optics letters.

[79]  Yue Hao,et al.  Photonic Associative Learning Neural Network Based on VCSELs and STDP , 2020, Journal of Lightwave Technology.

[80]  J. Danckaert,et al.  Solitary and coupled semiconductor ring lasers as optical spiking neurons. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[81]  Aleksandar Nesic,et al.  Hybrid integration of silicon photonics circuits and InP lasers by photonic wire bonding , 2018, Optica.

[82]  Multipurpose Photonic Polarization Processor Chip , 2019, 2019 Asia Communications and Photonics Conference (ACP).

[83]  S. Xiang,et al.  All-optical inhibitory dynamics in photonic neuron based on polarization mode competition in a VCSEL with an embedded saturable absorber. , 2019, Optics letters.