An all-optical neuron with sigmoid activation function.

We present an all-optical neuron that utilizes a logistic sigmoid activation function, using a Wavelength-Division Multiplexing (WDM) input & weighting scheme. The activation function is realized by means of a deeply-saturated differentially-biased Semiconductor Optical Amplifier-Mach-Zehnder Interferometer (SOA-MZI) followed by a SOA-Cross-Gain-Modulation (XGM) gate. Its transfer function is both experimentally and theoretically analyzed, showing excellent agreement between theory and experiment and an almost perfect fitting with a logistic sigmoid function. The optical sigmoid transfer function is then exploited in the experimental demonstration of a photonic neuron, demonstrating successful thresholding over a 100psec-long pulse sequence with 4 different weighted-and-summed power levels.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[3]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[4]  N. Pleros,et al.  40 Gb/s NRZ Wavelength Conversion Using a Differentially-Biased SOA-MZI: Theory and Experiment , 2011, Journal of Lightwave Technology.

[5]  Paul R. Prucnal,et al.  Broadcast and Weight: An Integrated Network For Scalable Photonic Spike Processing , 2014, Journal of Lightwave Technology.

[6]  Paul R Prucnal,et al.  A high performance photonic pulse processing device. , 2009, Optics express.

[7]  G. Morthier,et al.  A novel optical decision circuit based on a Mach-Zehnder or Michelson interferometer and gain-clamped semiconductor optical amplifiers , 1998, IEEE Photonics Technology Letters.

[8]  Wang,et al.  In-Datacenter Performance Analysis of a Tensor Processing UnitTM , .

[9]  Mario Miscuglio,et al.  All-optical nonlinear activation function for photonic neural networks [Invited] , 2018, Optical Materials Express.

[10]  P. R. Prucnal,et al.  A Leaky Integrate-and-Fire Laser Neuron for Ultrafast Cognitive Computing , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[11]  P. F. Vasconcelos,et al.  In situ immune response and mechanisms of cell damage in central nervous system of fatal cases microcephaly by Zika virus , 2018, Scientific Reports.

[12]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[13]  John Shalf,et al.  Computing beyond Moore's Law , 2015, Computer.

[14]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[15]  Lixia Zhao,et al.  Sequestration and bioavailability of perfluoroalkyl acids (PFAAs) in soils: Implications for their underestimated risk. , 2016, The Science of the total environment.

[16]  Paul R Prucnal,et al.  Ultrafast all-optical implementation of a leaky integrate-and-fire neuron. , 2011, Optics express.

[17]  G. Pazour,et al.  Ror2 signaling regulates Golgi structure and transport through IFT20 for tumor invasiveness , 2017, Scientific Reports.

[18]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[19]  John Chang,et al.  Demonstration of WDM weighted addition for principal component analysis. , 2015, Optics express.

[20]  P. R. Prucnal,et al.  Power Transfer Function Tailoring in a Highly Ge-Doped Nonlinear Interferometer-Based All-Optical Thresholder Using Offset-Spectral Filtering , 2012, IEEE Photonics Journal.

[21]  Paul R. Prucnal,et al.  An integrated analog O/E/O link for multi-channel laser neurons , 2016 .

[22]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  M. Cecchini,et al.  Ultrastructural Characterization of the Lower Motor System in a Mouse Model of Krabbe Disease , 2016, Scientific Reports.

[24]  A. N. Tait,et al.  The DREAM: An Integrated Photonic Thresholder , 2013, Journal of Lightwave Technology.

[25]  N. Pleros,et al.  Recipe for intensity modulation reduction in SOA-based interferometric switches , 2004, Journal of Lightwave Technology.

[26]  Atomic Structures and Electronic States of Divalent Bismuth in Bi-Doped Silica Optical Fiber , 2018, IEEE Journal of Selected Topics in Quantum Electronics.