Delay dynamics of neuromorphic optoelectronic nanoscale resonators: Perspectives and applications.

With the recent exponential growth of applications using artificial intelligence (AI), the development of efficient and ultrafast brain-like (neuromorphic) systems is crucial for future information and communication technologies. While the implementation of AI systems using computer algorithms of neural networks is emerging rapidly, scientists are just taking the very first steps in the development of the hardware elements of an artificial brain, specifically neuromorphic microchips. In this review article, we present the current state of the art of neuromorphic photonic circuits based on solid-state optoelectronic oscillators formed by nanoscale double barrier quantum well resonant tunneling diodes. We address, both experimentally and theoretically, the key dynamic properties of recently developed artificial solid-state neuron microchips with delayed perturbations and describe their role in the study of neural activity and regenerative memory. This review covers our recent research work on excitable and delay dynamic characteristics of both single and autaptic (delayed) artificial neurons including all-or-none response, spike-based data encoding, storage, signal regeneration and signal healing. Furthermore, the neural responses of these neuromorphic microchips display all the signatures of extended spatio-temporal localized structures (LSs) of light, which are reviewed here in detail. By taking advantage of the dissipative nature of LSs, we demonstrate potential applications in optical data reconfiguration and clock and timing at high-speeds and with short transients. The results reviewed in this article are a key enabler for the development of high-performance optoelectronic devices in future high-speed brain-inspired optical memories and neuromorphic computing.

[1]  R Kuszelewicz,et al.  Relative refractory period in an excitable semiconductor laser. , 2014, Physical review letters.

[2]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[3]  Sylvain Barbay,et al.  Excitability in a semiconductor laser with saturable absorber. , 2011, Optics letters.

[4]  Zhenghua An,et al.  Quantum dot single-photon switches of resonant tunneling current for discriminating-photon-number detection , 2015, Scientific Reports.

[5]  Peter Davis,et al.  Oscillation modes of laser diode pumped hybrid bistable system with large delay and application to dynamical memory , 1992 .

[6]  Craig G Rusin,et al.  Engineering the synchronization of neuron action potentials using global time-delayed feedback stimulation. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Giovanni Giacomelli,et al.  Front pinning and localized states analogues in long-delayed bistable systems. , 2014, Physical review letters.

[8]  Koichi Maezawa,et al.  Ultra-Short Pulse Generators Using Resonant Tunneling Diodes and Their Integration with Antennas on Ceramic Substrates , 2007 .

[9]  B. Romeira,et al.  A Self-Synchronized Optoelectronic Oscillator Based on an RTD Photodetector and a Laser Diode , 2011, IEEE Photonics Technology Letters.

[10]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[11]  Narayan Srinivasa,et al.  A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications. , 2012, Nano letters.

[12]  Edward Wasige,et al.  28 GHz MMIC resonant tunnelling diode oscillator of around 1mW output power , 2013 .

[13]  T. Delbruck,et al.  A 128 128 120 dB 15 s Latency Asynchronous Temporal Contrast Vision Sensor , 2006 .

[14]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[15]  Jan Danckaert,et al.  Analytical and experimental study of two delay-coupled excitable units. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  B. Romeira,et al.  Nonlinear Dynamics of Resonant Tunneling Optoelectronic Circuits for Wireless/Optical Interfaces , 2009, IEEE Journal of Quantum Electronics.

[17]  Christoph S. Herrmann,et al.  Autapse Turns Neuron into oscillator , 2004, Int. J. Bifurc. Chaos.

[18]  B. Romeira,et al.  Optical Control of a Resonant Tunneling Diode Microwave-Photonic Oscillator , 2010, IEEE Photonics Technology Letters.

[19]  L. Lugiato,et al.  Cavity solitons as pixels in semiconductor microcavities , 2002, Nature.

[20]  P. Umbanhowar,et al.  Localized excitations in a vertically vibrated granular layer , 1996, Nature.

[21]  Salvador Balle,et al.  Excitability and optical pulse generation in semiconductor lasers driven by resonant tunneling diode photo-detectors. , 2013, Optics express.

[22]  E. Voges,et al.  Dynamics of electrooptic bistable devices with delayed feedback , 1982 .

[23]  Mark L. Brongersma,et al.  Electrically driven subwavelength optical nanocircuits , 2014, Nature Photonics.

[24]  P Coullet,et al.  A new approach to data storage using localized structures. , 2004, Chaos.

[25]  B. Romeira,et al.  A LiÉnard Oscillator Resonant Tunnelling Diode-Laser Diode Hybrid Integrated Circuit: Model and Experiment , 2008, IEEE Journal of Quantum Electronics.

[26]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[27]  V. I. Krinsky,et al.  Image processing using light-sensitive chemical waves , 1989, Nature.

[28]  Charles N. Ironside,et al.  Self-oscillation and period adding from resonant tunnelling diode-laser diode circuit , 2008 .

[29]  Giacomelli,et al.  Relationship between delayed and spatially extended dynamical systems. , 1996, Physical review letters.

[30]  Moses,et al.  Multistability and confined traveling-wave patterns in a convecting binary mixture. , 1987, Physical review. A, General physics.

[31]  Safumi Suzuki,et al.  Resonant Tunneling Diodes for Sub-Terahertz and Terahertz Oscillators , 2008 .

[32]  Ian Farrer,et al.  Spiking computation and stochastic amplification in a neuron-like semiconductor microstructure , 2011 .

[33]  Charles N. Ironside,et al.  Electric field switching in a resonant tunneling diode electroabsorption modulator , 2001 .

[34]  Kestutis Pyragas Continuous control of chaos by self-controlling feedback , 1992 .

[35]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[36]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[37]  B. Romeira,et al.  Chaotic Dynamics in Resonant Tunneling Optoelectronic Voltage Controlled Oscillators , 2009, IEEE Photonics Technology Letters.

[38]  E M Glaser,et al.  Autapses in neocortex cerebri: synapses between a pyramidal cell's axon and its own dendrites. , 1972, Brain research.

[39]  C.R. Stanley,et al.  The electric field switching in resonant, tunneling diode electroabsorption modulator , 2001, OFC 2001. Optical Fiber Communication Conference and Exhibit. Technical Digest Postconference Edition (IEEE Cat. 01CH37171).

[40]  C. Ironside,et al.  Investigation Into the Integration of a Resonant Tunnelling Diode and an Optical Communications Laser: Model and Experiment , 2007, IEEE Journal of Quantum Electronics.

[41]  J. Javaloyes,et al.  How Laser Localized Structures Evolve Out of Passive Mode-Locking , 2014, 2014 International Semiconductor Laser Conference.

[42]  John Guckenheimer,et al.  Mixed-Mode Oscillations with Multiple Time Scales , 2012, SIAM Rev..

[43]  D. Prince,et al.  Functional Autaptic Neurotransmission in Fast-Spiking Interneurons: A Novel Form of Feedback Inhibition in the Neocortex , 2003, The Journal of Neuroscience.

[44]  Bruno Romeira Dynamics of resonant tunneling diode optoelectronic oscillators , 2012 .

[45]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[46]  R. Avo,et al.  Stochastic induced dynamics in neuromorphic optoelectronic oscillators , 2014, Optical and Quantum Electronics.

[47]  Paul R. Prucnal,et al.  Recent progress in semiconductor excitable lasers for photonic spike processing , 2016 .

[48]  Salvador Balle,et al.  Coupled optical excitable cells. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  A. Hodgkin,et al.  Measurement of current‐voltage relations in the membrane of the giant axon of Loligo , 1952, The Journal of physiology.

[51]  Safumi Suzuki,et al.  Wireless data transmission of 30 Gbps at a 500-GHz range using resonant-tunneling-diode terahertz oscillator , 2016, 2016 IEEE MTT-S International Microwave Symposium (IMS).

[52]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[53]  H. Purwins,et al.  Plasma spots in a gas discharge system: birth, scattering and formation of molecules , 2001 .

[54]  P. Prucnal,et al.  NEUROMORPHIC PHOTONICS , 2017 .

[55]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[56]  S. Balle,et al.  Vectorial dissipative solitons in vertical-cavity surface-emitting lasers with delays , 2014, Nature Photonics.

[57]  H. Swinney,et al.  Experimental observation of self-replicating spots in a reaction–diffusion system , 1994, Nature.

[58]  Christophe Loyez,et al.  A 4-fJ/Spike Artificial Neuron in 65 nm CMOS Technology , 2017, Front. Neurosci..

[59]  Gabor Stepan,et al.  Delay effects in brain dynamics , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[60]  B. Romeira,et al.  Supplementary Note 1: Modeling of Grating Coupler , 2022 .

[61]  Dirk Roose,et al.  Numerical bifurcation analysis of delay differential equations using DDE-BIFTOOL , 2002, TOMS.

[62]  B. Romeira,et al.  Mixed mode oscillations in a forced optoelectronic circuit for pattern and random bit generation , 2014, Numerical Simulation of Optoelectronic Devices, 2014.

[63]  D Goulding,et al.  Excitability in a quantum dot semiconductor laser with optical injection. , 2007, Physical review letters.

[64]  A J Shields,et al.  Efficient single photon detection by quantum dot resonant tunneling diodes. , 2005, Physical review letters.

[65]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[66]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[67]  M. Gather,et al.  Advances in small lasers , 2014, Nature Photonics.

[68]  S. Coen,et al.  Temporal cavity solitons in one-dimensional Kerr media as bits in an all-optical buffer , 2010 .

[69]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[70]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[71]  K. Ikeda Multiple-valued stationary state and its instability of the transmitted light by a ring cavity system , 1979 .

[72]  Tokio Takahashi,et al.  Investigating the bistability characteristics of GaN/AlN resonant tunneling diodes for ultrafast nonvolatile memory , 2015 .

[73]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[74]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[75]  Adonis Bogris,et al.  Artificial Neuron Based on Integrated Semiconductor Quantum Dot Mode-Locked Lasers , 2016, Scientific Reports.

[76]  J. García-Ojalvo,et al.  Effects of noise in excitable systems , 2004 .

[77]  Tomoyuki Miyamoto,et al.  Terahertz imaging system with resonant tunneling diodes , 2016 .

[78]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[79]  Andrew J. Shields,et al.  Quantum dot resonant tunneling diode single photon detector with aluminum oxide aperture defined tunneling area , 2008 .

[80]  M. Hashemi,et al.  Effect of duration of synaptic activity on spike rate of a Hodgkin-Huxley neuron with delayed feedback. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[81]  H.J. De Los Santos,et al.  Physics-based RTD current-voltage equation , 1996, IEEE Electron Device Letters.

[82]  B. Romeira,et al.  Regenerative memory in time-delayed neuromorphic photonic resonators , 2016, Scientific Reports.

[83]  Giovanni Giacomelli,et al.  Spatio-temporal phenomena in complex systems with time delays , 2017, 2206.03120.

[84]  J Javaloyes,et al.  Arrest of Domain Coarsening via Antiperiodic Regimes in Delay Systems. , 2015, Physical review letters.

[85]  I. Rudnick,et al.  Observation of a nonpropagating hydrodynamic soliton , 1984 .

[86]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[87]  Koichi Maezawa,et al.  Ultrashort Pulse Generators Using Resonant Tunneling Diodes and Their Integration with Antennas on Ceramic Substrates , 2007 .

[88]  H. I. Cantu,et al.  Delayed Feedback Dynamics of Liénard-Type Resonant Tunneling-Photo-Detector Optoelectronic Oscillators , 2013, IEEE Journal of Quantum Electronics.

[89]  N. Buric,et al.  Dynamics of FitzHugh-Nagumo excitable systems with delayed coupling. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[90]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[91]  D. Bassett,et al.  Autaptic Connections Shift Network Excitability and Bursting , 2016, Scientific Reports.

[92]  Yong Chen,et al.  Effect of an autapse on the firing pattern transition in a bursting neuron , 2014, Commun. Nonlinear Sci. Numer. Simul..

[93]  J. Javaloyes,et al.  Topological solitons as addressable phase bits in a driven laser , 2014, Nature Communications.

[94]  Maria J. Avedillo,et al.  Synchronisation and chaos in a laser diode driven by a resonant tunnelling diode , 2008 .

[95]  Joaquim F. Martins-Filho,et al.  Modeling of light-sensitive resonant-tunneling-diode devices , 2004 .

[96]  P. Somogyi,et al.  Massive Autaptic Self-Innervation of GABAergic Neurons in Cat Visual Cortex , 1997, The Journal of Neuroscience.

[97]  Jianping Yao,et al.  Broadband Chaotic Signals and Breather Oscillations in an Optoelectronic Oscillator Incorporating a Microwave Photonic Filter , 2014, Journal of Lightwave Technology.

[98]  Sven Höfling,et al.  Photocurrent-voltage relation of resonant tunneling diode photodetectors , 2015 .

[99]  Jianping Yao,et al.  High-Speed Spiking and Bursting Oscillations in a Long-Delayed Broadband Optoelectronic Oscillator , 2015, Journal of Lightwave Technology.

[100]  Sven Höfling,et al.  Sensitivity of resonant tunneling diode photodetectors , 2016, Nanotechnology.

[101]  Dieter Jäger,et al.  An MMIC implementation of FitzHugh–Nagumo neurons using a resonant tunneling diode nonlinear transmission line , 2015 .

[102]  Monica Hoyos Flight Neuromodulation: Exerting self-control for persistence , 2009, Nature Reviews Neuroscience.

[103]  Hengtong Wang,et al.  Effect of autaptic activity on the response of a Hodgkin-Huxley neuron. , 2014, Chaos.

[104]  Henrique M. Salgado,et al.  Photo-Detectors Integrated with Resonant Tunneling Diodes , 2013, Sensors.

[105]  Tasawar Hayat,et al.  Autaptic regulation of electrical activities in neuron under electromagnetic induction , 2017, Scientific Reports.

[106]  Philipp Hövel,et al.  Time-delayed feedback in neurosystems , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[107]  Joshua Robertson,et al.  Controlled inhibition of spiking dynamics in VCSELs for neuromorphic photonics: theory and experiments. , 2017, Optics letters.

[108]  J. Javaloyes,et al.  Electrical addressing and temporal tweezing of localized pulses in passively mode-locked semiconductor lasers , 2017, 2017 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC).

[109]  Nynke H. Dekker,et al.  Excitable Particles in an Optical Torque Wrench , 2011 .

[110]  B Kelleher,et al.  Excitation regeneration in delay-coupled oscillators. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.