Photonic Neuromorphic Signal Processing and Computing

There has been a recent explosion of interest in spiking neural networks (SNNs), which code information as spikes or events in time. Spike encoding is widely accepted as the information medium underlying the brain, but it has also inspired a new generation of neuromorphic hardware. Although electronics can match biological time scales and exceed them, they eventually reach a bandwidth fan-in trade-off. An alternative platform is photonics, which could process highly interactive information at speeds that electronics could never reach. Correspondingly, processing techniques inspired by biology could compensate for many of the shortcomings that bar digital photonic computing from feasibility, including high defect rates and signal control problems. We summarize properties of photonic spike processing and initial experiments with discrete components. A technique for mapping this paradigm to scalable, integrated laser devices is explored and simulated in small networks. This approach promises to wed the advantageous aspects of both photonic physics and unconventional computing systems. Further development could allow for fully scalable photonic networks that would open up a new domain of ultrafast, robust, and adaptive processing. Applications of this technology ranging from nanosecond response control systems to fast cognitive radio could potentially revitalize specialized photonic computing.

[1]  Antonio Hurtado,et al.  Optical neuron using polarisation switching in a 1550nm-VCSEL. , 2010, Optics express.

[2]  T. Krauss,et al.  An out-of-plane grating coupler for efficient butt-coupling between compact planar waveguides and single-mode fibers , 2002 .

[3]  M. A. Fisher,et al.  Self-pulsations in vertical-cavity surface emitting lasers , 1995 .

[4]  E. Bienenstock A model of neocortex , 1995 .

[5]  Francis T. S. Yu,et al.  Overview of hybrid optical neural networks , 1996 .

[6]  P. Jonker,et al.  A defect-?and fault-tolerant architecture for nanocomputers , 2003 .

[7]  G. Snider,et al.  Self-organized computation with unreliable, memristive nanodevices , 2007 .

[8]  Y Li,et al.  VCSEL-array-based angle-multiplexed optoelectronic crossbar interconnects. , 1996, Applied optics.

[9]  B. Krauskopf,et al.  Self-pulsations of lasers with saturable absorber: dynamics and bifurcations , 1999 .

[10]  Paul R Prucnal,et al.  Simple nonlinear interferometer-based all-optical thresholder and its applications for optical CDMA. , 2007, Optics express.

[11]  Yue Tian,et al.  Asynchronous spiking photonic neuron for lightwave neuromorphic signal processing. , 2012, Optics letters.

[12]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[13]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[14]  David Renshaw,et al.  Custom Integrated Circuits Conference (CICC) , 1990 .

[15]  Paul R Prucnal,et al.  Ultrafast all-optical implementation of a leaky integrate-and-fire neuron. , 2011, Optics express.

[16]  A. N. Tait,et al.  The DREAM: An Integrated Photonic Thresholder , 2013, Journal of Lightwave Technology.

[17]  E. Ozbay Plasmonics: Merging Photonics and Electronics at Nanoscale Dimensions , 2006, Science.

[18]  Leslie S. Smith,et al.  NEUROMORPHIC SYSTEMS AND THEORY , 1998 .

[19]  C. Chen,et al.  Circuit Modeling of Carrier–Photon Dynamics in Composite-Resonator Vertical-Cavity Lasers , 2011, IEEE Journal of Quantum Electronics.

[20]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[21]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[22]  Yutaka Sakai,et al.  Temporally correlated inputs to leaky integrate-and-fire models can reproduce spiking statistics of cortical neurons , 1999, Neural Networks.

[23]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[24]  Hans Wenzel,et al.  Mechanisms of fast self pulsations in two-section DFB lasers , 1996 .

[25]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[26]  H. Lin,et al.  VCSELs with monolithic coupling to internal horizontal waveguides using integrated diffraction gratings , 2004 .

[27]  Eric L. Schwartz,et al.  Computing with the Leaky Integrate-and-Fire Neuron: Logarithmic Computation and Multiplication , 1997, Neural Computation.

[28]  Rüdiger Paschotta,et al.  Experimentally confirmed design guidelines for passively Q-switched microchip lasers using semiconductor saturable absorbers , 2001 .

[29]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[30]  Bhavin J. Shastri,et al.  Face recognition using localized features based on non-negative sparse coding , 2006, Machine Vision and Applications.

[31]  P. R. Prucnal,et al.  A Leaky Integrate-and-Fire Laser Neuron for Ultrafast Cognitive Computing , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[32]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[33]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[34]  Demetri Psaltis,et al.  Optical Neural Computers , 1987, Topical Meeting on Optical Computing.

[35]  Paul R. Prucnal,et al.  Graphene excitable laser for photonic spike processing , 2013, 2013 IEEE Photonics Conference.

[36]  Andreas Mayr,et al.  CrossNets: High‐Performance Neuromorphic Architectures for CMOL Circuits , 2003, Annals of the New York Academy of Sciences.

[37]  Kevin L. Lear,et al.  Differential carrier lifetime in oxide-confined vertical cavity lasers obtained from electrical impedance measurements , 1999 .

[38]  Lutz Schimansky-Geier,et al.  Maximizing spike train coherence or incoherence in the leaky integrate-and-fire model. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Antonio Hurtado,et al.  Investigation of vertical cavity surface emitting laser dynamics for neuromorphic photonic systems , 2012 .

[40]  Gal Chechik,et al.  Spike-Timing-Dependent Plasticity and Relevant Mutual Information Maximization , 2003, Neural Computation.

[41]  Paul R Prucnal,et al.  A high performance photonic pulse processing device. , 2009, Optics express.

[42]  Dharmendra S. Modha,et al.  Cognitive Computing , 2011, Informatik-Spektrum.

[43]  L. Coldren,et al.  Diode Lasers and Photonic Integrated Circuits , 1995 .

[44]  Benjamin Schrauwen,et al.  Toward optical signal processing using photonic reservoir computing. , 2008, Optics express.

[45]  Jochen Triesch,et al.  Independent Component Analysis in Spiking Neurons , 2010, PLoS Comput. Biol..

[46]  Rahul Sarpeshkar,et al.  Analog Versus Digital: Extrapolating from Electronics to Neurobiology , 1998, Neural Computation.

[47]  Huug de Waardt,et al.  All fiber-optic neural network using coupled SOA based ring lasers , 2002, IEEE Trans. Neural Networks.

[48]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[49]  Wilfred Pinfold,et al.  Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis , 2009, HiPC 2009.

[50]  Yue Tian,et al.  Signal feature recognition based on lightwave neuromorphic signal processing. , 2011, Optics letters.

[51]  Neil Mathur,et al.  Nanotechnology: Beyond the silicon roadmap , 2002, Nature.

[52]  Christof Koch,et al.  Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits , 1994 .

[53]  Leslie S. Smith,et al.  Neuromorphic Systems: Engineering Silicon from Neurobiology , 1998 .

[54]  Christof Koch,et al.  Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series) , 1998 .

[55]  Fumio Koyama,et al.  Recent advances in VCSEL photonics , 2006, 16th Opto-Electronics and Communications Conference.

[56]  P. Simmons,et al.  Nerve Cells and Animal Behaviour , 1989 .

[57]  Paul R. Prucnal,et al.  Exploring excitability in graphene for spike processing networks , 2013, 2013 13th International Conference on Numerical Simulation of Optoelectronic Devices (NUSOD).

[58]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[59]  Sylvain Barbay,et al.  Excitability in a semiconductor laser with saturable absorber. , 2011, Optics letters.

[60]  Paul R. Prucnal,et al.  An evanescent hybrid silicon laser neuron , 2013, 2013 IEEE Photonics Conference.

[61]  Jochen Triesch,et al.  A Gradient Rule for the Plasticity of a Neuron's Intrinsic Excitability , 2005, ICANN.

[62]  S. Charpier,et al.  Spike‐Dependent Intrinsic Plasticity Increases Firing Probability in Rat Striatal Neurons In Vivo , 2003, The Journal of physiology.

[63]  R. Malenka,et al.  Synaptic scaling mediated by glial TNF-α , 2006, Nature.

[64]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[65]  Grzegorz M. Wójcik,et al.  Liquid State Machine Built of Hodgkin-Huxley Neurons , 2004, Informatica.

[67]  P. R. Prucnal,et al.  A dual resonator enhanced asymmetric Mach-Zehnder: Ultrafast passive thresholder for silicon-on-insulator , 2012, 2012 International Conference on Optical MEMS and Nanophotonics.

[68]  J. Danckaert,et al.  Solitary and coupled semiconductor ring lasers as optical spiking neurons. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[69]  G. Tononi Consciousness as Integrated Information: a Provisional Manifesto , 2008, The Biological Bulletin.