Fully analogue photonic reservoir computer

Introduced a decade ago, reservoir computing is an efficient approach for signal processing. State of the art capabilities have already been demonstrated with both computer simulations and physical implementations. If photonic reservoir computing appears to be promising a solution for ultrafast nontrivial computing, all the implementations presented up to now require digital pre or post processing, which prevents them from exploiting their full potential, in particular in terms of processing speed. We address here the possibility to get rid simultaneously of both digital pre and post processing. The standalone fully analogue reservoir computer resulting from our endeavour is compared to previous experiments and only exhibits rather limited degradation of performances. Our experiment constitutes a proof of concept for standalone physical reservoir computers.

[1]  Peter Tiño,et al.  Minimum Complexity Echo State Network , 2011, IEEE Transactions on Neural Networks.

[2]  Simon Haykin,et al.  Decoupled echo state networks with lateral inhibition , 2007, Neural Networks.

[3]  Dimitris Syvridis,et al.  Micro ring resonators as building blocks for an all-optical high-speed reservoir-computing bit-pattern-recognition system , 2013 .

[4]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[5]  J.J. Steil,et al.  Backpropagation-decorrelation: online recurrent learning with O(N) complexity , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[6]  Laurent Larger,et al.  Chaotic breathers in delayed electro-optical systems. , 2005, Physical review letters.

[7]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[8]  Mantas Lukosevicius,et al.  A Practical Guide to Applying Echo State Networks , 2012, Neural Networks: Tricks of the Trade.

[9]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[10]  Adonis Bogris,et al.  High-speed all-optical pattern recognition of dispersive Fourier images through a photonic reservoir computing subsystem. , 2015, Optics letters.

[11]  Hans Hallez,et al.  Automatic detection of epileptic seizures on the intra-cranial electroencephalogram of rats using reservoir computing , 2011, Artif. Intell. Medicine.

[12]  I. Bizjak,et al.  Measurement of the wrong-sign decays D0 --> K+ pi- pi0 and D0 --> K+ pi- pi+ pi-, and search for CP violation. , 2005, Physical review letters.

[13]  Laurent Larger,et al.  Photonic nonlinear transient computing with multiple-delay wavelength dynamics. , 2012, Physical review letters.

[14]  Ingo Fischer,et al.  High-Speed Optical Vector and Matrix Operations Using a Semiconductor Laser , 2013, IEEE Photonics Technology Letters.

[15]  Laurent Larger,et al.  From flow to map in an experimental high-dimensional electro-optic nonlinear delay oscillator. , 2005, Physical review letters.

[16]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[17]  Fang Liu,et al.  Integrated photonic reservoir computing based on hierarchical time-multiplexing structure , 2015, CLEO 2015.

[18]  Peter Tiño,et al.  Simple Deterministically Constructed Recurrent Neural Networks , 2010, IDEAL.

[19]  M. C. Soriano,et al.  Information Processing Using Transient Dynamics of Semiconductor Lasers Subject to Delayed Feedback , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[20]  Jan Danckaert,et al.  Constructing optimized binary masks for reservoir computing with delay systems , 2014, Scientific Reports.

[21]  Benjamin Schrauwen,et al.  Toward optical signal processing using photonic reservoir computing. , 2008, Optics express.

[22]  Miguel C. Soriano,et al.  Reservoir computing with a single time-delay autonomous Boolean node , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Miguel C. Soriano,et al.  Minimal approach to neuro-inspired information processing , 2015, Front. Comput. Neurosci..

[24]  Miguel C. Soriano,et al.  Photonic delay systems as machine learning implementations , 2015, J. Mach. Learn. Res..

[25]  Benjamin Schrauwen,et al.  Analog readout for optical reservoir computers , 2012, NIPS.

[26]  Laurent Larger,et al.  Routes to chaos and multiple time scale dynamics in broadband bandpass nonlinear delay electro-optic oscillators. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Fernando José Von Zuben,et al.  An extended echo state network using Volterra filtering and principal component analysis , 2012, Neural Networks.

[28]  Li Fang,et al.  All-optical reservoir computer based on saturation of absorption. , 2014, Optics express.

[29]  Serge Massar,et al.  All-optical Reservoir Computing , 2012, Optics express.

[30]  Benjamin Schrauwen,et al.  Optoelectronic Reservoir Computing , 2011, Scientific Reports.

[31]  Thomas Villmann,et al.  Generalized Derivative Based Kernelized Learning Vector Quantization , 2010, IDEAL.

[32]  Fernando José Von Zuben,et al.  An echo state network architecture based on volterra filtering and PCA with application to the channel equalization problem , 2011, The 2011 International Joint Conference on Neural Networks.

[33]  L. Larger,et al.  Optoelectronic reservoir computing: tackling noise-induced performance degradation. , 2013, Optics express.

[34]  Marc Haelterman,et al.  Virtual Optical Reservoir Computing , 2014 .

[35]  Benjamin Schrauwen,et al.  Nanophotonic Reservoir Computing With Photonic Crystal Cavities to Generate Periodic Patterns , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[37]  Romain Modeste Nguimdo,et al.  Fast photonic information processing using semiconductor lasers with delayed optical feedback: role of phase dynamics. , 2014, Optics express.

[38]  Chrisantha Fernando,et al.  Pattern Recognition in a Bucket , 2003, ECAL.

[39]  Serge Massar,et al.  High performance photonic reservoir computer based on a coherently driven passive cavity , 2015, ArXiv.

[40]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[41]  Serge Massar,et al.  Analog input layer for optical reservoir computers , 2014, ArXiv.

[42]  Benjamin Schrauwen,et al.  Reservoir computing: a photonic neural network for information processing , 2010, Photonics Europe.

[43]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[44]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[45]  Herbert Jaeger,et al.  Optimization and applications of echo state networks with leaky- integrator neurons , 2007, Neural Networks.

[46]  Benjamin Schrauwen,et al.  Phoneme Recognition with Large Hierarchical Reservoirs , 2010, NIPS.

[47]  L Pesquera,et al.  Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. , 2012, Optics express.

[48]  Benjamin Schrauwen,et al.  Event detection and localization for small mobile robots using reservoir computing , 2008, Neural Networks.

[49]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[50]  Benjamin Schrauwen,et al.  Parallel Reservoir Computing Using Optical Amplifiers , 2011, IEEE Transactions on Neural Networks.

[51]  Geert Morthier,et al.  Experimental demonstration of reservoir computing on a silicon photonics chip , 2014, Nature Communications.

[52]  Jan Danckaert,et al.  Delay-Based Reservoir Computing: Noise Effects in a Combined Analog and Digital Implementation , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[53]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .