Impact of coupling topology upon noise robustness of small optical reservoirs

In this work, we perform the numerical investigation of the performance of the small optical reservoir computing (RC) systems with four neurons using the commercial software for optical fiber communication system. The small optical RC system consists of the components of the optical fiber communication. The nonlinear function which is required in RC is provided by the erbium-doped optical fiber amplifiers (EDFA). We demonstrate that the EDFA should be operated in the saturated or non-linear regime to obtain a better performance of the small optical RC system. The performance of the small optical RC systems for different topological neuron structures is investigated. The results show that the interconnection between the neurons could offer a better performance than the systems without interconnection between the neurons. Moreover, the input signals with different noise levels are launched into the systems. The results show that the small optical RC system can classify the noisy input optical waveforms even when the signal-to-noise ratio is as low as − 2.55 dB.

[1]  Lukás Burget,et al.  Extensions of recurrent neural network language model , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Fang Liu,et al.  Integrated photonic reservoir computing based on hierarchical time-multiplexing structure , 2014, 2015 Conference on Lasers and Electro-Optics (CLEO).

[3]  Laurent Larger,et al.  Photonic nonlinear transient computing with multiple-delay wavelength dynamics. , 2012, Physical review letters.

[4]  Hans Hallez,et al.  Automatic detection of epileptic seizures on the intra-cranial electroencephalogram of rats using reservoir computing , 2011, Artif. Intell. Medicine.

[5]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[6]  Damien Rontani,et al.  All-Optical Reservoir Computing on a Photonic Chip Using Silicon-Based Ring Resonators , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[7]  Benjamin Schrauwen,et al.  Optoelectronic Reservoir Computing , 2011, Scientific Reports.

[8]  Benjamin Schrauwen,et al.  An uncued brain-computer interface using reservoir computing , 2010, NIPS 2010.

[9]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[10]  Seung Hwan Lee,et al.  Reservoir computing using dynamic memristors for temporal information processing , 2017, Nature Communications.

[11]  Benjamin Schrauwen,et al.  Real-time detection of epileptic seizures in animal models using reservoir computing , 2013, Epilepsy Research.

[12]  VerstraetenD.,et al.  2007 Special Issue , 2007 .

[13]  Chii-Chang Chen,et al.  Application of the deep learning for the prediction of rainfall in Southern Taiwan , 2019, Scientific Reports.

[14]  Jan Danckaert,et al.  Real-time Audio Processing with a Cascade of Discrete-Time Delay Line-Based Reservoir Computers , 2017, Cognitive Computation.

[15]  Michael Timmers,et al.  On the Use of Reservoir Computing in Popularity Prediction , 2010, 2010 2nd International Conference on Evolving Internet.

[16]  Benjamin Schrauwen,et al.  Generative Modeling of Autonomous Robots and their Environments using Reservoir Computing , 2007, Neural Processing Letters.

[17]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[18]  Takashi Ikegami,et al.  A Reservoir Computing approach to Image Classification using Coupled Echo State and BackPropagation Neural Networks , 2011 .

[19]  Li Fang,et al.  All-optical reservoir computer based on saturation of absorption. , 2014, Optics express.

[20]  Serge Massar,et al.  All-optical Reservoir Computing , 2012, Optics express.

[21]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[22]  Benjamin Schrauwen,et al.  Analog readout for optical reservoir computers , 2012, NIPS.

[23]  Dimitris Syvridis,et al.  Micro ring resonators as building blocks for an all-optical high-speed reservoir-computing bit-pattern-recognition system , 2013 .

[24]  Ian A. D. Williamson,et al.  Training of Photonic Neural Networks through In Situ Backpropagation , 2019 .

[25]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[27]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[28]  Jan Danckaert,et al.  Constructing optimized binary masks for reservoir computing with delay systems , 2014, Scientific Reports.

[29]  Shanhui Fan,et al.  Training of Photonic Neural Networks through In Situ Backpropagation , 2018, 2019 Conference on Lasers and Electro-Optics (CLEO).

[30]  Pierre Baldi,et al.  Improving the prediction of protein secondary structure in three and eight classes using recurrent neural networks and profiles , 2002, Proteins.

[31]  S. Lacroix,et al.  Modeling of symmetric 2 × 2 fused-fiber couplers. , 1994, Applied optics.

[32]  Goutam Saha,et al.  Construction of Gene Regulatory Networks Using Recurrent Neural Networks and Swarm Intelligence , 2016, Scientifica.

[33]  Benjamin Schrauwen,et al.  Reservoir-based techniques for speech recognition , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[34]  Benjamin Schrauwen,et al.  Connectivity, Dynamics, and Memory in Reservoir Computing with Binary and Analog Neurons , 2010, Neural Computation.

[35]  M. C. Soriano,et al.  Advances in photonic reservoir computing , 2017 .

[36]  Lakhmi C. Jain,et al.  Recurrent Neural Networks: Design and Applications , 1999 .

[37]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[38]  Pedro Antonio Gutiérrez,et al.  Robust estimation of wind power ramp events with reservoir computing , 2017 .

[39]  Claudio Gallicchio,et al.  Design of deep echo state networks , 2018, Neural Networks.

[40]  Guy Verschaffelt,et al.  Distributed Kerr Non-linearity in a Coherent All-Optical Fiber-Ring Reservoir Computer , 2019, Front. Phys..

[41]  Wesley De Neve,et al.  On the application of reservoir computing networks for noisy image recognition , 2018, Neurocomputing.

[42]  Yang Yi,et al.  Reservoir Computing Meets Smart Grids: Attack Detection Using Delayed Feedback Networks , 2018, IEEE Transactions on Industrial Informatics.

[43]  B. Schrauwen,et al.  Reservoir computing and extreme learning machines for non-linear time-series data analysis , 2013, Neural Networks.

[44]  Chii-Chang Chen,et al.  Optical neural networks based on optical fiber-communication system , 2019, Neurocomputing.

[45]  A. Carenco,et al.  Phrase correction by laser ablation of a polarization independent LiNbO3 Mach-Zehnder modulator , 1997, IEEE Photonics Technology Letters.

[46]  Benjamin Schrauwen,et al.  Artificial Intelligence at Light Speed: towards Opto-Electronic Reservoir Computing , 2010 .

[47]  Benjamin Schrauwen,et al.  Toward optical signal processing using photonic reservoir computing. , 2008, Optics express.