Multivariate nonlinear time-series estimation using delay-based reservoir computing

Multivariate nonlinear time-series analysis represents a major challenge in complex systems science, specially when the full underlying dynamics is unknown. Often, time-series forecast relies on the information contained in a single measured variable. However, in many cases one might benefit from other available measures of the system to improve the prediction of its dynamical evolution. Here, we utilize Reservoir Computing techniques to process sequential multivariate information. As reservoir, we employ a Mackey-Glass delay system. We discuss the approximation of a three-dimensional theoretical model (the Lorenz model) by comparing prediction performance for one variable using either one or two variables as input. Finally, we apply these insights to improve the performance of a relevant biomedical task, namely multi-electrode heartbeat classification.

[1]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[2]  Y. Pawitan In all likelihood : statistical modelling and inference using likelihood , 2002 .

[3]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[4]  Benjamin Schrauwen,et al.  Automated Design of Complex Dynamic Systems , 2014, PloS one.

[5]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[6]  A. N. Sharkovskiĭ Dynamic systems and turbulence , 1989 .

[7]  M D Hagen,et al.  An evaluation of technologies for identifying acute cardiac ischemia in the emergency department: executive summary of a National Heart Attack Alert Program Working Group Report. , 1997, Annals of emergency medicine.

[8]  Philip de Chazal,et al.  Automatic classification of heartbeats using ECG morphology and heartbeat interval features , 2004, IEEE Transactions on Biomedical Engineering.

[9]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[10]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[11]  Serge Massar,et al.  All-optical Reservoir Computing , 2012, Optics express.

[12]  F. Takens Detecting strange attractors in turbulence , 1981 .

[13]  A. Mees,et al.  Dynamics from multivariate time series , 1998 .

[14]  L Pesquera,et al.  Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. , 2012, Optics express.

[15]  Laurent Larger,et al.  Photonic nonlinear transient computing with multiple-delay wavelength dynamics. , 2012, Physical review letters.

[16]  J. Brugada,et al.  Right bundle branch block, persistent ST segment elevation and sudden cardiac death: a distinct clinical and electrocardiographic syndrome. A multicenter report. , 1992, Journal of the American College of Cardiology.

[17]  Benjamin Schrauwen,et al.  Optoelectronic Reservoir Computing , 2011, Scientific Reports.

[18]  H. Selker,et al.  Diagnosis of acute cardiac ischemia. , 2003, Emergency medicine clinics of North America.

[19]  M. C. Soriano,et al.  Information Processing Using Transient Dynamics of Semiconductor Lasers Subject to Delayed Feedback , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[20]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[21]  Benjamin Schrauwen,et al.  Information Processing Capacity of Dynamical Systems , 2012, Scientific Reports.

[22]  Romain Modeste Nguimdo,et al.  Fast photonic information processing using semiconductor lasers with delayed optical feedback: role of phase dynamics. , 2014, Optics express.

[23]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[24]  Benjamin Schrauwen,et al.  Toward optical signal processing using photonic reservoir computing. , 2008, Optics express.

[25]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[26]  L. Larger,et al.  Optoelectronic reservoir computing: tackling noise-induced performance degradation. , 2013, Optics express.