Forecasting chaotic cardiovascular time series with an adaptive slope multilayer perceptron neural network

A multilayer perceptron (MLP) network architecture has been formulated in which two adaptive parameters, the scaling and translation of the postsynaptic function at each node, are allowed to adjust iteratively by gradient-descent. The algorithm has been employed to predict experimental cardiovascular time series, following systematic reconstruction of the strange attractor of the training signal. Comparison with a standard MLP employing identical numbers of nodes and weight learning rates demonstrates that the adaptive approach provides an efficient modification of the MLP that permits faster learning. Thus, for an equivalent number of training epochs there was improved accuracy and generalization for both one- and k-step ahead prediction. The applicability of the methodology is demonstrated for a set of monotonic postsynaptic functions (sigmoidal, upper bounded, and nonbounded). The approach is computationally inexpensive as the increase in the parameter space of the network compared to a standard MLP is small.

[1]  A. Lapedes,et al.  Nonlinear Signal Processing Using Neural Networks , 1987 .

[2]  S. de Brouwer,et al.  Simplification of the quasiperiodic route to chaos in agonist-induced vasomotion by iterative circle maps. , 1998, American journal of physiology. Heart and circulatory physiology.

[3]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[4]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[5]  T. Griffith,et al.  Temporal chaos in the microcirculation. , 1996, Cardiovascular research.

[6]  M. Rosenstein,et al.  Reconstruction expansion as a geometry-based framework for choosing proper delay times , 1994 .

[7]  H. White,et al.  Universal approximation using feedforward networks with non-sigmoid hidden layer activation functions , 1989, International 1989 Joint Conference on Neural Networks.

[8]  Javier R. Movellan,et al.  Benefits of gain: speeded learning and minimal hidden layers in back-propagation networks , 1991, IEEE Trans. Syst. Man Cybern..

[9]  Raoul Tawel Does the Neuron "Learn" Like the Synapse? , 1988, NIPS.

[10]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[11]  M. F. Tenorio,et al.  Adaptive gain networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[12]  D. Edwards,et al.  EDRF suppresses chaotic pressure oscillations in isolated resistance artery without influencing intrinsic complexity. , 1994, The American journal of physiology.

[13]  L. W. Massengill,et al.  Threshold non-linearity effects on weight-decay tolerance in analog neural networks , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[14]  Jose C. Principe,et al.  Prediction of Chaotic Time Series with Neural Networks , 1992 .

[15]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[16]  P B Persson,et al.  Nonlinear chaotic dynamics of arterial blood pressure and renal blood flow. , 1995, The American journal of physiology.

[17]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[18]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[19]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[20]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[21]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[22]  T. M. Griffith,et al.  Fractal analysis of role of smooth muscle Ca2+ fluxes in genesis of chaotic arterial pressure oscillations. , 1994, The American journal of physiology.

[23]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[24]  Tudor M. Griffith,et al.  CRITICAL SCALING AND TYPE-III INTERMITTENT CHAOS IN ISOLATED RABBIT RESISTANCE ARTERIES , 1997 .

[25]  F. Takens Detecting strange attractors in turbulence , 1981 .

[26]  N. Stamatis,et al.  Prediction of Arterial "Burst" Activity and Transitions Between Chaotic Attractors with a Multilayer Perceptron Optimized by a New Stopping Criterion , 1996, Int. J. Neural Syst..

[27]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .