A stochastic model based on neural networks

This paper presents the proposal of a generic model of stochastic process based on neural networks, called Neural Stochastic Process (NSP). The proposed model can be applied to problems involving phenomena of stochastic behavior and / or periodic features. Through the NSP's neural networks it is possible to capture the historical series' behavior of these phenomena without requiring any a priori information about the series, as well as to generate synthetic time series with the same probabilities as the historical series. The NSP was applied to the treatment of monthly inflows series and the results indicate that the generated synthetic series exhibit statistical characteristics similar to historical series.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  Roger Sauter,et al.  Introduction to Probability and Statistics for Engineers and Scientists , 2005, Technometrics.

[3]  Hua Zhao,et al.  A chaotic time series prediction based on neural network: Evidence from the Shanghai Composite index in China , 2009, 2009 International Conference on Test and Measurement.

[4]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[5]  L. Tsimring,et al.  The analysis of observed chaotic data in physical systems , 1993 .

[6]  V. Rao Vemuri,et al.  Artificial Neural Networks - Forecasting Time Series , 1993 .

[7]  P. Bougerol,et al.  Strict Stationarity of Generalized Autoregressive Processes , 1992 .

[8]  Ricardo Bastos Cavalcante Prudêncio.  Projeto Híbrido de Redes Neurais , 2001 .

[9]  Sheldon M. Ross,et al.  Introduction to Probability and Statistics for Engineers and Scientists , 1987 .

[10]  Z. Schuss.  Theory and Applications of Stochastic Processes: An Analytical Approach , 2009 .

[11]  Rabi Bhattacharya,et al.  Stochastic processes with applications , 1990 .

[12]  Nada R. Sanders,et al.  Managing the forecasting function , 1995 .

[13]  Mario V. F. Pereira,et al.  OPERATION PLANNING OF LARGE-SCALE HYDROELECTRICAL SYSTEMS , 1984 .

[14]  Andreas S. Weigend,et al.  The Future of Time Series: Learning and Understanding , 1993 .

[15]  André Luiz França Batista.  MODELOS DE SÉRIES TEMPORAIS E REDES NEURAIS ARTIFICIAIS NA PREVISÃO DE VAZÃO , 2009 .

[16]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[17]  K. Hipel,et al.  Time series modelling of water resources and environmental systems , 1994 .

[18]  Simon M. Potter.  Nonlinear Time Series Modelling: An Introduction , 1999 .

[19]  Oliver Knill,et al.  Probability and Stochastic Processes with Applications , 2008 .

[20]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[21]  Neil Davey,et al.  Time Series Prediction and Neural Networks , 2001, J. Intell. Robotic Syst..

[22]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[24]  Chris Chatfield,et al.  Time series forecasting with neural networks , 1998, Neural Networks for Signal Processing VIII. Proceedings of the 1998 IEEE Signal Processing Society Workshop (Cat. No.98TH8378).

[25]  Paul A. Fishwick,et al.  Time series forecasting using neural networks vs. Box- Jenkins methodology , 1991, Simul..