Statistical Inference for Modeling Neural Network in Multivariate Time Series

We present a statistical procedure based on hypothesis test to build neural networks model in multivariate time series case. The method involved strategies for specifying the number of hidden units and the input variables in the model using inference of R2 increment. We draw on forward approach starting from empty model to gain the optimal neural networks model. The empirical study was employed relied on simulation data to examine the effectiveness of inference procedure. The result showed that the statistical inference could be applied successfully for modeling neural networks in multivariate time series analysis.

[1]  Norman R. Swanson,et al.  A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural Networks , 1997, Review of Economics and Statistics.

[2]  Suhartono,et al.  THE EFFECT OF DECOMPOSITION METHOD AS DATA PREPROCESSING ON NEURAL NETWORKS MODEL FOR FORECASTING TREND AND SEASONAL TIME SERIES , 2007, Jurnal Teknik Industri.

[3]  J. Nazuno.  Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[4]  H. V. Dijk,et al.  Neural network pruning applied to real exchange rate analysis , 2002 .

[5]  Lutz Prechelt,et al.  Investigation of the CasCor Family of Learning Algorithms , 1997, Neural Networks.

[6]  Halbert White,et al.  Connectionist nonparametric regression: Multilayer feedforward networks can learn arbitrary mappings , 1990, Neural Networks.

[7]  J. Neter,et al.  Applied Linear Regression Models , 1983 .

[8]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[9]  Suhartono Suhartono,et al.  MODEL SELECTION IN NEURAL NETWORKS BY USINGINFERENCE OF F. INCREMENTAL, PCA AND SIC CRITERIONFOR TIME SERIES FORCASTING , 2006 .

[10]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[11]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[12]  Jakob B. Madsen.  Book review: Basic Econometrics, Damodar N. Gujarati, McGraw-Hill, New York, 1995 , 1998 .

[13]  R. Shanmugam.  Introduction to Time Series and Forecasting , 1997 .

[14]  Norman R. Swanson,et al.  A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks , 1995 .

[15]  Jeffrey S. Racine,et al.  Semiparametric ARX neural-network models with an application to forecasting inflation , 2001, IEEE Trans. Neural Networks.

[16]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.