Identification of non‐linear additive autoregressive models

Summary.  We propose a lag selection method for non‐linear additive autoregressive models that is based on spline estimation and the Bayes information criterion. The additive structure of the autoregression function is used to overcome the ‘curse of dimensionality’, whereas the spline estimators effectively take into account such a structure in estimation. A stepwise procedure is suggested to implement the method proposed. A comprehensive Monte Carlo study demonstrates good performance of the method proposed and a substantial computational advantage over existing local‐polynomial‐based methods. Consistency of the lag selection method based on the Bayes information criterion is established under the assumption that the observations are from a stochastic process that is strictly stationary and strongly mixing, which provides the first theoretical result of this kind for spline smoothing of weakly dependent data.

[1]  H. Akaike.  Fitting autoregressive models for prediction , 1969 .

[2]  H. Akaike.  Statistical predictor identification , 1970 .

[3]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[4]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[5]  P. Robinson.  NONPARAMETRIC ESTIMATORS FOR TIME SERIES , 1983 .

[6]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[7]  R. Tibshirani,et al.  Linear Smoothers and Additive Models , 1989 .

[8]  Trevor Hastie,et al.  [Flexible Parsimonious Smoothing and Additive Modeling]: Discussion , 1989 .

[9]  Calyampudi R. Rao,et al.  A strongly consistent procedure for model selection in a regression problem , 1989 .

[10]  Douglas M. Hawkins,et al.  Discussion of ‘Flexible Parsimonious Smoothing and Additive Modeling’ , 1989 .

[11]  Wolfgang Härdle,et al.  Nonparametric Curve Estimation from Time Series , 1989 .

[12]  D. Tjøstheim,et al.  Identification of nonlinear time series: First order characterization and order determination , 1990 .

[13]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[14]  J. Friedman.  Multivariate adaptive regression splines , 1990 .

[15]  P. Lewis,et al.  Nonlinear Modeling of Time Series Using Multivariate Adaptive Regression Splines (MARS) , 1991 .

[16]  A. Atkinson.  Subset Selection in Regression , 1992 .

[17]  Howell Tong,et al.  Consistent nonparametric order determination and chaos, with discussion , 1992 .

[18]  Tomasz Rychlik.  Bounds for expectation of l-estimates for dependent samples , 1993 .

[19]  Ruey S. Tsay,et al.  Nonlinear Additive ARX Models , 1993 .

[20]  Qiwei Yao,et al.  On subset selection in non-parametric stochastic regression , 1994 .

[21]  Dag Tjøstheim,et al.  Nonparametric Identification of Nonlinear Time Series: Selecting Significant Lags , 1994 .

[22]  C. J. Stone,et al.  The Use of Polynomial Splines and Their Tensor Products in Multivariate Function Estimation , 1994 .

[23]  Dag Tjøstheim,et al.  Nonparametric Identification of Nonlinear Time Series: Projections , 1994 .

[24]  P. Vieu.  Order Choice in Nonlinear Autoregressive Models , 1995 .

[25]  O. Linton,et al.  A kernel method of estimating structured nonparametric regression based on marginal integration , 1995 .

[26]  Denis Bosq,et al.  Nonparametric statistics for stochastic processes , 1996 .

[27]  Young K. Truong,et al.  Polynomial splines and their tensor products in extended linear modeling: 1994 Wald memorial lecture , 1997 .

[28]  Dag Tjøstheim,et al.  Additive Nonlinear ARX Time Series and Projection Estimates , 1997, Econometric Theory.

[29]  Jianhua Z. Huang.  Projection estimation in multiple regression with application to functional ANOVA models , 1998 .

[30]  Jens Perch Nielsen,et al.  Nonparametric Autoregression with Multiplicative Volatility and Additive mean , 1999 .

[31]  Enno Mammen,et al.  The Existence and Asymptotic Properties of a Backfitting Projection Algorithm Under Weak Conditions , 1999 .

[32]  Lijian Yang,et al.  Multivariate bandwidth selection for local linear regression , 1999 .

[33]  Lijian Yang,et al.  Nonparametric Lag Selection for Time Series , 2000 .

[34]  Timo Teräsvirta,et al.  A SIMPLE VARIABLE SELECTION TECHNIQUE FOR NONLINEAR MODELS , 2001 .

[35]  Jianhua Z. Huang.  CONCAVE EXTENDED LINEAR MODELING: A THEORETICAL SYNTHESIS , 2001 .

[36]  Lijian Yang,et al.  NON- AND SEMIPARAMETRIC IDENTIFICATION OF SEASONAL NONLINEAR AUTOREGRESSION MODELS , 2002, Econometric Theory.