Wavelet estimation of functional coefficient regression models

The area of nonlinear time series models has experienced a great development since the 1980s. Although there is a wide range of parametric nonlinear time series models, in general, we do not know if the postulated model is the most appropriated one for a specific data set. This situation highlights the importance of nonparametric models. An interesting nonparametric model to fit nonlinear time series is the well-known functional coefficient regression model. Nonparametric estimations by, e.g., local linear regression and splines, are developed in the literature. In this work, we study the estimation of such a model using wavelets. It is a proposal that takes into account both, classical and warped wavelets. We present the rates of convergence of the proposed estimators and carry out simulation studies to evaluate automatic procedures (among AIC, AICc and BIC) for selecting the coarsest and finest levels to be used during the estimation process. Moreover, we illustrate the methodology with an application to a real data set, where we also calculate multi-step-ahead forecasts and compare the results with other methods known in the literature.

[1]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[2]  R Todd Ogden,et al.  Wavelet-Based LASSO in Functional Linear Regression , 2012, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[3]  I. Daubechies,et al.  Two-scale difference equations I: existence and global regularity of solutions , 1991 .

[4]  Rafal Kulik,et al.  WAVELET REGRESSION IN RANDOM DESIGN WITH HETEROSCEDASTIC DEPENDENT ERRORS , 2009, 0909.0384.

[5]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[6]  Gerard Kerkyacharian,et al.  Regression in random design and warped wavelets , 2004 .

[7]  I. Johnstone,et al.  Minimax estimation via wavelet shrinkage , 1998 .

[8]  Peter Hall,et al.  Formulae for Mean Integrated Squared Error of Nonlinear Wavelet-Based Density Estimators , 1995 .

[9]  Pierre Moulin.  Wavelet thresholding techniques for power spectrum estimation , 1994, IEEE Trans. Signal Process..

[10]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[11]  Michael H. Neumann.  SPECTRAL DENSITY ESTIMATION VIA NONLINEAR WAVELET METHODS FOR STATIONARY NON‐GAUSSIAN TIME SERIES , 1996 .

[12]  Haipeng Shen,et al.  Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach , 2004 .

[13]  I. Johnstone,et al.  Density estimation by wavelet thresholding , 1996 .

[14]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[15]  Anestis Antoniadis,et al.  Adaptive wavelet series estimation in separable nonparametric regression models , 2001, Stat. Comput..

[16]  Rong Chen.  Functional coefficient autoregressive models: Estimation and tests of hypotheses , 2001 .

[17]  G. Kerkyacharian,et al.  Density estimation in Besov spaces , 1992 .

[18]  I. Daubechies,et al.  Two-scale difference equations II. local regularity, infinite products of matrices and fractals , 1992 .

[19]  H. Akaike.  A new look at the statistical model identification , 1974 .

[20]  T. Tony Cai,et al.  Wavelet estimation for samples with random uniform design , 1999 .

[21]  Chang Chiann,et al.  Spline estimation of functional coefficient regression models for time series with correlated errors , 2014 .

[22]  Ruey S. Tsay,et al.  Functional-Coefficient Autoregressive Models , 1993 .

[23]  T. Fearn,et al.  Bayesian Wavelet Regression on Curves With Application to a Spectroscopic Calibration Problem , 2001 .

[24]  J. Restrepo,et al.  Inner product computations using periodized daubechies wavelets. , 1997 .

[25]  T. Ozaki,et al.  Modelling nonlinear random vibrations using an amplitude-dependent autoregressive time series model , 1981 .

[26]  Anestis Antoniadis,et al.  Dimension reduction in functional regression with applications , 2006, Comput. Stat. Data Anal..

[27]  Peter Hall,et al.  On wavelet methods for estimating smooth functions , 1995 .

[28]  C. Granger,et al.  AN INTRODUCTION TO LONG‐MEMORY TIME SERIES MODELS AND FRACTIONAL DIFFERENCING , 1980 .

[29]  T. Tony Cai,et al.  WAVELET SHRINKAGE FOR NONEQUISPACED SAMPLES , 1998 .

[30]  D. Cochrane,et al.  Application of Least Squares Regression to Relationships Containing Auto-Correlated Error Terms , 1949 .

[31]  Jianqing Fan,et al.  Functional-Coefficient Regression Models for Nonlinear Time Series , 2000 .

[32]  Hong-ye Gao.  Choice of thresholds for wavelet shrinkage estimate of the spectrum , 1997 .