Revisiting Tests for Neglected Nonlinearity Using Artificial Neural Networks

Tests for regression neglected nonlinearity based on artificial neural networks (ANNs) have so far been studied by separately analyzing the two ways in which the null of regression linearity can hold. This implies that the asymptotic behavior of general ANN-based tests for neglected nonlinearity is still an open question. Here we analyze a convenient ANN-based quasi-likelihood ratio statistic for testing neglected nonlinearity, paying careful attention to both components of the null. We derive the asymptotic null distribution under each component separately and analyze their interaction. Somewhat remarkably, it turns out that the previously known asymptotic null distribution for the type 1 case still applies, but under somewhat stronger conditions than previously recognized. We present Monte Carlo experiments corroborating our theoretical results and showing that standard methods can yield misleading inference when our new, stronger regularity conditions are violated.

[1]  H. Bierens.  Armax model specification testing, with an application to unemployment in the Netherlands , 1987 .

[2]  Bruce E. Hansen,et al.  Interval forecasts and parameter uncertainty , 2006 .

[3]  J. Cho,et al.  Testing for Unobserved Heterogeneity in Exponential and Weibull Duration Models , 2009 .

[4]  E. Gassiat,et al.  Testing the order of a model using locally conic parametrization : population mixtures and stationary ARMA processes , 1999 .

[5]  T. Rao,et al.  Tensor Methods in Statistics , 1989 .

[6]  J. Carlos Escanciano,et al.  ON THE LACK OF POWER OF OMNIBUS SPECIFICATION TESTS , 2009, Econometric Theory.

[7]  E. Candès.  Ridgelets: estimating with ridge functions , 2003 .

[8]  P. Massart,et al.  Invariance principles for absolutely regular empirical processes , 1995 .

[9]  Halbert White,et al.  On learning the derivatives of an unknown mapping with multilayer feedforward networks , 1992, Neural Networks.

[10]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[11]  H. White,et al.  An additional hidden unit test for neglected nonlinearity in multilayer feedforward networks , 1989, International 1989 Joint Conference on Neural Networks.

[12]  Maxwell B. Stinchcombe,et al.  CONSISTENT SPECIFICATION TESTING WITH NUISANCE PARAMETERS PRESENT ONLY UNDER THE ALTERNATIVE , 1998, Econometric Theory.

[13]  H. White.  Some Asymptotic Results for Learning in Single Hidden-Layer Feedforward Network Models , 1989 .

[14]  Halbert White,et al.  Higher-Order Approximations for Testing Neglected Nonlinearity , 2012, Neural Computation.

[15]  Andreas Gottschling,et al.  Mixtures of t-distributions for Finance and Forecasting , 2008 .

[16]  M. Bartlett,et al.  APPROXIMATE CONFIDENCE INTERVALSMORE THAN ONE UNKNOWN PARAMETER , 1953 .

[17]  Timo Teräsvirta,et al.  Testing linearity against smooth transition autoregressive models , 1988 .

[18]  T. Teräsvirta.  Specification, Estimation, and Evaluation of Smooth Transition Autoregressive Models , 1994 .

[19]  A. V. D. Vaart,et al.  Asymptotic Statistics: Frontmatter , 1998 .

[20]  C. Granger,et al.  Modelling Nonlinear Economic Relationships , 1995 .

[21]  P. Sen,et al.  Theory of rank tests , 1969 .

[22]  Barr Rosenberg,et al.  The Analysis of a Cross-Section of Time Series by Stochastically Convergent Parameter Regression , 1973 .

[23]  Halbert White,et al.  Connectionist nonparametric regression: Multilayer feedforward networks can learn arbitrary mappings , 1990, Neural Networks.

[24]  Peter C. B. Phillips,et al.  New Tools for Understanding Spurious Regressions , 1998 .

[25]  Clive W. J. Granger,et al.  Testing for neglected nonlinearity in time series models: A comparison of neural network methods and alternative tests , 1993 .

[26]  A. V. D. Vaart.  Asymptotic Statistics: Delta Method , 1998 .

[27]  H. White.  Nonparametric Estimation of Conditional Quantiles Using Neural Networks , 1990 .

[28]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[29]  Adrian Pagan,et al.  Estimation, Inference and Specification Analysis. , 1996 .

[30]  M. Bartlett,et al.  APPROXIMATE CONFIDENCE INTERVALS , 1953 .

[31]  B. Lindsay.  Mixture models : theory, geometry, and applications , 1995 .

[32]  Jin Seo Cho,et al.  Testing for Regime Switching , 2007 .

[33]  Halbert White,et al.  Improved Rates and Asymptotic Normality for Nonparametric Neural Network Estimators , 1999, IEEE Trans. Inf. Theory.

[34]  H. White.  Asymptotic theory for econometricians , 1985 .

[35]  Jerzy Neyman,et al.  ASYMPTOTICALLY OPTIMAL TESTS OF COMPOSITE HYPOTHESES FOR RANDOMIZED EXPERIMENTS WITH NONCONTROLLED PREDICTOR VARIABLES , 1965 .

[36]  Herman J. Bierens,et al.  A consistent conditional moment test of functional form , 1990 .

[37]  Halbert White,et al.  Artificial neural networks: an econometric perspective ∗ , 1994 .

[38]  R. Bass,et al.  Review: P. Billingsley, Convergence of probability measures , 1971 .

[39]  D. Andrews.  Testing When a Parameter Is on the Boundary of the Maintained Hypothesis , 2001 .

[40]  Bruce E. Hansen,et al.  Inference When a Nuisance Parameter Is Not Identified under the Null Hypothesis , 1996 .

[41]  R. Davies.  Hypothesis testing when a nuisance parameter is present only under the alternative , 1977 .

[42]  H. Bierens,et al.  Non-linear regression with discrete explanatory variables, with an application to the earnings function , 1988 .

[43]  R. Rao.  Relations between Weak and Uniform Convergence of Measures with Applications , 1962 .

[44]  Timo Teräsvirta,et al.  POWER OF THE NEURAL NETWORK LINEARITY TEST , 1993 .