Jackknife Model Averaging for Quantile Regressions

In this paper we consider model averaging for quantile regressions (QR) when all models under investigation are potentially misspecified and the number of parameters is diverging with the sample size. To allow for the dependence between the error terms and regressors in the QR models, we propose a jackknife model averaging (JMA) estimator which selects the weights by minimizing a leave-one-out cross-validation criterion function and demonstrate its asymptotic optimality in terms of minimizing the out-of-sample final prediction error. We conduct simulations to demonstrate the finite-sample performance of our estimator and compare it with other model selection and averaging methods. We apply our JMA method to forecast quantiles of excess stock returns and wages.

[1]  Jianqing Fan,et al.  Functional-Coefficient Regression Models for Nonlinear Time Series , 2000 .

[2]  S. Portnoy Asymptotic Behavior of $M$-Estimators of $p$ Regression Parameters when $p^2/n$ is Large. I. Consistency , 1984 .

[3]  A. Ullah,et al.  Local Linear GMM Estimation of Functional Coefficient IV Models With an Application to Estimating the Rate of Return to Schooling , 2013 .

[4]  Andrew R. Barron,et al.  Information Theory and Mixing Least-Squares Regressions , 2006, IEEE Transactions on Information Theory.

[5]  M. C. Jensen The Performance of Mutual Funds in the Period 1945-1964 , 1967 .

[6]  G. Kapetanios,et al.  Forecasting Using Bayesian and Information-Theoretic Model Averaging , 2008 .

[7]  R. Koenker,et al.  Goodness of Fit and Related Inference Processes for Quantile Regression , 1999 .

[8]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[9]  W. Sharpe CAPITAL ASSET PRICES: A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK* , 1964 .

[10]  S. Ross THE CAPITAL ASSET PRICING MODEL (CAPM), SHORT‐SALE RESTRICTIONS AND RELATED ISSUES , 1977 .

[11]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[12]  Stijn Van Nieuwerburgh,et al.  Housing Collateral, Consumption Insurance and Risk Premia: An Empirical Perspective , 2003 .

[13]  S. B. Thompson,et al.  Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average? , 2008 .

[14]  Pin T. Ng,et al.  Quantile smoothing splines , 1994 .

[15]  E. Mammen,et al.  Time Series Modelling With Semiparametric Factor Dynamics , 2007 .

[16]  J. Rice Bandwidth Choice for Nonparametric Regression , 1984 .

[17]  D. Pollard Asymptotics for Least Absolute Deviation Regression Estimators , 1991, Econometric Theory.

[18]  Kenneth J. Singleton,et al.  Estimation and Evaluation of Conditional Asset Pricing Models , 2010 .

[19]  Clifford Lam,et al.  PROFILE-KERNEL LIKELIHOOD INFERENCE WITH DIVERGING NUMBER OF PARAMETERS. , 2008, Annals of statistics.

[20]  Jianqing Fan,et al.  Nonconcave penalized likelihood with a diverging number of parameters , 2004, math/0406466.

[21]  Jiti Gao,et al.  Nonlinear Time Series: Semiparametric and Nonparametric Methods , 2019 .

[22]  Robert A. Korajczyk,et al.  Do Arbitrage Pricing Models Explain the Predictability of Stock Returns? , 1995 .

[23]  S. Portnoy Asymptotic behavior of M-estimators of p regression parameters when p , 1985 .

[24]  Jay Shanken,et al.  Intertemporal asset pricing: An Empirical Investigation , 1990 .

[25]  Serena Ng,et al.  Variable Selection in Predictive Regressions , 2013 .

[26]  I. Welch,et al.  A Comprehensive Look at the Empirical Performance of Equity Premium Prediction II , 2004, SSRN Electronic Journal.

[27]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[28]  Szymon Borak,et al.  A semiparametric factor model for electricity forward curve dynamics , 2008 .

[29]  Yuhong Yang Adaptive Regression by Mixing , 2001 .

[30]  E. Fama,et al.  Common risk factors in the returns on stocks and bonds , 1993 .

[31]  Deborah Nolan,et al.  A general Akaike-type criterion for model selection in robust regression , 1995 .

[32]  D. Andrews,et al.  Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors , 1991 .

[33]  Generalized Cp Model Averaging for Heteroskedastic Models , 2010 .

[34]  George Kapetanios,et al.  Forecasting Using Bayesian and Information Theoretic Model Averaging: An Application to UK Inflation , 2005 .

[35]  Chu-An Liu A Plug-In Averaging Estimator for Regressions with Heteroskedastic Errors , 2012 .

[36]  N. Hjort,et al.  Frequentist Model Average Estimators , 2003 .

[37]  Victor Chernozhukov,et al.  Quantile Regression Under Misspecification, with an Application to the U.S. Wage Structure , 2004 .

[38]  H. White,et al.  Conditional Independence Specification Testing for Dependent Processes with Local Polynomial Quantile Regression , 2012 .

[39]  R. Koenker,et al.  Robust Tests for Heteroscedasticity Based on Regression Quantiles , 1982 .

[40]  A. Ullah,et al.  A NONPARAMETRIC GOODNESS-OF-FIT-BASED TEST FOR CONDITIONAL HETEROSKEDASTICITY , 2013, Econometric Theory.

[41]  Guohua Zou,et al.  Model averaging by jackknife criterion in models with dependent data , 2013 .

[42]  J. Wooldridge,et al.  A Capital Asset Pricing Model with Time-Varying Covariances , 1988, Journal of Political Economy.

[43]  R. Serfling Approximation Theorems of Mathematical Statistics , 1980 .

[44]  Yuhong Yang,et al.  Combining Linear Regression Models , 2005, Journal of the American Statistical Association.

[45]  Yacine Ait-Sahalia,et al.  Nonparametric Option Pricing Under Shape Restrictions , 2002 .

[46]  Bruce E. Hansen,et al.  Averaging estimators for autoregressions with a near unit root , 2010 .

[47]  John H. Cochrane,et al.  A Cross-Sectional Test of an Investment-Based Asset Pricing Model , 1996, Journal of Political Economy.

[49]  Enrique Moral-Benito,et al.  Model Averaging in Economics , 2011 .

[50]  M. Lettau,et al.  Resurrecting the (C)Capm: A Cross-Sectional Test When Risk Premia Wre Time-Varying , 1999 .

[51]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[52]  B. Hansen Least Squares Model Averaging , 2007 .

[53]  Stephen A. Ross,et al.  Differential Information and Performance Measurement Using a Security Market Line , 1985 .

[54]  Ryo Okui,et al.  Heteroscedasticity�?Robust C Model Averaging , 2012 .

[55]  Kevin Q. Wang Asset Pricing with Conditioning Information: A New Test , 2003 .

[56]  José A.F. Machado,et al.  Robust Model Selection and M-Estimation , 1993, Econometric Theory.

[57]  Enrique Moral-Benito,et al.  Model Averaging in Economics: An Overview , 2015 .

[58]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[59]  A. Lo,et al.  Nonparametric Estimation of State‐Price Densities Implicit in Financial Asset Prices , 1998 .

[60]  Ker-Chau Li,et al.  Asymptotic Optimality for $C_p, C_L$, Cross-Validation and Generalized Cross-Validation: Discrete Index Set , 1987 .

[61]  Aman Ullah,et al.  Robustify Financial Time Series Forecasting with Bagging , 2014 .

[62]  Ryo Okui,et al.  Constructing Optimal Instruments by First-Stage Prediction Averaging , 2010 .

[63]  Jeffrey S. Racine,et al.  Jackknife model averaging , 2012 .

[64]  A. Belloni,et al.  L1-Penalized Quantile Regression in High Dimensional Sparse Models , 2009, 0904.2931.

[65]  N. Roussanov Composition of Wealth, Conditioning Information, and the Cross-Section of Stock Returns , 2010 .

[66]  Aman Ullah,et al.  Semiparametric Estimator of Time Series Conditional Variance , 2010 .

[67]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[68]  D. Ruppert,et al.  Trimmed Least Squares Estimation in the Linear Model , 1980 .

[69]  Bruce E. Hansen,et al.  Least-squares forecast averaging , 2008 .

[70]  R. Shibata An optimal selection of regression variables , 1981 .

[71]  S. Viswanathan,et al.  No Arbitrage and Arbitrage Pricing: A New Approach , 1993 .

[72]  B. Hansen UNIFORM CONVERGENCE RATES FOR KERNEL ESTIMATION WITH DEPENDENT DATA , 2008, Econometric Theory.

[73]  H. Bergström On the central limit theorem , 1944 .

[74]  Keith Knight,et al.  Limiting distributions for $L\sb 1$ regression estimators under general conditions , 1998 .

[75]  A. Welsh On $M$-Processes and $M$-Estimation , 1989 .

[76]  Eric Ghysels,et al.  On Stable Factor Structures in the Pricing of Risk: Do Time-Varying Betas Help or Hurt? , 1998 .

[77]  Yonghui Zhang,et al.  Variable Selection in Nonparametric and Semiparametric Regression Models , 2014 .

[78]  Liyan Yang,et al.  Testing Conditional Factor Models: A Nonparametric Approach , 2011 .

[79]  Marc S. Paolella,et al.  Value-at-Risk Prediction: A Comparison of Alternative Strategies , 2005 .

[80]  J. Davidson Stochastic Limit Theory: An Introduction for Econometricians , 1994 .

[81]  Benedikt M. Potscher,et al.  The Distribution of Model Averaging Estimators and an Impossibility Result Regarding Its Estimation , 2006, math/0702781.

[82]  Pietro Veronesi,et al.  Labor Income and Predictable Stock Returns , 2001 .

[83]  Yufeng Liu,et al.  VARIABLE SELECTION IN QUANTILE REGRESSION , 2009 .

[84]  Chih-Ling Tsai,et al.  Model selection for least absolute deviations regression in small samples , 1990 .

[85]  Nils Lid Hjort,et al.  Model Selection and Model Averaging , 2001 .

[86]  Guohua Zou,et al.  Least squares model averaging by Mallows criterion , 2010 .

[87]  Adrian E. Raftery,et al.  Bayesian Model Averaging: A Tutorial , 2016 .

[88]  R. Koenker,et al.  Regression Quantiles , 2007 .

[89]  Aman Ullah,et al.  Estimation and Forecasting of Dynamic Conditional Covariance: A Semiparametric Multivariate Model , 2009 .

[90]  H. Tong,et al.  Cross-validatory bandwidth selections for regression estimation based on dependent data , 1998 .

[91]  Bruce E. Hansen,et al.  CHALLENGES FOR ECONOMETRIC MODEL SELECTION , 2005, Econometric Theory.

[92]  Ritei Shibata Amendments and Corrections: An Optimal Selection of Regression Variables , 1982 .

[93]  Bruce E. Hansen,et al.  AVERAGING ESTIMATORS FOR REGRESSIONS WITH A POSSIBLE STRUCTURAL BREAK , 2009, Econometric Theory.

[94]  Bruce E. Hansen,et al.  Testing for structural change in conditional models , 2000 .

[95]  Alan T. K. Wan,et al.  Optimal Weight Choice for Frequentist Model Average Estimators , 2011 .

[96]  Kengo Kato,et al.  Smoothed Quantile Regression for Panel Data , 2015 .

[97]  P. Dooren Matrix Mathematics: Theory, Facts, and Formulas with Application to Linear Systems Theory [Book Review] , 2006 .

[98]  H. Akaike Statistical predictor identification , 1970 .

[99]  A. Ullah,et al.  Asymptotic Normality of a Combined Regression Estimator , 1999 .