Adaptive Elastic Net for Generalized Methods of Moments

Model selection and estimation are crucial parts of econometrics. This article introduces a new technique that can simultaneously estimate and select the model in generalized method of moments (GMM) context. The GMM is particularly powerful for analyzing complex datasets such as longitudinal and panel data, and it has wide applications in econometrics. This article extends the least squares based adaptive elastic net estimator by Zou and Zhang to nonlinear equation systems with endogenous variables. The extension is not trivial and involves a new proof technique due to estimators’ lack of closed-form solutions. Compared to Bridge-GMM by Caner, we allow for the number of parameters to diverge to infinity as well as collinearity among a large number of variables; also, the redundant parameters are set to zero via a data-dependent technique. This method has the oracle property, meaning that we can estimate nonzero parameters with their standard limit and the redundant parameters are dropped from the equations simultaneously. Numerical examples are used to illustrate the performance of the new method.

[1]  Hao Helen Zhang,et al.  Adaptive Lasso for Cox's proportional hazards model , 2007 .

[2]  W. Newey,et al.  Instrumental variable estimation of nonparametric models , 2003 .

[3]  Wenjiang J. Fu,et al.  Asymptotics for lasso-type estimators , 2000 .

[4]  Clifford Lam,et al.  PROFILE-KERNEL LIKELIHOOD INFERENCE WITH DIVERGING NUMBER OF PARAMETERS. , 2008, Annals of statistics.

[5]  Jianqing Fan,et al.  Nonconcave penalized likelihood with a diverging number of parameters , 2004, math/0406466.

[6]  R. Tibshirani,et al.  On the “degrees of freedom” of the lasso , 2007, 0712.0881.

[7]  M. Bartlett.  Periodogram analysis and continuous spectra. , 1950, Biometrika.

[8]  Q. Shao,et al.  On Parameters of Increasing Dimensions , 2000 .

[9]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[10]  Zhipeng Liao,et al.  ADAPTIVE GMM SHRINKAGE ESTIMATION WITH CONSISTENT MOMENT SELECTION , 2012, Econometric Theory.

[11]  Mehmet Caner,et al.  Asymptotically Honest Confidence Regions for High Dimensional Parameters by the Desparsified Conservative Lasso , 2014, 1410.4208.

[12]  B. M. Pötscher,et al.  MODEL SELECTION AND INFERENCE: FACTS AND FICTION , 2005, Econometric Theory.

[13]  Xiaohong Chen,et al.  Land of Addicts? An Empirical Investigation of Habit-Based Asset Pricing Models , 2004 .

[14]  L. Hansen.  Large Sample Properties of Generalized Method of Moments Estimators , 1982 .

[15]  J. Davidson.  Stochastic Limit Theory , 1994 .

[16]  Lars Peter Hansen,et al.  LARGE SAMPLE PROPERTIES OF GENERALIZED METHOD OF , 1982 .

[17]  K. Basu,et al.  Aggregating Infinite Utility Streams with InterGenerational Equity: The Impossibility of Being Paretian , 2003 .

[18]  Xiaohong Chen,et al.  Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions , 2003 .

[19]  H. Zou.  The Adaptive Lasso and Its Oracle Properties , 2006 .

[20]  Runze Li,et al.  Tuning parameter selectors for the smoothly clipped absolute deviation method. , 2007, Biometrika.

[21]  Donald W. K. Andrews,et al.  Consistent model and moment selection procedures for GMM estimation with application to dynamic panel data models , 2001 .

[22]  Whitney K. Newey,et al.  Generalized method of moments with many weak moment conditions , 2009 .

[23]  W. Newey,et al.  GMM with Many Weak Moment Conditions , 2005 .

[24]  P. J. Huber.  Robust Regression: Asymptotics, Conjectures and Monte Carlo , 1973 .

[25]  J. Horowitz,et al.  Asymptotic properties of bridge estimators in sparse high-dimensional regression models , 2008, 0804.0693.

[26]  Laura Alfaro,et al.  Why Doesn't Capital Flow from Rich to Poor Countries? An Empirical Investigation , 2008, The Review of Economics and Statistics.

[27]  Patrik Guggenberger,et al.  Generalized Empirical Likelihood Tests in Time Series Models With Potential Identification Failure (joint with R.J.Smith), accepted for publication, Journal of Econometrics , 2005 .

[28]  Keith Knight,et al.  SHRINKAGE ESTIMATION FOR NEARLY SINGULAR DESIGNS , 2007, Econometric Theory.

[29]  Taisuke Otsu,et al.  GENERALIZED EMPIRICAL LIKELIHOOD INFERENCE FOR NONLINEAR AND TIME SERIES MODELS UNDER WEAK IDENTIFICATION , 2006, Econometric Theory.

[30]  Chenlei Leng,et al.  Shrinkage tuning parameter selection with a diverging number of parameters , 2008 .

[31]  Anders Bredahl Kock,et al.  Inference in High-dimensional Dynamic Panel Data Models , 2014 .

[32]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[33]  Chirok Han,et al.  GMM with Many Moment Conditions , 2005 .

[34]  Xiaoli Gao,et al.  Asymptotic analysis of high-dimensional LAD regression with Lasso , 2016 .

[35]  M. Bhaskara Rao,et al.  Model Selection and Inference , 2000, Technometrics.

[36]  S. Portnoy.  Asymptotic Behavior of $M$-Estimators of $p$ Regression Parameters when $p^2/n$ is Large. I. Consistency , 1984 .

[37]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[38]  Mehmet Caner,et al.  LASSO-TYPE GMM ESTIMATOR , 2009, Econometric Theory.

[39]  Xiaohong Chen.  Chapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models , 2007 .

[40]  Dennis Kristensen,et al.  ABC of SV: Limited Information Likelihood Inference in Stochastic Volatility Jump-Diffusion Models , 2015 .

[41]  Hao Helen Zhang,et al.  ON THE ADAPTIVE ELASTIC-NET WITH A DIVERGING NUMBER OF PARAMETERS. , 2009, Annals of statistics.