Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Generalized Residuals

This paper studies nonparametric estimation of conditional moment restrictions in which the generalized residual functions can be nonsmooth in the unknown functions of endogenous variables. This is a nonparametric nonlinear instrumental variables (IV) problem. We propose a class of penalized sieve minimum distance (PSMD) estimators, which are minimizers of a penalized empirical minimum distance criterion over a collection of sieve spaces that are dense in the infinite dimensional function parameter space. Some of the PSMD procedures use slowly growing finite dimensional sieves with flexible penalties or without any penalty; others use large dimensional sieves with lower semicompact and/or convex penalties. We establish their consistency and the convergence rates in Banach space norms (such as a sup-norm or a root mean squared norm), allowing for possibly non-compact infinite dimensional parameter spaces. For both mildly and severely ill-posed nonlinear inverse problems, our convergence rates in Hilbert space norms (such as a root mean squared norm) achieve the known minimax optimal rate for the nonparametric mean IV regression. We illustrate the theory with a nonparametric additive quantile IV regression. We present a simulation study and an empirical application of estimating nonparametric quantile IV Engel curves.

[1]  G. Glauberman Proof of Theorem A , 1977 .

[2]  E. Zeidler Nonlinear Functional Analysis and its Applications: III: Variational Methods and Optimization , 1984 .

[3]  E. Zeidler Nonlinear functional analysis and its applications , 1988 .

[4]  A. Gallant,et al.  Seminonparametric Estimation Of Conditionally Constrained Heterogeneous Processes: Asset Pricing Applications , 1989 .

[5]  D. Pollard Empirical Processes: Theory and Applications , 1990 .

[6]  Gary Chamberlain,et al.  Efficiency Bounds for Semiparametric Regression , 1992 .

[7]  W. Newey,et al.  16 Efficient estimation of models with conditional moment restrictions , 1993 .

[8]  Y. Meyer Wavelets and Operators , 1993 .

[9]  S. Viswanathan,et al.  No Arbitrage and Arbitrage Pricing: A New Approach , 1993 .

[10]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[11]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[12]  H. Triebel,et al.  Function Spaces, Entropy Numbers, Differential Operators: Function Spaces , 1996 .

[13]  W. Newey,et al.  Convergence rates and asymptotic normality for series estimators , 1997 .

[14]  Xiaotong Shen,et al.  Sieve extremum estimates for weakly dependent data , 1998 .

[15]  Jianhua Z. Huang Projection estimation in multiple regression with application to functional ANOVA models , 1998 .

[16]  Yuhong Yang,et al.  Information-theoretic determination of minimax rates of convergence , 1999 .

[17]  P. Eggermont,et al.  Maximum penalized likelihood estimation , 2001 .

[18]  V. Chernozhukov,et al.  An IV Model of Quantile Treatment Effects , 2002 .

[19]  Oliver Linton,et al.  Estimation of Semiparametric Models When the Criterion Function is Not Smooth , 2002 .

[20]  J. Florens,et al.  Nonparametric Instrumental Regression , 2010 .

[21]  Jianhua Z. Huang Local asymptotics for polynomial spline regression , 2003 .

[22]  A. Chesher Identification in Nonseparable Models , 2003 .

[23]  Xiaohong Chen,et al.  Land of Addicts? An Empirical Investigation of Habit-Based Asset Pricing Models , 2004 .

[24]  Xiaohong Chen,et al.  Estimation of Semiparametric Models When the Criterion Function is Not Smooth , 2002 .

[25]  J. Florens,et al.  Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization , 2003 .

[26]  Xiaohong Chen,et al.  Semi‐Nonparametric IV Estimation of Shape‐Invariant Engel Curves , 2003 .

[27]  W. Newey,et al.  Instrumental variable estimation of nonparametric models , 2003 .

[28]  Xiaohong Chen,et al.  Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions , 2003 .

[29]  P. Hall,et al.  Nonparametric methods for inference in the presence of instrumental variables , 2003, math/0603130.

[30]  Xiaohong Chen,et al.  Land of Addicts? An Empirical Investigation of Habit-Based Asset Pricing Behavior , 2004 .

[31]  Joel L. Horowitz,et al.  Nonparametric Estimation of an Additive Quantile Regression Model , 2004 .

[32]  Felix Schlenk,et al.  Proof of Theorem 3 , 2005 .

[33]  Sergei V. Pereverzev,et al.  Regularization in Hilbert scales under general smoothing conditions , 2005 .

[34]  Nonparametric Estimation of an Additive Quantile Regression Model , 2005 .

[35]  B. Silverman,et al.  Maximum Penalized Likelihood Estimation , 2006 .

[36]  Joel L. Horowitz,et al.  Nonparametric Instrumental Variables Estimation of a Quantile Regression Model , 2006 .

[37]  T. Severini,et al.  SOME IDENTIFICATION ISSUES IN NONPARAMETRIC LINEAR MODELS WITH ENDOGENOUS REGRESSORS , 2006, Econometric Theory.

[38]  Joel L. Horowitz,et al.  Rate-optimal estimation for a general class of nonparametric regression models with unknown link functions , 2007, 0803.2999.

[39]  Nicolai Bissantz,et al.  Convergence Rates of General Regularization Methods for Statistical Inverse Problems and Applications , 2007, SIAM J. Numer. Anal..

[40]  Victor Chernozhukov,et al.  Instrumental variable estimation of nonseparable models , 2007 .

[41]  Xiaohong Chen Chapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models , 2007 .

[42]  Rosa L. Matzkin NONPARAMETRIC IDENTIFICATION , 2012 .

[43]  Demian Pouzo,et al.  Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Moments , 2008 .

[44]  Demian Pouzo,et al.  Efficient Estimation of Semiparametric Conditional Moment Models with Possibly Nonsmooth Residuals , 2008 .

[45]  C. Arellano Default risk and income fluctuations in emerging economies , 2008 .

[46]  Xiaohong Chen,et al.  On nonlinear ill-posed inverse problems with applications to pricing of defaultable bonds and option pricing , 2009 .

[47]  Xiaohong Chen,et al.  Land of addicts? an empirical investigation of habit-based asset pricing models , 2009 .

[48]  Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Generalized Residuals , 2009 .

[49]  J. Florens,et al.  IDENTIFICATION AND ESTIMATION BY PENALIZATION IN NONPARAMETRIC INSTRUMENTAL REGRESSION , 2010, Econometric Theory.

[50]  Xavier D'Haultfoeuille,et al.  ON THE COMPLETENESS CONDITION IN NONPARAMETRIC INSTRUMENTAL PROBLEMS , 2010, Econometric Theory.

[51]  Xiaohong Chen,et al.  ON RATE OPTIMALITY FOR ILL-POSED INVERSE PROBLEMS IN ECONOMETRICS , 2007, Econometric Theory.

[52]  P. Gagliardini,et al.  Nonparametric Instrumental Variable Estimation of Structural Quantile effects , 2011 .

[53]  W. Newey,et al.  Local Identification of Nonparametric and Semiparametric Models , 2011, 1105.3007.

[54]  P. Gagliardini,et al.  Tikhonov Regularization for Nonparametric Instrumental Variable Estimators , 2011 .

[55]  Irène Gijbels,et al.  Semiparametric estimation of conditional copulas , 2012, J. Multivar. Anal..

[56]  Richard J. Smith,et al.  Exogeneity in semiparametric moment condition models , 2012 .

[57]  Azeem M. Shaikh,et al.  On the Testability of Identification in Some Nonparametric Models With Endogeneity , 2012 .

[58]  Joel L. Horowitz,et al.  Adaptive nonparametric instrumental variables estimation: empirical choice of the regularization parameter , 2013 .