Nonparametric estimation when data on derivatives are available

We consider settings where data are available on a nonparametric function and various partial derivatives. Such circumstances arise in practice, for example in the joint estimation of cost and input functions in economics. We show that when derivative data are available, local averages can be replaced in certain dimensions by nonlocal averages, thus reducing the nonparametric dimension of the problem. We derive optimal rates of convergence and conditions under which dimension reduction is achieved. Kernel estimators and their properties are analyzed, although other estimators, such as local polynomial, spline and nonparametric least squares, may also be used. Simulations and an application to the estimation of electricity distribution costs are included.

[1]  R. Tibshirani,et al.  Linear Smoothers and Additive Models , 1989 .

[2]  Stanley R. Johnson,et al.  Varying Coefficient Models , 1984 .

[3]  O. Linton,et al.  A kernel method of estimating structured nonparametric regression based on marginal integration , 1995 .

[4]  Carl E. Rasmussen,et al.  Derivative Observations in Gaussian Process Models of Dynamic Systems , 2002, NIPS.

[5]  I. Johnstone,et al.  Projection-Based Approximation and a Duality with Kernel Methods , 1989 .

[6]  P. Bickel,et al.  Nonparametric estimators which can be "plugged-in" , 2003 .

[7]  D. McFadden,et al.  Production Economics: A Dual Approach to Theory and Applications. Volume I: The Theory of Production.@@@Production Economics: A Dual Approach to Theory and Applications. Volume 2: Applications to the Theory of Production. , 1979 .

[8]  C. J. Stone,et al.  Optimal Global Rates of Convergence for Nonparametric Regression , 1982 .

[9]  J. Friedman.  Multivariate adaptive regression splines , 1990 .

[10]  Jerome H. Friedman.  Multivariate adaptive regression splines (with discussion) , 1991 .

[11]  J. Simonoff.  Smoothing Methods in Statistics , 1998 .

[12]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[13]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[14]  D. McFadden,et al.  Production Economics: A Dual Approach to Theory and Applications (I): The Theory of Production , 1978 .

[15]  Wolfgang Härdle,et al.  Direct estimation of low-dimensional components in additive models , 1998 .

[16]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[17]  Daniel Sbarbaro,et al.  Nonlinear adaptive control using non-parametric Gaussian Process prior models , 2002 .

[18]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[19]  C. J. Stone,et al.  Optimal Rates of Convergence for Nonparametric Estimators , 1980 .

[20]  Fabio Trojani,et al.  Semiparametric Regression for the Applied Econometrician , 2006 .

[21]  J. Florens,et al.  Sobolev Estimation of Approximate Regressions , 1996, Econometric Theory.

[22]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[23]  D. Jorgenson.  Econometric Methods for Modeling Producer Behavior , 1986 .

[24]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .