Nonparametric Least Squares Estimation of a Multivariate Convex Regression Function

This paper deals with the consistency of the least squares estimator of a convex regression function when the predictor is multidimensional. We characterize and discuss the computation of such an estimator via the solution of certain quadratic and linear programs. Mild sufficient conditions for the consistency of this estimator and its subdifferentials in fixed and stochastic design regression settings are provided. We also consider a regression function which is known to be convex and componentwise nonincreasing and discuss the characterization, computation and consistency of its least squares estimator.

[1]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[2]  C. Hildreth.  Point Estimates of Ordinates of Concave Functions , 1954 .

[3]  H. D. Brunk.  Maximum Likelihood Estimates of Monotone Parameters , 1955 .

[4]  U. Grenander.  On the theory of mortality measurement , 1956 .

[5]  R. Courant,et al.  Introduction to Calculus and Analysis , 1991 .

[6]  L.Ya. Tslaf,et al.  Introduction to calculus and analysis. vol. 1: Courant, R. and John, F. New York-London-Sydney, Intersci. Publs. A div. of John Wiley and Sons, Inc., VII + 661 pp., 80/-, 1965☆ , 1967 .

[7]  D. L. Hanson,et al.  Consistency in Concave Regression , 1976 .

[8]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[9]  E. Bronshtein.  Extremal convex functions , 1978 .

[10]  H. Varian.  The Nonparametric Approach to Demand Analysis , 1982 .

[11]  Gerald B. Folland,et al.  Real Analysis: Modern Techniques and Their Applications , 1984 .

[12]  H. Varian.  The Nonparametric Approach to Production Analysis , 1984 .

[13]  Pravin M. Vaidya,et al.  Fast algorithms for convex quadratic programming and multicommodity flows , 1986, STOC '86.

[14]  Sanjay Mehrotra,et al.  An Algorithm for Convex Quadratic Programming That Requires O(n3.5L) Arithmetic Operations , 1990, Math. Oper. Res..

[15]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.

[16]  Rosa L. Matzkin.  Semiparametric Estimation of Monotone and Concave Utility Functions for Polychotomous Choice Models , 1991 .

[17]  E. Mammen.  Nonparametric regression under qualitative smoothness assumptions , 1991 .

[18]  R. Banker,et al.  Maximum likelihood estimation of monotone and concave production frontiers , 1992 .

[19]  Rosa L. Matzkin.  Nonparametric identification and estimation of polychotomous choice models , 1993 .

[20]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[21]  Ajay Maindiratta,et al.  On the Consistency of Maximum Likelihood Estimation of Monotone and Concave Production Frontiers , 1997 .

[22]  Natashia Boland,et al.  A dual-active-set algorithm for positive semi-definite quadratic programming , 1997, Math. Program..

[23]  D. Harville.  Matrix Algebra From a Statistician's Perspective , 1998 .

[24]  J. Wellner,et al.  Estimation of a convex function: characterizations and asymptotic theory. , 2001 .

[25]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[26]  Cun-Hui Zhang.  Risk bounds in isotonic regression , 2002 .

[27]  Arie Beresteanu,et al.  Nonparametric Estimation of Regression Functions under Restrictions on Partieal Derivatives , 2004 .

[28]  Zhengjun Cao,et al.  The generalized decomposition theorem in Banach spaces and its applications , 2004, J. Approx. Theory.

[29]  Gad Allon,et al.  Nonparametric Estimation of Concave Production Technologies by Entropic Methods , 2005 .

[30]  Holger Dette,et al.  Estimating a Convex Function in Nonparametric Regression , 2007 .

[31]  Timo Kuosmanen.  Representation Theorem for Convex Nonparametric Least Squares , 2008, Econometrics Journal.

[32]  M. Cule,et al.  Maximum likelihood estimation of a multi‐dimensional log‐concave density , 2008, 0804.3989.

[33]  S. Geer,et al.  Multivariate log-concave distributions as a nearly parametric model , 2008, Am. Math. Mon..

[34]  J. Fu,et al.  An extension of Alexandrov's theorem on second derivatives of convex functions , 2009, 0908.0278.

[35]  M. Cule,et al.  Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density , 2009, 0908.4400.

[36]  SUPPLEMENT TO \NONPARAMETRIC ESTIMATION OF MULTIVARIATE CONVEX-TRANSFORMED DENSITIES." , 2010 .

[37]  Discussion of the paper by Cule, Samworth and Stewart: \Maximum likelihood estimation of a multidimensional log-concave density" , 2010 .

[38]  L. Dümbgen,et al.  Consistency of multivariate log-concave density estimators , 2010 .

[39]  Jon A Wellner,et al.  NONPARAMETRIC ESTIMATION OF MULTIVARIATE CONVEX-TRANSFORMED DENSITIES. , 2009, Annals of statistics.