A more efficient algorithm for Convex Nonparametric Least Squares

Convex Nonparametric Least Squares (CNLSs) is a nonparametric regression method that does not require a priori specification of the functional form. The CNLS problem is solved by mathematical programming techniques; however, since the CNLS problem size grows quadratically as a function of the number of observations, standard quadratic programming (QP) and Nonlinear Programming (NLP) algorithms are inadequate for handling large samples, and the computational burdens become significant even for relatively small samples. This study proposes a generic algorithm that improves the computational performance in small samples and is able to solve problems that are currently unattainable. A Monte Carlo simulation is performed to evaluate the performance of six variants of the proposed algorithm. These experimental results indicate that the most effective variant can be identified given the sample size and the dimensionality. The computational benefits of the new algorithm are demonstrated by an empirical application that proved insurmountable for the standard QP and NLP algorithms.

[1]  Timo Kuosmanen.  Representation Theorem for Convex Nonparametric Least Squares , 2008, Econometrics Journal.

[2]  A. Henningsen,et al.  Imposing regional monotonicity on translog stochastic production frontiers with a simple three-step procedure , 2009 .

[3]  Timo Kuosmanen,et al.  A More Efficient Algorithm for Convex Nonparametric Least Squares , 2011 .

[4]  C. Hildreth.  Point Estimates of Ordinates of Concave Functions , 1954 .

[5]  José H. Dulá.  An Algorithm for Data Envelopment Analysis , 2011, INFORMS J. Comput..

[6]  Pedro Morin,et al.  On uniform consistent estimators for convex regression , 2011 .

[7]  E. Seijo,et al.  Nonparametric Least Squares Estimation of a Multivariate Convex Regression Function , 2010, 1003.4765.

[8]  Timo Kuosmanen,et al.  Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints , 2012 .

[9]  Selmer M. Johnson,et al.  On a Linear-Programming, Combinatorial Approach to the Traveling-Salesman Problem , 1959 .

[10]  H. Varian.  The Nonparametric Approach to Production Analysis , 1984 .

[11]  E. Mammen.  Nonparametric regression under qualitative smoothness assumptions , 1991 .

[12]  R. Färe,et al.  Measuring the efficiency of decision making units: A comment , 1984 .

[13]  Timo Kuosmanen,et al.  Data Envelopment Analysis as Nonparametric Least-Squares Regression , 2010, Oper. Res..

[14]  R. Just,et al.  Stochastic specification of production functions and economic implications , 1978 .

[15]  A. Charnes,et al.  The non-archimedean CCR ratio for efficiency analysis: A rejoinder to Boyd and Färe☆ , 1984 .

[16]  John Ruggiero,et al.  Nonparametric measurement of productivity and efficiency in education , 2014, Ann. Oper. Res..

[17]  Harold O. Fried,et al.  The Measurement of Productive Efficiency and Productivity Growth , 2008 .

[18]  Timo Kuosmanen,et al.  One-stage estimation of the effects of operational conditions and practices on productive performance: asymptotically normal and efficient, root-n consistent StoNEZD method , 2011 .

[19]  J. Wellner,et al.  Estimation of a convex function: characterizations and asymptotic theory. , 2001 .

[20]  David B. Dunson,et al.  Ensemble Methods for Convex Regression with Applications to Geometric Programming Based Circuit Design , 2012, ICML.

[21]  B. N. Pshenichnyi,et al.  Numerical Methods in Extremal Problems. , 1978 .

[22]  Hal R. Varian,et al.  Non-parametric analysis of optimizing behavior with measurement error , 1985 .

[23]  D. Wilhelmsen.  A nearest point algorithm for convex polyhedral cones and applications to positive linear approximation , 1976 .

[24]  Peter W. Glynn,et al.  Consistency of Multidimensional Convex Regression , 2012, Oper. Res..

[25]  S. Afriat.  Efficiency Estimation of Production Function , 1972 .

[26]  M. J. Todd,et al.  Two new proofs of Afriat’s theorem , 2003 .

[27]  A.A.R. Madhavi,et al.  Efficiency Estimation of Production Functions , 2013 .

[28]  A. Yatchew,et al.  Nonparametric Regression Techniques in Economics , 1998 .

[29]  R. Dykstra.  An Algorithm for Restricted Least Squares Regression , 1983 .

[30]  Timo Kuosmanen,et al.  One-stage and two-stage DEA estimation of the effects of contextual variables , 2012, Eur. J. Oper. Res..

[31]  Andrew L. Johnson,et al.  Estimating the shadow prices of SO2 and NOx for U.S. coal power plants: A convex nonparametric least squares approach , 2012 .

[32]  S. Afriat.  THE CONSTRUCTION OF UTILITY FUNCTIONS FROM EXPENDITURE DATA , 1967 .

[33]  S. Goldman.  Nonparametric Multivariate Regression Subject to Constraint , 1993 .

[34]  William J. Cook,et al.  Solution of a Large-Scale Traveling-Salesman Problem , 1954, 50 Years of Integer Programming.

[35]  H. Varian.  The Nonparametric Approach to Demand Analysis , 1982 .

[36]  C. Lovell,et al.  On the estimation of technical inefficiency in the stochastic frontier production function model , 1982 .

[37]  A. Charnes,et al.  Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis , 1984 .

[38]  Timo Kuosmanen,et al.  Role of benchmark technology in sustainable value analysis: an application to Finnish dairy farms. , 2009 .

[39]  Mary C. Meyer.  An extension of the mixed primal–dual bases algorithm to the case of more constraints than dimensions , 1999 .

[40]  Jeffrey S. Racine,et al.  Nonparametric Kernel Regression with Multiple Predictors and Multiple Shape Constraints , 2012 .

[41]  Christine Thomas-Agnan,et al.  Smoothing Splines and Shape Restrictions , 1999 .

[42]  Timo Kuosmanen,et al.  Stochastic semi-nonparametric frontier estimation of electricity distribution networks: Application of the StoNED method in the Finnish regulatory model , 2012 .

[43]  D. L. Hanson,et al.  Consistency in Concave Regression , 1976 .

[44]  Paul Arthur Ruud.  RESTRICTED LEAST SQUARES SUBJECT TO MONOTONICITY AND CONCAVITY CONSTRAINTS. , 1995 .