Optimal Designs for Rational Function Regression

We consider the problem of finding optimal nonsequential designs for a large class of regression models involving polynomials and rational functions with heteroscedastic noise also given by a polynomial or rational weight function. Since the design weights can be found easily by existing methods once the support is known, we concentrate on determining the support of the optimal design. The proposed method treats D-, E-, A-, and Φ p -optimal designs in a unified manner, and generates a polynomial whose zeros are the support points of the optimal approximate design, generalizing a number of previously known results of the same flavor. The method is based on a mathematical optimization model that can incorporate various criteria of optimality and can be solved efficiently by well-established numerical optimization methods. In contrast to optimization-based methods previously proposed for the solution of similar design problems, our method also has theoretical guarantee of its algorithmic efficiency; in concordance with the theory, the actual running times of all numerical examples considered in the paper are negligible. The numerical stability of the method is demonstrated in an example involving high-degree polynomials. As a corollary, an upper bound on the size of the support set of the minimally supported optimal designs is also found.

[1]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[2]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[3]  Yurii Nesterov,et al.  Squared Functional Systems and Optimization Problems , 2000 .

[4]  P. G. Guest,et al.  The Spacing of Observations in Polynomial Regression , 1958 .

[5]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[6]  A. Ruszczynski,et al.  Nonlinear Optimization , 2006 .

[7]  Fu-Chuen Chang,et al.  On Minimally-supported D-optimal Designs for Polynomial Regression with Log-concave Weight Function , 2007 .

[8]  Holger Dette,et al.  Optimal Designs for Dose-Finding Studies , 2008 .

[9]  F. Chang,et al.  E-optimal designs for polynomial regression without intercept , 1996 .

[10]  Holger Dette,et al.  The Theory of Canonical Moments with Applications in Statistics, Probability, and Analysis , 1997 .

[11]  Paul G. Hoel,et al.  Efficiency Problems in Polynomial Estimation , 1958 .

[12]  E. E. Tyrtyshnikov How bad are Hankel matrices? , 1994 .

[13]  D-OPTIMAL DESIGNS FOR POLYNOMIAL REGRESSION WITH WEIGHT FUNCTION x/(1 + x) , 2003 .

[14]  Aharon Ben-Tal,et al.  Lectures on modern convex optimization , 1987 .

[15]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[16]  Didier Henrion,et al.  GloptiPoly: Global optimization over polynomials with Matlab and SeDuMi , 2003, TOMS.

[17]  W. J. Studden,et al.  Tchebycheff Systems: With Applications in Analysis and Statistics. , 1967 .

[18]  Michael Jackson,et al.  Optimal Design of Experiments , 1994 .

[19]  D. Majumdar,et al.  Some results on D-optimal designs for nonlinear models with applications , 2009 .

[20]  H. Dette OPTIMAL DESIGNS FOR A CLASS OF POLYNOMIALS OF ODD OR EVEN DEGREE , 1992 .

[21]  F. Lukács Verschärfung des ersten Mittelwertsatzes der Integralrechnung für rationale Polynome , 1918 .

[22]  V. Pan Structured Matrices and Polynomials: Unified Superfast Algorithms , 2001 .

[23]  Lorens A. Imhof,et al.  E-optimal designs for rational models , 1996 .

[24]  Abbas Seifi,et al.  Optimal design of multi-response experiments using semi-definite programming , 2009 .

[25]  R. K. Meyer,et al.  The Coordinate-Exchange Algorithm for Constructing Exact Optimal Experimental Designs , 1995 .

[26]  A. D. L. Garza,et al.  Spacing of Information in Polynomial Regression , 1954 .

[27]  R. Saigal,et al.  Handbook of semidefinite programming : theory, algorithms, and applications , 2000 .

[28]  V. Pan Structured Matrices and Polynomials , 2001 .

[29]  Stephen M. Stigler,et al.  Optimal Experimental Design for Polynomial Regression , 1971 .

[30]  E. Haynsworth Determination of the inertia of a partitioned Hermitian matrix , 1968 .

[31]  Gonzalo R. Arce,et al.  A Maximum Likelihood Approach to Least Absolute Deviation Regression , 2004, EURASIP J. Adv. Signal Process..

[32]  Fuzhen Zhang The Schur complement and its applications , 2005 .

[33]  Arkadi Nemirovski,et al.  Lectures on modern convex optimization - analysis, algorithms, and engineering applications , 2001, MPS-SIAM series on optimization.

[34]  Zhide Fang D-optimal designs for polynomial regression models through origin , 2002 .

[35]  G. Pólya,et al.  Problems and theorems in analysis , 1983 .

[36]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[37]  Holger Dette,et al.  Optimal designs for a class of nonlinear regression models , 2002 .

[38]  Henry Wolkowicz,et al.  Handbook of Semidefinite Programming , 2000 .

[39]  S. Silvey,et al.  A sequentially constructed design for estimating a nonlinear parametric function , 1980 .