Efficient computational algorithms for approximate optimal designs

ABSTRACT In this paper, we propose two simple yet efficient computational algorithms to obtain approximate optimal designs for multi-dimensional linear regression on a large variety of design spaces. We focus on the two commonly used optimal criteria, Dand A-optimal criteria. For D-optimality, we provide an alternative proof for the monotonic convergence for D-optimal criterion and propose an efficient computational algorithm to obtain the approximate D-optimal design. We further show that the proposed algorithm converges to the D-optimal design, and then prove that the approximate D-optimal design converges to the continuous D-optimal design under certain conditions. For A-optimality, we provide an efficient algorithm to obtain approximate A-optimal design and conjecture the monotonicity of the proposed algorithm. Numerical comparisons suggest that the proposed algorithms perform well and they are comparable or superior to some existing algorithms.

[1]  J. Kiefer,et al.  Optimum Designs in Regression Problems , 1959 .

[2]  F. Pukelsheim Optimal Design of Experiments , 1993 .

[3]  Hon Keung Tony Ng,et al.  Efficient computational algorithm for optimal continuous experimental designs , 2018, J. Comput. Appl. Math..

[4]  J. S. Hunter,et al.  Statistics for experimenters : an introduction to design, data analysis, and model building , 1979 .

[5]  Matemática,et al.  Society for Industrial and Applied Mathematics , 2010 .

[6]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[7]  Anthony C. Atkinson,et al.  Optimum Experimental Designs, with SAS , 2007 .

[8]  Hon Keung Tony Ng,et al.  Efficient computational algorithm for optimal allocation in regression models , 2013, J. Comput. Appl. Math..

[9]  Yaming Yu,et al.  D-optimal designs via a cocktail algorithm , 2009, Stat. Comput..

[10]  W. J. Studden,et al.  Tchebycheff Systems: With Applications in Analysis and Statistics. , 1967 .

[11]  W. Welch Algorithmic complexity: three NP- hard problems in computational statistics , 1982 .

[12]  Christopher J. Nachtsheim,et al.  Model Robust, Linear-Optimal Designs , 1982 .

[13]  Radoslav Harman,et al.  A Randomized Exchange Algorithm for Computing Optimal Approximate Designs of Experiments , 2018, Journal of the American Statistical Association.

[14]  H. Wynn The Sequential Generation of $D$-Optimum Experimental Designs , 1970 .

[15]  Peter Goos,et al.  I-Optimal Design of Mixture Experiments , 2016 .

[16]  R. K. Meyer,et al.  The Coordinate-Exchange Algorithm for Constructing Exact Optimal Experimental Designs , 1995 .

[17]  J. Kiefer General Equivalence Theory for Optimum Designs (Approximate Theory) , 1974 .

[18]  Holger Dette,et al.  The Theory of Canonical Moments with Applications in Statistics, Probability, and Analysis , 1997 .

[19]  Didier Henrion,et al.  Approximate Optimal Designs for Multivariate Polynomial Regression , 2017, The Annals of Statistics.

[20]  S. Silvey,et al.  An algorithm for optimal designs on a design space , 1978 .

[21]  Kalliopi Mylona,et al.  Optimum design of experiments for statistical inference : discussion , 2012 .