Optimal static and sequential design : a critical review

The aim of this thesis is to review and augment the theory and methods of optimal experimental design. In Chapter I the scene is set by considering the possible aims of an experimenter prior to an experiment, the statistical methods one might use to achieve those aims and how experimental design might aid this procedure. It is indicated that, given a criterion for design, a priori optimal design will only be possible in certain instances and, otherwise, some form of sequential procedure would seem to be indicated. In Chapter 2 an exact experimental design problem is formulated mathematically and is compared with its continuous analogue. Motivation is provided for the solution of this continuous problem, and the remainder of the chapter concerns this problem. A necessary and sufficient condition for optimality of a design measure is given. Problems which might arise in testing this condition are discussed, in particular with respect to possible non-differentiability of the criterion function at the design being tested. Several examples are given of optimal designs which may be found analytically and which illustrate the points discussed earlier in the chapter. In Chapter 3 numerical methods of solution of the continuous optimal design problem are reviewed. A new algorithm is presented with illustrations of how it should be used in practice. It is shown that, for reasonably large sample size, continuously optimal designs may be approximated to well by an exact design. In situations where this is not satisfactory algorithms for improvement of this design are reviewed. Chapter 4 consists of a discussion of sequentially designed experiments, with regard to both the philosophies underlying, and the application of the methods of, statistical inference. In Chapter 5 we criticise constructively previous suggestions for fully sequential design procedures. Alternative suggestions are made along with conjectures as to how these might improve performance. Chapter 6 presents a simulation study, the aim of which is to investigate the conjectures of Chapter 5. The results of this study provide empirical support for these conjectures. In Chapter 7 examples are analysed. These suggest aids to sequential experimentation by means of reduction of the dimension of the design space and the possibility of experimenting semi-sequentially. Further examples are considered which stress the importance of the use of prior information in situations of this type. Finally we consider the design of experiments when semi-sequential experimentation is mandatory because of the necessity of taking batches of observations at the same time. In Chapter 8 we look at some of the assumptions which have been made and indicate what may go wrong where these assumptions no longer hold.

[1]  K. Smith.  ON THE STANDARD DEVIATIONS OF ADJUSTED AND INTERPOLATED VALUES OF AN OBSERVED POLYNOMIAL FUNCTION AND ITS CONSTANTS AND THE GUIDANCE THEY GIVE TOWARDS A PROPER CHOICE OF THE DISTRIBUTION OF OBSERVATIONS , 1918 .

[2]  J. I.  The Design of Experiments , 1936, Nature.

[3]  G. Elfving.  Optimum Allocation in Linear Regression Theory , 1952 .

[4]  D. Lindley.  On a Measure of the Information Provided by an Experiment , 1956 .

[5]  P. G. Guest,et al.  The Spacing of Observations in Polynomial Regression , 1958 .

[6]  Paul G. Hoel,et al.  Efficiency Problems in Polynomial Estimation , 1958 .

[7]  J. Kiefer.  ON THE NONRANDOMIZED OPTIMALITY AND RANDOMIZED NONOPTIMALITY OF SYMMETRICAL DESIGNS , 1958 .

[8]  H. L. Lucas,et al.  DESIGN OF EXPERIMENTS IN NON-LINEAR SITUATIONS , 1959 .

[9]  G. Box,et al.  A Basis for the Selection of a Response Surface Design , 1959 .

[10]  J. Kiefer.  Optimum Experimental Designs , 1959 .

[11]  J. Kiefer,et al.  Optimum Designs in Regression Problems , 1959 .

[12]  John Mandel,et al.  Planning of Experiments. , 1959 .

[13]  J. E. Kelley,et al.  The Cutting-Plane Method for Solving Convex Programs , 1960 .

[14]  J. Kiefer,et al.  The Equivalence of Two Extremum Problems , 1960, Canadian Journal of Mathematics.

[15]  S. Silvey.  A Note on Maximum‐Likelihood in the Case of Dependent Random Variables , 1961 .

[16]  P. Wolfe.  Accelerating the Cutting Plane Method for Nonlinear Programming , 1961 .

[17]  W. G. Hunter,et al.  The Experimental Study of Physical Mechanisms , 1965 .

[18]  William G. Hunter,et al.  Designs for Discriminating Between Two Rival Models , 1965 .

[19]  W. G. Hunter,et al.  Design of experiments for parameter estimation in multiresponse situations , 1966 .

[20]  W. J. Studden,et al.  Optimal Experimental Designs , 1966 .

[21]  William J. Hill,et al.  Discrimination Among Mechanistic Models , 1967 .

[22]  W. G. Hunter,et al.  The use of prior distributions in the design of experiments for parameter estimation in non-linear situations. , 1967, Biometrika.

[23]  W. G. Hunter,et al.  The use of prior distributions in the design of experiments for parameter estimation in non-linear situations: multiresponse case. , 1967, Biometrika.

[24]  Andrej Pázman,et al.  Design of Physical Experiments (Statistical Methods) , 1968, 1968.

[25]  P. Laycock,et al.  Optimal designs in regression problems with a general convex loss function. , 1968, Biometrika.

[26]  Corwin L. Atwood,et al.  Optimal and Efficient Designs of Experiments , 1969 .

[27]  R. Jennrich.  Asymptotic Properties of Non-Linear Least Squares Estimators , 1969 .

[28]  Anthony C. Atkinson.  Constrained Maximisation and the Design of Experiments , 1969 .

[29]  H. Wynn.  The Sequential Generation of $D$-Optimum Experimental Designs , 1970 .

[30]  G. Zyskind.  Introduction to Matrices with Applications in Statistics , 1970 .

[31]  M. J. Box.  Some Experiences with a Nonlinear Experimental Design Criterion , 1970 .

[32]  A. P. Dawid,et al.  On the limiting normality of posterior distributions , 1970, Mathematical Proceedings of the Cambridge Philosophical Society.

[33]  Karl Johan Åström,et al.  BOOK REVIEW SYSTEM IDENTIFICATION , 1994, Econometric Theory.

[34]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[35]  L. White.  An extension of the General Equivalence Theorem to nonlinear models , 1973 .

[36]  C. Atwood.  Sequences Converging to $D$-Optimal Designs of Experiments , 1973 .

[37]  S. Silvey,et al.  A geometric approach to optimal design theory , 1973 .

[38]  Andrej Pázman,et al.  A Convergence Theorem in the Theory of $D$-Optimum Experimental Designs , 1974 .

[39]  B. Bhat,et al.  On the Method of Maximum-Likelihood for Dependent Observations , 1974 .

[40]  D. Cox,et al.  Planning Experiments for Discriminating between Models , 1974 .

[41]  Raman K. Mehra,et al.  Optimal input signals for parameter estimation in dynamic systems--Survey and new results , 1974 .

[42]  J. Kiefer.  General Equivalence Theory for Optimum Designs (Approximate Theory) , 1974 .

[43]  W. J. Hill,et al.  Design of Experiments for Subsets of Parameters , 1974 .

[44]  Raman K. Mehra,et al.  Frequency-domain synthesis of optimal inputs for multiinput-multioutput (MIMO) systems with process noise , 1974, CDC 1974.

[45]  S. Silvey,et al.  A Lagrangian approach to optimal design , 1974 .

[46]  L. Keviczky.  "Design of Experiments" for the Identification of Linear Dynamic Systems , 1975 .

[47]  D. Titterington.  Optimal design: Some geometrical aspects of D-optimality , 1975 .

[48]  A. Atkinson,et al.  Optimal design : Experiments for discriminating between several models , 1975 .

[49]  A. Atkinson,et al.  The design of experiments for discriminating between two rival models , 1975 .

[50]  R. Sibson,et al.  Coefficients in D‐Optimal Experimental Design , 1975 .

[51]  Corwin L. Atwood,et al.  Convergent Design Sequences, for Sufficiently Regular Optimality Criteria , 1976 .