Factorial Design for Efficient Experimentation

While James Dyson's eponymous company, Dyson Ltd., based in Malmesbury, United Kingdom, is known to make high-quality vacuum cleaners, Dyson might have saved himself and his company a lot of time and money if he had been aware of the factorial design approach to experimentation. In fact, as discussed below, the statement of Dyson on cause and effect is incorrect. It is possible to learn what improves a system by changing more than one input variable at a time. Furthermore, this learning can be done more efficiently and with the additional benefit of acquiring information about input-variable interactions that cannot be revealed in the one-at-a-time changes advocated by Dyson. Unfortunately, he is not alone in his beliefs. Many in industry, government, and elsewhere share such misconceptions. The aim of this article is to present some of the key ideas in factorial designs and demonstrate how this approach offers both greater efficiency and insight than one-at-a-time changes.

[1]  Jongwon Kim,et al.  Controller gain tuning of a simultaneous multi-axis PID control system using the Taguchi method , 2000 .

[2]  David H. Annis,et al.  Rethinking the Paper Helicopter , 2005 .

[3]  Jack P. C. Kleijnen Design and Analysis of Simulation Experiments , 2007 .

[4]  G. Box,et al.  On the Experimental Attainment of Optimum Conditions , 1951 .

[5]  D. B. Duncan,et al.  Linear Dynamic Recursive Estimation from the Viewpoint of Regression Analysis , 1972 .

[6]  Håkan Hjalmarsson,et al.  From experiment design to closed-loop control , 2005, Autom..

[7]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[8]  Karen A. F. Copeland Experiments: Planning, Analysis, and Parameter Design Optimization , 2002 .

[9]  Enrique Del Castillo,et al.  Process Optimization: A Statistical Approach , 2007 .

[10]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[11]  P. Laycock,et al.  Optimum Experimental Designs , 1995 .

[12]  Richard Bellman,et al.  Introduction to matrix analysis (2nd ed.) , 1997 .

[13]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[14]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[15]  Luc Pronzato,et al.  Optimal experimental design and some related control problems , 2008, Autom..

[16]  D. Popovic,et al.  Extremum seeking methods for optimization of variable cam timing engine operation , 2006, IEEE Transactions on Control Systems Technology.

[17]  Kevin M. Passino,et al.  Biomimicry for Optimization, Control and Automation , 2004, IEEE Transactions on Automatic Control.

[18]  Fazil A. Aliev,et al.  Evaluation of convergence rate in the central limit theorem for the Kalman filter , 1999, IEEE Trans. Autom. Control..

[19]  Graham C. Goodwin,et al.  Choosing Between Open- and Closed-Loop Experiments in Linear System Identification , 2007, IEEE Transactions on Automatic Control.

[20]  Eric Walter,et al.  Qualitative and quantitative experiment design for phenomenological models - A survey , 1990, Autom..

[21]  Dragan Kukolj,et al.  Experimental design of supervisory control functions based on multilayer perceptrons , 2001, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[22]  Anthony C. Atkinson,et al.  Optimum Experimental Designs , 1992 .

[23]  Jack P. C. Kleijnen,et al.  A User's Guide to the Brave New World of Designing Simulation Experiments. State-of-the-Art Review , 2005 .

[24]  Anthony C. Atkinson,et al.  Optimum Experimental Designs, with SAS , 2007 .

[25]  J. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[26]  Christine M. Anderson-Cook Quality By Experimental Design (3rd ed.). Thomas B. Barker , 2007 .

[27]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[28]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[29]  D.G. Dudley,et al.  Dynamic system identification experiment design and data analysis , 1979, Proceedings of the IEEE.

[30]  James C. Spall,et al.  Parameter identification for state-space models with nuisance parameters , 1990 .

[31]  D. Ucinski Optimal measurement methods for distributed parameter system identification , 2004 .

[32]  O. Kempthorne,et al.  Introduction to experimental design , 1994 .

[33]  J. Spall,et al.  Asymptotic distribution theory for the kalman filter state estimator , 1984 .