D-optimal design methods for robust estimation of multivariate location and scatter

Using ideas and techniques from related disciplines frequently proves productive and often yields new insights and methods. In this paper, a method from experimental design is applied to the robust estimation of multivariate location and scatter. In particular, the procedure of determining discrete D-optimal designs is applied to the problem of finding the robust estimator called the minimum volume ellipsoid (MVE). The objective of the D-optimal design problem is to select h points to include in the design from a set of n candidate points such that the determinant of the information matrix is maximized. To calculate the MVE, a subset of h points must be selected where the volume of the ellipsoid covering them is the minimum over all possible subsets of size h. We demonstrate the relationship of these optimization problems and propose a technique to select the subset of points for both applications. The subset selection method is applied to several regression data sets where the true MVE estimate is known.

[1]  J. Kiefer,et al.  Optimum Designs in Regression Problems , 1959 .

[2]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[3]  D. Titterington Optimal design: Some geometrical aspects of D-optimality , 1975 .

[4]  A. Mood On Hotelling's Weighing Problem , 1946 .

[5]  Robert H. Tolson,et al.  Maximizing the determinant of the information matrix with the effective independence method , 1992 .

[6]  P. Rousseeuw Multivariate estimation with high breakdown point , 1985 .

[7]  R. C. St. John,et al.  D-Optimality for Regression Designs: A Review , 1975 .

[8]  Douglas M. Hawkins,et al.  Exact iterative computation of the robust multivariate minimum volume ellipsoid estimator , 1993 .

[9]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[10]  Alan J. Miller,et al.  A review of some exchange algorithms for constructing discrete D-optimal designs , 1992 .

[11]  A. Wald On the Efficient Design of Statistical Investigations , 1943 .

[12]  R. Mathar,et al.  On a class of algorithms from experimental design theory , 1992 .

[13]  David M. Rocke,et al.  Heuristic Search Algorithms for the Minimum Volume Ellipsoid , 1993 .

[14]  Daniel C. Kammer Sensor placement for on-orbit modal identification and correlation of large space structures , 1991 .

[15]  Wendy Lynn Poston Optimal subset selection methods , 1995 .

[16]  Douglas M. Hawkins,et al.  A Feasible Solution Algorithm for the Minimum Volume Ellipsoid Estimator in Multivariate Data , 1993 .