Minimal volume ellipsoids

In bounded-error estimation one is interested in characterizing the set § of all values of the parameters of a model which are consistent with the data in the sense that the corresponding errors fall between known prior bounds. the problem treated here is the computation of a minimal volume ellipsoid guaranteed to contain §. Although this ellipsoidal approach to parameter bounding was initially applied to models linear in their parameters, where the only error to be accounted for was an output error, it can be extended to deal with errors-in-variables problems. This makes it possible to consider models nonlinear in their parameters or dynamical models where both inputs and outputs are subject to bounded errors. Recursive algorithms are considered first. the basic algorithm of Fogel and Huang (1982), developed from the seminal work of Schweppe (1973) and modified as suggested by Belforte and co-workers (1985, 1990), is derived in detail, which makes it possible to clarify the nature of the tests needed. This algorithm is proved to be mathematically equivalent to a recursively optimal algorithm independently developed by Todd (1980) and Konig and Pallaschke (1981) in the context of linear programming after the celebrated work of Khachiyan (1979). A recursive approach, also developed in this context, is suggested for errors-in-variables problems. Recursively optimal ellipsoids, however, are not globally optimal because of the approximations committed at each step. Using a methodology borrowed from experiment design, we obtain optimality conditions which can be used to derive a number of algorithms guaranteed to converge to the global optimum.

[1]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[2]  W. Kahan,et al.  Circumscribing an Ellipsoid about the Intersection of Two Ellipsoids , 1968, Canadian Mathematical Bulletin.

[3]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[4]  D. Titterington Optimal design: Some geometrical aspects of D-optimality , 1975 .

[5]  H. König,et al.  On Khachian's algorithm and minimal ellipsoids , 1980 .

[6]  L. Lovász,et al.  Geometric Algorithms and Combinatorial Optimization , 1981 .

[7]  Michael J. Todd,et al.  Feature Article - The Ellipsoid Method: A Survey , 1981, Oper. Res..

[8]  Y. F. Huang,et al.  On the value of information in system identification - Bounded noise case , 1982, Autom..

[9]  Dankmar Böhning,et al.  Numerical estimation of a probability measure , 1985 .

[10]  Yih-Fang Huang,et al.  A recursive estimation algorithm using selective updating for spectral analysis and adaptive signal processing , 1986, IEEE Trans. Acoust. Speech Signal Process..

[11]  J. P. Norton,et al.  Identification and application of bounded-parameter models , 1985, Autom..

[12]  J. Norton Identification of parameter bounds for ARMAX models from records with bounded noise , 1987 .

[13]  E. Walter,et al.  Robust experiment design via maximin optimization , 1988 .

[14]  Sylviane Gentil,et al.  Reformulation of parameter identification with unknown-but-bounded errors , 1988 .

[15]  Y. A. Merkuryev,et al.  Identification of objects with unknown bounded disturbances , 1989 .

[16]  D. Böhning Likelihood inference for mixtures: Geometrical and other constructions of monotone step-length algorithms , 1989 .

[17]  E. Walter,et al.  Exact recursive polyhedral description of the feasible parameter set for bounded-error models , 1989 .

[18]  J. Norton Recursive computation of inner bounds for the parameters of linear models , 1989 .

[19]  J. Deller Set membership identification in digital signal processing , 1989, IEEE ASSP Magazine.

[20]  Gustavo Belforte,et al.  Parameter estimation algorithms for a set-membership description of uncertainty , 1990, Autom..

[21]  J. P. Norton,et al.  Parameter bounding from time-varying systems , 1990 .

[22]  Sylviane Gentil,et al.  Recursive membership estimation for output-error models , 1990 .

[23]  Sandor M. Veres,et al.  Adaptive pole-placement control using parameter bounds , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[24]  M. Milanese,et al.  Optimal Approximation of Feasible Parameter Set in Estimation with Unknown but Bounded Noise , 1991 .

[25]  I. Valyi,et al.  Guaranteed State Estimation for Dynamic Systems: Beyond the Overviews , 1992 .

[26]  J. Norton,et al.  Parameter-Bounding Algorithms for Linear Errors in Variables Models , 1992 .

[27]  Eric Walter,et al.  Minimum-volume ellipsoids containing compact sets : Application to parameter bounding , 1994, Autom..