New robust metrics of central tendency for estimation performance evaluation

Many existing error metrics for estimation performance evaluation can be viewed as measures of central tendency of error (CTE). However, they are not robust because they are sensitive to extreme values or change of “middle” errors. In view of this, we consider estimation performance evaluation with metrics of CTE directly. To design appropriate measures of CTE, two desirable properties named location equivariance and scale equivariance are introduced and some indicators of robustness are presented. A general form called generalized weighted average Euclidean error (GW-AEE) is proposed for designing specific robust error metrics satisfying the two desirable properties. GW-AEE is a general error metric that aggregates several existing error metrics. Iterative mid-range error (IMRE) and several other error metrics based on GW-AEE are proposed for different applications. Compared with the others, IMRE is more efficient and can be applied easily. Robustness analysis of the new error metrics compared with the existing ones is also presented. Robustness and other properties of IMRE are demonstrated by simulation.

[1]  Chee-Yee Chong Problem characterization in tracking/fusion algorithm evaluation , 2000, Proceedings of the Third International Conference on Information Fusion.

[2]  X. R. Li,et al.  Measures of performance for evaluation of estimators and filters , 2001 .

[3]  Frederick Mosteller,et al.  Understanding robust and exploratory data analysis , 1983 .

[4]  David R. Cox,et al.  The Oxford Dictionary of Statistical Terms , 2006 .

[5]  Oliver E. Drummond Methodologies for performance evaluation of multitarget multisensor tracking , 1999, Optics & Photonics.

[6]  Chee-Yee Chong Problem characterization in tracking/fusion algorithm evaluation , 2001 .

[7]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[8]  Herbert A. David,et al.  Order Statistics , 2011, International Encyclopedia of Statistical Science.

[9]  Thia Kirubarajan,et al.  Performance measures for multiple target tracking problems , 2011, 14th International Conference on Information Fusion.

[10]  Matthieu Geist,et al.  Performance evaluation for particle filters , 2011, 14th International Conference on Information Fusion.

[11]  V. Yohai,et al.  Robust Statistics: Theory and Methods , 2006 .

[12]  LI X.RONG,et al.  Evaluation of estimation algorithms part I: incomprehensive measures of performance , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Robert J. Vanderbei,et al.  Linear Programming: Foundations and Extensions , 1998, Kluwer international series in operations research and management service.

[14]  Ondrej Straka,et al.  Performance evaluation of local state estimation methods in bearings-only tracking problems , 2011, 14th International Conference on Information Fusion.

[15]  X.R. Li,et al.  Relative error measures for evaluation of estimation algorithms , 2005, 2005 7th International Conference on Information Fusion.