Uncertainty estimation with a small number of measurements, part II: a redefinition of uncertainty and an estimator method

This paper is the second (Part II) in a series of two papers (Part I and Part II). Part I has quantitatively discussed the fundamental limitations of the t-interval method for uncertainty estimation with a small number of measurements. This paper (Part II) reveals that the t-interval is an 'exact' answer to a wrong question; it is actually misused in uncertainty estimation. This paper proposes a redefinition of uncertainty, based on the classical theory of errors and the theory of point estimation, and a modification of the conventional approach to estimating measurement uncertainty. It also presents an asymptotic procedure for estimating the z-interval. The proposed modification is to replace the t-based uncertainty with an uncertainty estimator (mean- or median-unbiased). The uncertainty estimator method is an approximate answer to the right question to uncertainty estimation. The modified approach provides realistic estimates of uncertainty, regardless of whether the population standard deviation is known or unknown, or if the sample size is small or large. As an application example of the modified approach, this paper presents a resolution to the Du–Yang paradox (i.e. Paradox 2), one of the three paradoxes caused by the misuse of the t-interval in uncertainty estimation.

[1]  Walter Bich,et al.  Towards a new GUM—an update , 2016 .

[2]  Maurice G. Cox,et al.  Error analysis in the evaluation of measurement uncertainty , 2003 .

[3]  M Ballico,et al.  Limitations of the Welch-Satterthwaite approximation for measurement uncertainty calculations , 2000 .

[4]  Ignacio Lira,et al.  Comparison between the conventional and Bayesian approaches to evaluate measurement data , 2006 .

[5]  Jeffrey N. Rouder,et al.  The fallacy of placing confidence in confidence intervals , 2015, Psychonomic bulletin & review.

[6]  I Lira,et al.  The GUM revision: the Bayesian view toward the expression of measurement uncertainty , 2016 .

[7]  Allan W. Smith,et al.  Improved broadband blackbody calibrations at NIST for low-background infrared applications , 2003 .

[8]  J. Tukey The Future of Data Analysis , 1962 .

[9]  Hening Huang Uncertainty-based measurement quality control , 2014, Accreditation and Quality Assurance.

[10]  R. Willink On the validity of methods of uncertainty evaluation , 2010 .

[11]  Filippo Attivissimo,et al.  A Bayesian paradox and its impact on the GUM approach to uncertainty , 2012 .

[12]  R. Willink What can we learn from the GUM of 1995 , 2016 .

[13]  Probability, belief and success rate: comments on 'On the meaning of coverage probabilities' , 2010 .

[14]  C S Veldman A novel implementation of an ISO standard method for primary vibration calibration by laser interferometry , 2003 .

[15]  J. Neyman Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability , 1937 .

[16]  Hening Huang Optimal estimator for uncertainty-based measurement quality control , 2015, Accreditation and Quality Assurance.