Exact Parametric Confidence Intervals for Bland-Altman Limits of Agreement

Purpose The previous literature on Bland-Altman analysis only describes approximate methods for calculating confidence intervals for 95% limits of agreement (LoAs). This article describes exact methods for calculating such confidence intervals based on the assumption that differences in measurement pairs are normally distributed. Methods Two basic situations are considered for calculating LoA confidence intervals: the first, where LoAs are considered individually (i.e., using one-sided tolerance factors for a normal distribution); and the second, where LoAs are considered as a pair (i.e., using two-sided tolerance factors for a normal distribution). Equations underlying the calculation of exact confidence limits are briefly outlined. Results To assist in determining confidence intervals for LoAs (considered individually and as a pair), tables of coefficients have been included for degrees of freedom between 1 and 1000. Numerical examples, showing the use of the tables for calculating confidence limits for Bland-Altman LoAs, have been provided. Conclusions Exact confidence intervals for LoAs can differ considerably from the Bland and Altman approximate method, especially for sample sizes that are not large. There are better, more precise methods for calculating confidence intervals for LoAs than the Bland and Altman approximate method, although even an approximate calculation of confidence intervals for LoAs is likely to be better than none at all. Reporting confidence limits for LoAs considered as a pair is appropriate for most situations; however, there may be circumstances where it is appropriate to report confidence limits for LoAs considered individually.

[1]  Colm McAlinden,et al.  Statistical methods for conducting agreement (comparison of clinical tests) and precision (repeatability or reproducibility) studies in optometry and ophthalmology , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[2]  Robert W. Mee,et al.  Computing factors for exact two-sided tolerance limits for a normal distribution , 1989 .

[3]  G Y Zou,et al.  Confidence interval estimation for the Bland–Altman limits of agreement with multiple observations per individual , 2013, Statistical methods in medical research.

[4]  Allan Donner,et al.  Closed-form confidence intervals for functions of the normal mean and standard deviation , 2012, Statistical methods in medical research.

[5]  Ayumi Kimura,et al.  An Evaluation of the M&S Technologies Smart System II for Visual Acuity Measurement in Young Visually-Normal Adults , 2007, Optometry and vision science : official publication of the American Academy of Optometry.

[6]  Paul J Murphy,et al.  A New Portable Digital Meniscometer , 2014, Optometry and vision science : official publication of the American Academy of Optometry.

[7]  A. W. Swan Handbook of Statistical Tables , 1964 .

[8]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[9]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[10]  Robert E. Odeh,et al.  Tables of two-sided tolerance factors for a normal distribution , 1978 .

[11]  Andrew J Anderson,et al.  Test-Retest Reliability of Retinal Oxygen Saturation Measurement , 2014, Optometry and vision science : official publication of the American Academy of Optometry.

[12]  H. Levene Robust tests for equality of variances , 1961 .

[13]  Bernard Gilmartin,et al.  Statistical guidelines for clinical studies of human vision , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[14]  Erik Olofsen,et al.  Improvements in the application and reporting of advanced Bland–Altman methods of comparison , 2015, Journal of Clinical Monitoring and Computing.

[15]  Joseph Foss,et al.  Comparing Methods of Clinical Measurement: Reporting Standards for Bland and Altman Analysis , 2000, Anesthesia and analgesia.

[16]  James Stamey,et al.  Using Bland−Altman to Assess Agreement between Two Medical Devices – Don’t Forget the Confidence Intervals! , 2007, Journal of Clinical Monitoring and Computing.

[17]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[18]  K. Pesudovs,et al.  Agreement studies: clarification , 2012 .

[19]  John Ludbrook,et al.  Confidence in Altman–Bland plots: A critical review of the method of differences , 2010, Clinical and experimental pharmacology & physiology.

[20]  D G Altman,et al.  Estimating with confidence , 1988, British medical journal.

[21]  J. Wolfowitz,et al.  Tolerance Limits for a Normal Distribution , 1946 .

[22]  Donald B. Owen,et al.  Tables for normal tolerance limits, sampling plans, and screening , 1981 .

[23]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[24]  S. Saw,et al.  Repeatability of IOLMaster Biometry in Children , 2004, Optometry and vision science : official publication of the American Academy of Optometry.