Analysis of method‐comparison data

Method‐comparison studies, in which new‘candidate’techniques are compared with an established‘gold standard', feature commonly in optometric research. Investigators often analyse their findings using least squares regression. Pearson's product‐moment correlation coefficient and the paired t‐test. We describe more appropriate methods which include: the‘limits of agreement', the intraclass correlation coefficient, and Deming's method for estimating a straight line fit. Comparisons between methods are made with the aid of a computer simulation. Computer program listings are provided to assist in implementing the analyses.

[1]  J. Lovie-Kitchin,et al.  Validity and reliability of visual acuity measurements , 1988, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[2]  N Gochman,et al.  Incorrect least-squares regression coefficients in method-comparison analysis. , 1979, Clinical chemistry.

[3]  S. Hollis.  Analysis of Method Comparison Studies , 1996, Annals of clinical biochemistry.

[4]  M. Pourfarzaneh,et al.  Linear regression analysis by Deming's method. , 1980, Clinical chemistry.

[5]  R. B. Payne.  Calculation of slope by Deming's method from least-squares regression coefficients and imprecision. , 1984, Clinical chemistry.

[6]  I. Wood,et al.  A CLINICAL EVALUATION OF THE NIDEK AUTOREFRACTOR , 1984, Ophthalmic & physiological optics.

[7]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[8]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[9]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[10]  A. Fielder,et al.  Comparison of a new non-contact tonometer with Goldmann applanation , 1989, Eye.

[11]  P. Asbell,et al.  Manual vs. automated keratometry: a comparison. , 1987, The CLAO Journal.

[12]  D. Koh,et al.  Statistical evaluation of agreement between two methods for measuring a quantitative variable. , 1989, Computers in biology and medicine.

[13]  H. Johnson,et al.  A comparison of 'traditional' and multimedia information systems development practices , 2003, Inf. Softw. Technol..

[14]  Joseph L. Fleiss,et al.  A NEW VIEW OF INTER‐OBSERVER AGREEMENT , 1963 .