Validity of linear regression in method comparison studies: is it limited by the statistical model or the quality of the analytical input data?

We compared the application of ordinary linear regression, Deming regression, standardized principal component analysis, and Passing-Bablok regression to real-life method comparison studies to investigate whether the statistical model of regression or the analytical input data have more influence on the validity of the regression estimates. We took measurements of serum potassium as an example for comparisons that cover a narrow data range and measurements of serum estradiol-17beta as an example for comparisons that cover a wide data range. We demonstrate that, in practice, it is not the statistical model but the quality of the analytical input data that is crucial for interpretation of method comparison studies. We show the usefulness of ordinary linear regression, in particular, because it gives a better estimate of the standard deviation of the residuals than the other procedures. The latter is important for distinguishing whether the observed spread across the regression line is caused by the analytical imprecision alone or whether sample-related effects also contribute. We further demonstrate the usefulness of linear correlation analysis as a first screening test for the validity of linear regression data. When ordinary linear regression (in combination with correlation analysis) gives poor estimates, we recommend investigating the analytical reason for the poor performance instead of assuming that other linear regression procedures add substantial value to the interpretation of the study. This investigation should address whether (a) the x and y data are linearly related; (b) the total analytical imprecision (s(a,tot)) is responsible for the poor correlation; (c) sample-related effects are present (standard deviation of the residuals >> s(a,tot)); (d) the samples are adequately distributed over the investigated range; and (e) the number of samples used for the comparison is adequate.

[1]  W Bablok,et al.  Comparison of Several Regression Procedures for Method Comparison Studies and Determination of Sample Sizes Application of linear regression procedures for method comparison studies in Clinical Chemistry, Part II , 1984, Journal of clinical chemistry and clinical biochemistry. Zeitschrift fur klinische Chemie und klinische Biochemie.

[2]  R. B. Payne,et al.  Method Comparison: Evaluation of Least Squares, Deming and Passing/Bablok Regression Procedures Using Computer Simulation , 1997, Annals of clinical biochemistry.

[3]  L. Guttman,et al.  Statistical Adjustment of Data , 1944 .

[4]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[5]  N Gochman,et al.  Incorrect least-squares regression coefficients in method-comparison analysis. , 1979, Clinical chemistry.

[6]  J O Westgard,et al.  Use and interpretation of common statistical tests in method-comparison studies. , 1973, Clinical chemistry.

[7]  R. Bender,et al.  A General Regression Procedure for Method Transformation. Application of Linear Regression Procedures for Method Comparison Studies in Clinical Chemistry, Part III , 1988, Journal of clinical chemistry and clinical biochemistry. Zeitschrift fur klinische Chemie und klinische Biochemie.

[8]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[9]  S. Hollis.  Analysis of Method Comparison Studies , 1996, Annals of clinical biochemistry.

[10]  K. Linnet,et al.  Evaluation of regression procedures for methods comparison studies. , 1993, Clinical chemistry.

[11]  D Stöckl,et al.  Beyond the Myths of Difference Plots , 1996, Annals of clinical biochemistry.

[12]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[13]  K. Linnet,et al.  Performance of Deming regression analysis in case of misspecified analytical error ratio in method comparison studies. , 1998, Clinical chemistry.

[14]  P H Petersen,et al.  Graphical interpretation of analytical data from comparison of a field method with reference method by use of difference plots. , 1997, Clinical chemistry.

[15]  E. A. Sylvestre,et al.  Statistical Comparison of Multiple Analytic Procedures: Application to Clinical Chemistry , 1979 .

[16]  H. Hellendoorn,et al.  Applications of statistics in clinical chemistry. A critical evaluation of regression lines. , 1975, Clinica chimica acta; international journal of clinical chemistry.

[17]  L. Thienpont,et al.  Efforts by Industry Toward Standardization of Serum Estradiol-17β Measurements , 1998 .

[18]  W. Bablok,et al.  A New Biometrical Procedure for Testing the Equality of Measurements from Two Different Analytical Methods. Application of linear regression procedures for method comparison studies in Clinical Chemistry, Part I , 1983, Journal of clinical chemistry and clinical biochemistry. Zeitschrift fur klinische Chemie und klinische Biochemie.

[19]  L M Thienpont,et al.  Intrinsic and routine quality of serum total potassium measurement as investigated by split-sample measurement with an ion chromatography candidate reference method. , 1998, Clinical chemistry.