ASSESSING THE LEARNING CURVE EFFECT IN HEALTH TECHNOLOGIES

INTRODUCTION Many health technologies exhibit some from of learning effect, and this represents a barrier to rigorous assessment. It has been shown that the statistical methods used are relatively crude. Methods to describe learning curves in fields outside medicine, for example, psychology and engineering, may be better. METHODS To systematically search non-health technology assessment literature (for example, PsycLit and Econlit databases) to identify novel statistical techniques applied to learning curves. RESULTS The search retrieved 9,431 abstracts for assessment, of which 18 used a statistical technique for analyzing learning effects that had not previously been identified in the clinical literature. The newly identified methods were combined with those previously used in health technology assessment, and categorized into four groups of increasing complexity: a) exploratory data analysis; b) simple data analysis; c) complex data analysis; and d) generic methods. All the complex structured data techniques for analyzing learning effects were identified in the nonclinical literature, and these emphasized the importance of estimating intra- and interindividual learning effects. CONCLUSION A good dividend of more sophisticated methods was obtained by searching in nonclinical fields. These methods now require formal testing on health technology data sets.

[1]  Michael W. Browne,et al.  Best methods for the analysis of change: Recent advances, unanswered questions, future directions. , 1991 .

[2]  Nigel Rice,et al.  Multilevel Models: Applications to Health Data , 1996, Journal of health services research & policy.

[3]  G. Logan Shapes of reaction-time distributions and shapes of learning curves: a test of the instance theory of automaticity. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Linda M. Collins,et al.  Best Methods for the Analysis of Change: Recent Advances, Unanswered Questions, Future Directions , 1991 .

[5]  W. Spears Measurement of Learning and Transfer through Curve Fitting , 1985 .

[6]  T. P. Wright,et al.  Factors affecting the cost of airplanes , 1936 .

[7]  C. Kastner,et al.  The Generalised Estimating Equations: An Annotated Bibliography , 1998 .

[8]  A F Monk,et al.  ASSESSMENT OF THE LEARNING CURVE IN HEALTH TECHNOLOGIES , 2000, International Journal of Technology Assessment in Health Care.

[9]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[10]  I. Russell Evaluating new surgical procedures , 1995, BMJ.

[11]  D G Altman,et al.  The hidden effect of time. , 1988, Statistics in medicine.

[12]  J. Cairns,et al.  When is the right time to initiate an assessment of a health technology? , 1997, International Journal of Technology Assessment in Health Care.

[13]  James R. Buck,et al.  INSTRUCTIONS AND FEEDBACK EFFECTS ON SPEED AND ACCURACY WITH DIFFERENT LEARNING CURVE MODELS , 1993 .

[14]  D. Francis,et al.  A cross-level units-of-analysis approach to individual differences in skill acquisition. , 1993, The Journal of applied psychology.

[15]  A. Cuschieri Whither minimal access surgery: tribulations and expectations. , 1995, American journal of surgery.

[16]  P. Burton,et al.  Extending the simple linear regression model to account for correlated responses: an introduction to generalized estimating equations and multi-level mixed modelling. , 1998, Statistics in medicine.

[17]  Louis E. Yelle Estimating learning curves for potential products , 1976 .

[18]  Sher ry Folsom-Meek,et al.  Human Performance , 2020, Nature.

[19]  H Goldstein,et al.  Multilevel time series models with applications to repeated measures data. , 1994, Statistics in medicine.

[20]  J. Barkun,et al.  Technology assessment in laparoscopic general surgery and gastrointestinal endoscopy: science or convenience? , 1996, Gastroenterology.