A primer on the statistical modelling of learning curves in health professions education

Learning curves are a useful way of representing the rate of learning over time. Features include an index of baseline performance (y-intercept), the efficiency of learning over time (slope parameter) and the maximal theoretical performance achievable (upper asymptote). Each of these parameters can be statistically modelled on an individual and group basis with the resulting estimates being useful to both learners and educators for feedback and educational quality improvement. In this primer, we review various descriptive and modelling techniques appropriate to learning curves including smoothing, regression modelling and application of the Thurstone model. Using an example dataset we demonstrate each technique as it specifically applies to learning curves and point out limitations.

[1]  R. Leach The learning curve , 1992 .

[2]  A. Epstein,et al.  Pay for performance at the tipping point. , 2007, The New England journal of medicine.

[3]  Flávio Sanson Fogliatto,et al.  Learning Curves: The State of the Art and Research Directions , 2011 .

[4]  R. Hatala,et al.  Learning Curves in Health Professions Education , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[5]  K. A. Ericsson,et al.  Deliberate practice and acquisition of expert performance: a general overview. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[6]  L. L. Thurstone,et al.  The learning curve equation , 1919 .

[7]  A. Dubrowski,et al.  Performance vs. learning curves: what is motor learning and how is it measured? , 2005, Surgical Endoscopy And Other Interventional Techniques.

[8]  J. Singer,et al.  Applied Longitudinal Data Analysis , 2003 .

[9]  Mohamad Y. Jaber,et al.  Learning and forgetting models and their applications , 2013 .

[10]  S Bolsin,et al.  The use of the Cusum technique in the assessment of trainee competence in new procedures. , 2000, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[11]  T. B. Robertson A Biochemical Conception of the Phenomena of Memory and Sensation. , 1909 .

[12]  M. Pusic,et al.  Using signal detection theory to model changes in serial learning of radiological image interpretation , 2010, Advances in health sciences education : theory and practice.

[13]  M. Pusic,et al.  Defining and Assessing Competence , 2014 .

[14]  Mohamad Y. Jaber,et al.  A numerical comparison of three potential learning and forgetting models , 2004 .

[15]  T. Ahlering,et al.  Robot-assisted versus open radical prostatectomy: a comparison of one surgeon's outcomes. , 2004, Urology.

[16]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[17]  G. Jung,et al.  Review of 100 cases of single port laparoscopic cholecystectomy , 2012, Journal of the Korean Surgical Society.

[18]  F. E. Ritter,et al.  Learning Curve, The , 2001 .

[19]  Mohamad Y. Jaber,et al.  Production , Manufacturing and Logistics Learning curves for processes generating defects requiring reworks , 2004 .

[20]  Patrick J Curran,et al.  Twelve Frequently Asked Questions About Growth Curve Modeling , 2010, Journal of cognition and development : official journal of the Cognitive Development Society.

[21]  M. Priestley,et al.  Non‐Parametric Function Fitting , 1972 .

[22]  Steven M Downing,et al.  Item response theory: applications of modern test theory in medical education , 2003, Medical education.

[23]  D. Irby,et al.  Assessment in medical education. , 2007, The New England journal of medicine.

[24]  M. Pusic,et al.  Experience curves as an organizing framework for deliberate practice in emergency medicine learning. , 2012, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[25]  M. Detry,et al.  Analyzing Repeated Measurements Using Mixed Models. , 2016, JAMA.

[26]  A F Monk,et al.  ASSESSMENT OF THE LEARNING CURVE IN HEALTH TECHNOLOGIES , 2000, International Journal of Technology Assessment in Health Care.