Profiling students for remediation using latent class analysis

While clinical exams using SPs are used extensively across the medical schools for summative purposes and high-stakes decisions, the method of identifying students for remediation varies widely and there is a lack of consensus on the best methodological approach. The purpose of this study is to provide an alternative approach to identification of students for remediation using the latent class analysis (LCA) technique. 147 third year medical students participating in the Clinical Performance Examination (CPX) are included in the study. We used LCA to identify students who potentially need remediation based on their performance on CPX. Three distinct clusters of students with different performance profiles were identified. The identification of two rather than one low performing group has significant implications for identifying cut-points as well as for remediation programs. The two low performing groups in our study had low scores on contrasting sets of cases. LCA presents an alternative approach to identification of borderline or low performing groups. This method provides advantages over traditional statistical techniques such as cluster analysis used for grouping students. Based on the flexibility of the model specification, within the LCA framework, we were able to identify more than one group that may need remediation or instruction support.

[1]  D. Irby,et al.  Student Performance Problems in Medical School Clinical Skills Assessments , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[2]  J. Vermunt,et al.  Latent class cluster analysis , 2002 .

[3]  John R Boulet,et al.  Setting defensible performance standards on OSCEs and standardized patient examinations , 2003, Medical teacher.

[4]  P. O'Sullivan,et al.  Approaches to medical student remediation after a comprehensive clinical skills examination , 2007, Medical education.

[5]  T. Roberts,et al.  Standard Setting for Clinical Competence at Graduation from Medical School: A Comparison of Passing Scores Across Five Medical Schools , 2006, Advances in health sciences education : theory and practice.

[6]  L. Grotzinger Comprehensive Handbook of Personality and Psychopathology. Michel Hersen and Jay C. Thomas, eds. , 2008 .

[7]  E. Baker,et al.  Early Identification of Reading Difficulties Using Heterogeneous Developmental Trajectories , 2008 .

[8]  L. Shulman,et al.  Medical problem-solving. , 2014, Journal of medical education.

[9]  David B. Swanson,et al.  Assessment of clinical skills with standardized patients: State of the art , 1990 .

[10]  S. Zeger,et al.  Latent Class Model Diagnosis , 2000, Biometrics.

[11]  G. Norman,et al.  How specific is case specificity? , 2006, Medical education.

[12]  J. Hagenaars,et al.  Applied Latent Class Analysis , 2003 .

[13]  Graceanne Adamo,et al.  Simulated and standardized patients in OSCEs: achievements and challenges 1992-2003 , 2003, Medical teacher.

[14]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[15]  R. Kessler,et al.  The identification and validation of distinct depressive syndromes in a population-based sample of female twins. , 1996, Archives of general psychiatry.