Data analysis in medical education research: a multilevel perspective

A substantial part of medical education research focuses on learning in teams (e.g., departments, problem-based learning groups) or centres (e.g., clinics, institutions) that are followed over time. Individual students or employees sharing the same team or centre tend to be more similar in learning than students or employees from different teams or centres. In other words, when students or employees are nested within teams or centres, there is a within-team or within-centre correlation that should be taken into account in the analysis of data obtained from individuals in these teams or centres. Further, when individuals are measured several times on the same performance (or other) variable, these repeated measurements tend to be correlated, that is: we are dealing with an intra-individual correlation that should be taken into account when analyzing data obtained from these individuals. In such a study context, many researchers resort to methods that cannot account for intra-team and/or intra-individual correlation and this may result in incorrect conclusions with regard to effects and relations of interest. This comparison paper presents the benefits which result from adopting a proper multilevel perspective on the conceptualization and estimation of effects and relations of interest.

[1]  Matthew Sibbald,et al.  Feasibility of self-reflection as a tool to balance clinical reasoning strategies , 2012, Advances in health sciences education : theory and practice.

[2]  Frans E. S. Tan,et al.  Best Practices in Analysis of Longitudinal Data: A Multilevel Approach , 2008 .

[3]  J. Kyle Roberts,et al.  Handbook of advanced multilevel analysis , 2011 .

[4]  Jimmie Leppink,et al.  Prior knowledge moderates instructional effects on conceptual understanding of statistics , 2012 .

[5]  J. Hox Multilevel analysis: Techniques and applications, 2nd ed. , 2010 .

[6]  G. A. Marcoulides Multilevel Analysis Techniques and Applications , 2002 .

[7]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[8]  D. C. Howell Statistical Methods for Psychology , 1987 .

[9]  T. Gog,et al.  Improving critical thinking: Effects of dispositions and instructions on economics students' reasoning skills , 2014 .

[10]  J. Osborne Best Practices in Quantitative Methods , 2009 .

[11]  Diana Adler,et al.  Using Multivariate Statistics , 2016 .

[12]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[13]  Ana Ivelisse Avilés,et al.  Linear Mixed Models for Longitudinal Data , 2001, Technometrics.

[14]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[15]  Diana H J M Dolmans,et al.  The Maastricht Clinical Teaching Questionnaire (MCTQ) as a Valid and Reliable Instrument for the Evaluation of Clinical Teachers , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[16]  Barbara M. Byrne,et al.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[17]  Spss,et al.  Discovering Statistics (4th Edition ed. , 2013 .

[18]  T. Gog,et al.  Timing and Frequency of Mental Effort Measurement: Evidence in Favour of Repeated Measures , 2012 .

[19]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[20]  C. Witt,et al.  Development of knowledge in basic sciences: a comparison of two medical curricula , 2012, Medical education.