Do Admissions Multiple Mini-Interview and Traditional Interview Scores Predict Subsequent Academic Performance? A Study of Five California Medical Schools

Purpose To compare the predictive validities of medical school admissions multiple mini-interviews (MMIs) and traditional interviews (TIs). Method This longitudinal observational study of 2011–2013 matriculants to five California public medical schools examined the associations of MMI scores (two schools) and TI scores (three schools) with subsequent academic performance. Regression models adjusted for sociodemographics and undergraduate academic metrics examined associations of standardized mean MMI and TI scores with United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge (CK) scores and, for required clerkships, with mean National Board of Medical Examiners Clinical Science subject (shelf) exam score and number of honors grades. Results Of the 1,460 medical students, 746 (51.1%) interviewed at more than one study school; 579 (39.7%) completed at least one MMI and at least one TI. Neither interview type was associated with Step 1 scores. Higher MMI scores were associated with more clerkship honors grades (adjusted incidence rate ratio [AIRR] 1.28 more [95% CI 1.18, 1.39; P < .01] per SD increase) and higher shelf exam and Step 2 CK scores (adjusted mean 0.73 points higher [95% CI 0.28, 1.18; P < .01] and 1.25 points higher [95% CI 0.09, 2.41; P = .035], respectively, per SD increase). Higher TI scores were associated only with more honors grades (AIRR 1.11 more [95% CI 1.01, 1.20; P = .03] per SD increase). Conclusions MMI scores were more strongly associated with subsequent academic performance measures than were TI scores.

[1]  A. Jerant,et al.  Medical School Performance of Socioeconomically Disadvantaged and Underrepresented Minority Students Matriculating after a Multiple Mini-Interview , 2018, Journal of health care for the poor and underserved.

[2]  A. Jerant,et al.  Reliability of Multiple Mini-Interviews and traditional interviews within and between institutions: a study of five California medical schools , 2017, BMC medical education.

[3]  A. Jerant,et al.  Medical School Applicant Characteristics Associated With Performance in Multiple Mini-Interviews Versus Traditional Interviews: A Multi-Institutional Study , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[4]  Kirsty N. Prior,et al.  Predicting success in medical school: a longitudinal study of common Australian student selection tools , 2016, BMC medical education.

[5]  J. Bates,et al.  Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME Guide No. 37 , 2016, Medical teacher.

[6]  C. Roberts,et al.  The predictive validity of a situational judgement test and multiple-mini interview for entry into postgraduate training in Australia , 2016, BMC Medical Education.

[7]  J. Dowell,et al.  Predictive validity of the Dundee multiple mini‐interview , 2013, Medical education.

[8]  Dana M. Dunleavy,et al.  The Predictive Validity of the MCAT Exam in Relation to Academic Performance Through Medical School: A National Cohort Study of 2001–2004 Matriculants , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[9]  Dana M. Dunleavy,et al.  An Overview of the Medical School Admission Process and Use of Applicant Data in Decision Making: What Has Changed Since the 1980s? , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Timothy J. Wood,et al.  Association between a medical school admission process using the multiple mini-interview and national licensing examination scores. , 2012, JAMA.

[11]  A. Jerant,et al.  Does Applicant Personality Influence Multiple Mini-Interview Performance and Medical School Acceptance Offers? , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[12]  J. McLachlan,et al.  Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the UKCAT in the 2009 cohort , 2012, BMJ : British Medical Journal.

[13]  D. Jeffe,et al.  Prematriculation variables associated with suboptimal outcomes for the 1994-1999 cohort of US medical school matriculants. , 2010, JAMA.

[14]  F. Lievens,et al.  Personality scale validities increase throughout medical school. , 2009, The Journal of applied psychology.

[15]  Jeffrey P Gold,et al.  Impact of preadmission variables on USMLE step 1 and step 2 performance , 2009, Advances in health sciences education : theory and practice.

[16]  J. Chibnall,et al.  Do Clinical Evaluations in a Psychiatry Clerkship Favor Students With Positive Personality Characteristics? , 2008, Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry.

[17]  D. Jeffe,et al.  "Making the grade:" noncognitive predictors of medical students' clinical clerkship grades. , 2007, Journal of the National Medical Association.

[18]  G. Norman,et al.  Multiple mini‐interviews predict clerkship and licensing examination performance , 2007, Medical education.

[19]  J. Goho,et al.  The effectiveness of academic admission interviews: an exploratory meta-analysis , 2006, Medical teacher.

[20]  G. Norman,et al.  The Ability of the Multiple Mini-Interview to Predict Preclerkship Performance in Medical School , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[21]  K. Eva,et al.  An admissions OSCE: the multiple mini‐interview , 2004, Medical education.

[22]  Robyn Tamblyn,et al.  Association between licensure examination scores and practice in primary care. , 2002, JAMA.

[23]  D. Streiner,et al.  Characteristics of first-year students in Canadian medical schools. , 2002, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[24]  J Norcini,et al.  Association between licensing examination scores and resource use and quality of care in primary care practice. , 1998, JAMA.

[25]  C. Clogg,et al.  Statistical Methods for Comparing Regression Coefficients Between Models , 1995, American Journal of Sociology.

[26]  D. Witzke,et al.  Performances of underrepresented‐minority students at the University of Arizona College of Medicine, 1987‐1991 , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[27]  StataCorp Stata User's Guide: Release 15. , 2017 .

[28]  Amy V. Blue,et al.  The Effect of Gender and Age on Medical School Performance: An Important Interaction , 2000, Advances in health sciences education : theory and practice.