Are commonly used premedical school or medical school measures associated with board certification?

PURPOSE To determine if there is an association between several commonly obtained premedical school and medical school measures and board certification performance. We specifically included measures from our institution for which we have predictive validity evidence into the internship year. We hypothesized that board certification would be most likely to be associated with clinical measures of performance during medical school, and with scores on standardized tests, whether before or during medical school. METHODS Achieving board certification in an American Board of Medical Specialties specialty was used as our outcome measure for a 7-year cohort of graduates (1995-2002). Age at matriculation, Medical College Admissions Test (MCAT) score, undergraduate college grade point average (GPA), undergraduate college science GPA, Uniformed Services University (USU) cumulative GPA, USU preclerkship GPA, USU clerkship year GPA, departmental competency committee evaluation, Internal Medicine (IM) clerkship clinical performance rating (points), IM total clerkship points, history of Student Promotion Committee review, and United States Medical Licensing Examination (USMLE) Step 1 score and USMLE Step 2 clinical knowledge score were associated with this outcome. RESULTS Ninety-three of 1,155 graduates were not certified, resulting in an average rate of board certification of 91.9% for the study cohort. Significant small correlations were found between board certification and IM clerkship points (r = 0.117), IM clerkship grade (r = 0.108), clerkship year GPA (r = 0.078), undergraduate college science GPA (r = 0.072), preclerkship GPA and medical school GPA (r = 0.068 for both), USMLE Step 1 (r = 0.066), undergraduate college total GPA (r = 0.062), and age at matriculation (r = -0.061). In comparing the two groups (board certified and not board certified cohorts), significant differences were seen for all included variables with the exception of MCAT and USMLE Step 2 clinical knowledge scores. All the variables put together could explain 4.1% of the variance of board certification by logistic regression. CONCLUSIONS This investigation provides some additional validity evidence that measures collected for purposes of student evaluation before and during medical school are warranted.

[1]  L. Pangaro,et al.  Using Formal Evaluation Sessions for Case‐based Faculty Development during Clinical Clerkships , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[2]  L. Pangaro,et al.  A new vocabulary and other innovations for improving descriptive in-training evaluations. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[3]  J. Sosenko,et al.  NBME examination part I as a predictor of clinical and ABIM certifying examination performances , 1993, Journal of General Internal Medicine.

[4]  S. Sexson,et al.  Relationship between performance on child and adolescent psychiatry in-training and certification examinations. , 2013, Journal of graduate medical education.

[5]  D. Easter,et al.  Predicting performance on the American Board of Surgery qualifying and certifying examinations: a multi-institutional study. , 2010, Archives of surgery.

[6]  L. Pangaro,et al.  Does Group Discussion of Student Clerkship Performance at an Education Committee Affect an Individual Committee Member’s Decisions? , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[7]  S. Deering,et al.  Do U.S. medical licensure examination step 1 scores correlate with council on resident education in obstetrics and gynecology in-training examination scores and American board of obstetrics and gynecology written examination performance? , 2007, Military medicine.

[8]  L. Pangaro,et al.  Internship ratings as a validity outcome measure for an evaluation system to identify inadequate clerkship performance , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[9]  David L Buckeridge,et al.  Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. , 2007, JAMA.

[10]  S. Durning,et al.  The association of students requiring remediation in the internal medicine clerkship with poor performance during internship. , 2015, Military medicine.

[11]  G. Gravlee,et al.  Predicting Success on the Certification Examinations of the American Board of Anesthesiology , 2010, Anesthesiology.

[12]  J. Carline,et al.  Predictive validity of certification by the American Board of Internal Medicine. , 1989, Annals of internal medicine.

[13]  R. Lipner,et al.  Putting the secure examination to the test. , 2010, JAMA.

[14]  Steven J Durning,et al.  Intersite Consistency as a Measurement of Programmatic Evaluation in a Medicine Clerkship with Multiple, Geographically Separated Sites , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[15]  Daniel L. Cohen,et al.  Does Student Promotions Committee Appearance Predict Below-Average Performance During Internship? A Seven-Year Study , 2008, Teaching and learning in medicine.

[16]  J. Hanson,et al.  Narrative descriptions should replace grades and numerical ratings for clinical performance in medical education in the United States , 2013, Front. Psychol..

[17]  T. Meehan,et al.  Association between maintenance of certification examination scores and quality of care for medicare beneficiaries. , 2008, Archives of internal medicine.

[18]  E. Berner,et al.  Use of the USMLE to select residents , 1993, Academic medicine : journal of the Association of American Medical Colleges.