Predicting Quality of Clinical Performance From Cardiology Fellowship Applications.

Variables in cardiology fellowship applications have not been objectively analyzed against applicants' subsequent clinical performance. We investigated possible correlations in a retrospective cohort study of 65 cardiology fellows at the Mayo Clinic (Rochester, Minn) who began 2 years of clinical training from July 2007 through July 2013. Application variables included the strength of comparative statements in recommendation letters and the authors' academic ranks, membership status in the Alpha Omega Alpha Honor Medical Society, awards earned, volunteer activities, United States Medical Licensing Examination (USMLE) scores, advanced degrees, publications, and completion of a residency program ranked in the top 6 in the United States. The outcome was clinical performance as measured by a mean of faculty evaluation scores during clinical training. The overall mean evaluation score was 4.07 ± 0.18 (scale, 1-5). After multivariable analysis, evaluation scores were associated with Alpha Omega Alpha designation (β=0.13; 95% CI, 0.01-0.25; P=0.03), residency program reputation (β=0.13; 95% CI, 0.05-0.21; P=0.004), and strength of comparative statements in recommendation letters (β=0.08; 95% CI, 0.01-0.15; P=0.02), particularly in letters from residency program directors (β=0.05; 95% CI, 0.01-0.08; P=0.009). Objective factors to consider in the cardiology fellowship application include Alpha Omega Alpha membership, residency program reputation, and comparative statements from residency program directors.

[1]  S. Aggarwal,et al.  Mind the Gap: Representation of Medical Education in Cardiology-Related Articles and Journals. , 2016, Journal of graduate medical education.

[2]  John Burkhardt,et al.  Impact of Doximity Residency Rankings on Emergency Medicine Applicant Rank Lists , 2016, The western journal of emergency medicine.

[3]  T. Beckman,et al.  Associations between resident physicians’ publications and clinical performance during residency training , 2016, BMC Medical Education.

[4]  Adam B. Wilson,et al.  Ranking Surgical Residency Programs: Reputation Survey or Outcomes Measures? , 2015, Journal of surgical education.

[5]  S. Santen,et al.  Effect of Doximity Residency Rankings on Residency Applicants’ Program Choices , 2015, The western journal of emergency medicine.

[6]  S. Sinha,et al.  COCATS 4: Securing the Future of Cardiovascular Medicine. , 2015, Journal of the American College of Cardiology.

[7]  J. Halperin,et al.  COCATS 4 Introduction. , 2015, Journal of the American College of Cardiology.

[8]  D. Polk,et al.  The cardiovascular in-training examination: development, implementation, results, and future directions. , 2015, Journal of the American College of Cardiology.

[9]  J. Jackson,et al.  The Relationship Between Internal Medicine Residency Graduate Performance on the ABIM Certifying Examination, Yearly In-Service Training Examinations, and the USMLE Step 1 Examination , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[10]  M. Shabahang,et al.  The predictive value of application variables on the global rating of applicants to a general surgery residency program. , 2015, Journal of Surgical Education.

[11]  Jun Liu,et al.  Correlation between trainee candidate selection criteria and subsequent performance. , 2014, Journal of the American College of Surgeons.

[12]  T. Emerick,et al.  The Cost of Resident Scholarly Activity and Its Effect on Resident Clinical Experience , 2013, Anesthesia and analgesia.

[13]  S. Brandes,et al.  Predictors of success in a urology residency program. , 2013, Journal of surgical education.

[14]  T. Shanafelt,et al.  Resident Physician Well-Being and Assessments of Their Knowledge and Clinical Performance , 2012, Journal of General Internal Medicine.

[15]  T. Beckman,et al.  Selection criteria for internal medicine residency applicants and professionalism ratings during internship. , 2011, Mayo Clinic proceedings.

[16]  P. Carroll,et al.  Urology resident publication output and its relationship to future academic achievement. , 2011, The Journal of urology.

[17]  T. Hartranft,et al.  Using United States Medical Licensing Examination(®) (USMLE) examination results to predict later in-training examination performance among general surgery residents. , 2010, Journal of surgical education.

[18]  A. Detsky,et al.  Publishing history does not correlate with clinical performance among internal medicine residents , 2010, Medical education.

[19]  S. Silvestri,et al.  Do United States Medical Licensing Examination (USMLE) scores predict in-training test performance for emergency medicine residents? , 2010, The Journal of emergency medicine.

[20]  Thomas J Beckman,et al.  Determining Reliability of Clinical Assessment Scores in Real Time , 2009, Teaching and learning in medicine.

[21]  T. Beckman,et al.  Behaviors of highly professional resident physicians. , 2008, JAMA.

[22]  Daniel L. Cohen,et al.  Identifying Medical Students Likely to Exhibit Poor Professionalism and Knowledge During Internship , 2007, Journal of General Internal Medicine.

[23]  D. Cook,et al.  Current concepts in validity and reliability for psychometric instruments: theory and application. , 2006, The American journal of medicine.

[24]  Hossam Hamdy,et al.  BEME systematic review: Predictive values of measurements obtained in medical schools and future performance in medical practice , 2006, Medical teacher.

[25]  A. Teherani,et al.  Disciplinary action by medical boards and prior behavior in medical school. , 2005, The New England journal of medicine.

[26]  Ellen R. Julian,et al.  Validity of the Medical College Admission Test for Predicting Medical School Performance , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[27]  D. Jeffe,et al.  What predicts surgical internship performance? , 2004, American journal of surgery.

[28]  S. Durning,et al.  Assessing the Reliability and Validity of the Mini—Clinical Evaluation Exercise for Internal Medicine Residency Training , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[29]  S. Sireci,et al.  Validity of MCAT scores for predicting clerkship performance of medical students grouped by sex and ethnicity. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[30]  C. Hodgson,et al.  Evaluating GPAs and MCAT scores as predictors of NBME I and clerkship performances based on students' data from one undergraduate institution , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[31]  Markert Rj The relationship of academic measures in medical school to performance after graduation. , 1993 .