Analysis of the Sports Medicine Section of the Orthopaedic In-Training Examination: Improvements in Levels of Evidence and Question Taxonomy Over a 12-Year Period.

There has been a recent shift within the orthopedic literature to publish articles with higher levels of evidence. In this investigation, the trends in question taxonomy and the levels of evidence of the references for sports medicine questions on the Orthopaedic In-Training Examination (OITE) during a 12-year period were evaluated. Sports medicine questions were obtained from the OITEs administered between 2005 and 2007 and between 2014 and 2016. The taxonomy of each question was characterized, and levels of evidence for all references were assigned using American Academy of Orthopaedic Surgeons guidelines. Question taxonomy and article levels of evidence from 2005 to 2007 were compared with those from 2014 to 2016. Sports medicine questions comprised 8% of the OITEs in both examination groups. The questions from 2014 to 2016 had a higher mean taxonomic level (2.26 vs 1.52, P=.0001) and a greater proportion of studies with high levels of evidence (levels 1 and 2) (21% vs 10%, P=.027). However, references with low levels of evidence or nonprimary resources made up 82.2% and 68.5% of the total references on the older and more recent examinations, respectively. References from 2014 to 2016 were, on average, 2 years older than those from earlier examinations. This study indicated that sports medicine questions on recent OITEs cite references of higher levels of evidence and contain higher taxonomic question structure than examinations 10 to 12 years ago. However, the majority of questions still cite articles with low levels of evidence or nonprimary sources. These findings can be used to guide resident education and continue improvements in the selection of references for questions on the Sports Medicine section of the OITE. [Orthopedics. 2020;43(x):xx-xx.].

[1]  Gerard J. Cush,et al.  Levels of Evidence for Foot and Ankle Questions on the Orthopaedic In-Training Examination: 15-Year Trends. , 2016, Journal of surgical education.

[2]  A. Pugely,et al.  Validation of a Web-Based Curriculum for Resident Education in Orthopedic Surgery. , 2016, Journal of surgical education.

[3]  J. Graham,et al.  Levels of Evidence for Hand Questions on the Orthopaedic In-Training Examination , 2016, Hand.

[4]  Joshua D. Harris,et al.  Publication and Level of Evidence Trends in The American Journal of Sports Medicine From 1996 to 2011 , 2015, The American journal of sports medicine.

[5]  R. Frank,et al.  An Analysis of References Used for the Orthopaedic In-Training Examination: What are Their Levels of Evidence and Journal Impact Factors? , 2014, Clinical orthopaedics and related research.

[6]  M. Bhandari,et al.  The orthopaedic in-training examination: perspectives of program directors and residents from the United States and Canada. , 2013, Journal of surgical education.

[7]  N. Walter,et al.  Analysis of the basic science section of the orthopaedic in-training examination. , 2012, Orthopedics.

[8]  M. Cross,et al.  An analysis of the hip and knee reconstruction section of the orthopaedic in-training examination. , 2011, Orthopedics.

[9]  M. Cross,et al.  Orthopaedic In-Training Examination , 2011, The American journal of sports medicine.

[10]  P. Schilling,et al.  Do Scores of the USMLE Step 1 and OITE Correlate with the ABOS Part I Certifying Examination?: A Multicenter Study , 2010, Clinical orthopaedics and related research.

[11]  D. Zurakowski,et al.  Predictors of Success on the American Board of Orthopaedic Surgery Examination , 2009, Clinical orthopaedics and related research.

[12]  Derek F. Papp,et al.  Analysis of the Pathology Section of the OITE Will Aid in Trainee Preparation , 2008, Clinical orthopaedics and related research.

[13]  W. Obremskey,et al.  Level of Evidence in Spine Compared to Other Orthopedic Journals , 2007, Spine.

[14]  B. Reider Read Early and Often , 2005 .

[15]  Marc F Swiontkowski,et al.  Introducing levels of evidence to the journal , 2011, The Journal of bone and joint surgery. American volume.

[16]  R. McLeod,et al.  Randomized controlled trials in surgery: Issues and problems. , 1996, Surgery.

[17]  P. Mohl,et al.  The cognitive context of examinations in psychiatry using Bloom's taxonomy , 1991, Medical education.

[18]  J. Buckwalter,et al.  Use of an educational taxonomy for evaluation of cognitive performance. , 1981, Journal of medical education.