A Pilot Study Assessment of Medical Student Knowledge and System Citizenship Attitudes Pertaining to Health Systems Science

Background and Purpose Health system science (HSS) has been described as the third pillar of medical education. We introduced a new health system science and interprofessional practice (HSSIP) curriculum, and measured students’ HSS knowledge and attitudes concerning health system citizenship. Methods This pilot study involved first-year (M1) and fourth-year (M4) medical students in two cohorts across 2 years. Only M1 students in the second cohort participated in the new HSSIP curriculum. We compared student performance on a new National Board of Medical Examiners (NBME) HSS subject exam, and student attitudes toward system citizenship via a new attitudinal survey. Results Fifty-six eligible fourth-year students (68%) and 70 (76%) study eligible first-year students participated in the study. NBME HSS exam performance by M4 students was statistically significantly higher than M1 students for both cohorts, with moderate to large effect sizes. Exam performance for M1 students not experiencing the HSS curriculum was higher than for M1 students who received HSS curricular content. Attitudes toward HSS by M4 versus M1 students were statistically significantly different on several survey items with moderate effect sizes. Scale internal consistency for the HSS attitude survey was strong (0.83 or higher). Discussion There were differences among M4 and M1 medical students concerning knowledge of and attitudes toward HSS, with performance on the NBME subject exam similar to a national sample. Exam performance by M1 students was likely impacted by class size and other factors. Our results support the need for increased attention to HSS during medical education. Our health system citizenship survey has potential for further development and cross-institutional collaboration.

[1]  A. Kumbamu,et al.  “Finding My Piece in That Puzzle”: A Qualitative Study Exploring How Medical Students at Four U.S. Schools Envision Their Future Professional Identity in Relation to Health Systems , 2022, Academic medicine : journal of the Association of American Medical Colleges.

[2]  V. Dzau,et al.  Revisiting academic health sciences systems a decade later: discovery to health to population to society , 2021, The Lancet.

[3]  D. Schlundt,et al.  Defining Successful Practice Within Health Systems Science Among Entering Residents: A Single-Institution Qualitative Study of Graduate Medical Education Faculty Observations , 2021, Academic medicine : journal of the Association of American Medical Colleges.

[4]  S. Starr,et al.  Health systems science education: The new post-Flexner professionalism for the 21st century , 2021, Medical teacher.

[5]  H. Krouse,et al.  The power of interdependence: Linking health systems, communities, and health professions educational programs to better meet the needs of patients and populations , 2021, Medical teacher.

[6]  S. Santen,et al.  The Accelerating Change in Medical Education Consortium: Key Drivers of Transformative Change , 2020, Academic medicine : journal of the Association of American Medical Colleges.

[7]  L. Learman,et al.  Building Health Systems Science Education from the Core Domain of Interprofessional Education at Virginia Tech Carilion School of Medicine , 2020, Medical science educator.

[8]  L. Learman,et al.  Building Health Systems Science Education from the Core Domain of Interprofessional Education at Virginia Tech Carilion School of Medicine , 2020, Medical Science Educator.

[9]  S. Ramani,et al.  Healthcare systems and the sciences of health professional education , 2020, Advances in Health Sciences Education.

[10]  Daniel R Wolpaw,et al.  Health Systems Science in Medical Education: Unifying the Components to Catalyze Transformation , 2020, Academic medicine : journal of the Association of American Medical Colleges.

[11]  Sonali Saluja,et al.  The impact of a new curriculum on medical students' interest in and knowledge of health systems science. , 2020, Healthcare.

[12]  M. Pusic,et al.  Validity of the Health Systems Science Examination: Relationship Between Examinee Performance and Time of Training , 2020, American journal of medical quality : the official journal of the American College of Medical Quality.

[13]  Mary A. Dolansky,et al.  Faculty Knowledge, Awareness, Value, and Self-Efficacy in Teaching Systems Thinking to Nursing Students: A Pilot Study , 2019, International Archives of Nursing and Health Care.

[14]  Lawrence Buja,et al.  Medical education today: all that glitters is not gold , 2019, BMC Medical Education.

[15]  Daniel R Wolpaw,et al.  New Educator Roles for Health Systems Science: Implications of New Physician Competencies for U.S. Medical School Faculty , 2018, Academic medicine : journal of the Association of American Medical Colleges.

[16]  Britta M. Thompson,et al.  Educating patient-centered, systems-aware physicians: a qualitative analysis of medical student perceptions of value-added clinical systems learning roles , 2018, BMC medical education.

[17]  Aditya Khurana,et al.  A Prognosis for Health Systems Science Courses: Observations From Current Students , 2018, Academic medicine : journal of the Association of American Medical Colleges.

[18]  Britta M. Thompson,et al.  Aligning Education With Health Care Transformation: Identifying a Shared Mental Model of “New” Faculty Competencies for Academic Faculty , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[19]  J. Cleland,et al.  Getting off the carousel: Exploring the wicked problem of curriculum reform , 2017, Perspectives on Medical Education.

[20]  Tara R. Lang,et al.  Science of health care delivery milestones for undergraduate medical education , 2017, BMC Medical Education.

[21]  Mark A. Clark,et al.  Professional Identity Formation: Creating a Longitudinal Framework Through TIME (Transformation in Medical Education) , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[22]  J. Garber,et al.  Stumbling and Succeeding Together: a New Medical School’s Collaborative Initiative to Elevate Interprofessionalism as a Signature Hallmark in Training Future Healthcare Leaders , 2014 .

[23]  Mitesh S. Patel,et al.  Medical Student Perceptions of Education in Health Care Systems , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[24]  S. Swing,et al.  The ACGME outcome project: retrospective and prospective , 2007, Medical teacher.

[25]  C. Burkle,et al.  Accreditation Council for Graduate Medical Education Competencies and the American Board of Anesthesiology Clinical Competence Committee: A Comparison , 2006, Anesthesia and analgesia.

[26]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[27]  J. Nunnally,et al.  Psychometric Theory , 2020, Encyclopedia of Behavioral Medicine.

[28]  S. Stack,et al.  Creating the Medical Schools of the Future. , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[29]  Daniel R Wolpaw,et al.  Educating for the 21st-Century Health Care System: An Interdependent Framework of Basic, Clinical, and Systems Sciences , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[30]  M. Schwartz,et al.  Health Systems Science Curricula in Undergraduate Medical Education: Identifying and Defining a Potential Curricular Framework , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[31]  T. Ferris,et al.  Validation Studies of a Questionnaire Development for Students ’ Engagement with Systems Thinking , 2016 .