Measuring progressive independence with the resident supervision index: empirical approach.

BACKGROUND A Resident Supervision Index (RSI) developed by our research team quantifies the intensity of resident supervision in graduate medical education, with the goal of testing for progressive independence. The 4-part RSI method includes a survey instrument for staff and residents (RSI Inventory), a strategy to score survey responses, a theoretical framework (patient centered optimal supervision), and a statistical model that accounts for the presence or absence of supervision and the intensity of patient care. METHODS The RSI Inventory data came from 140 outpatient encounters involving 57 residents and 37 attending physicians during a 3-month period at a Department of Veterans Affairs outpatient clinic. Responses are scored to quantitatively measure the intensity of resident supervision across 10 levels of patient services (staff is absent, is present, participated, or provided care with or without a resident), case discussion (resident-staff interaction), and oversight (staff reviewed case, reviewed medical chart, consulted with staff, or assessed patient). Scores are analyzed by level and for patient care using a 2-part model (supervision initiated [yes or no] versus intensity once supervision was initiated). RESULTS All resident encounters had patient care supervision, resident oversight, or both. Consistent with the progressive independence hypothesis, residents were 1.72 (P  =  .019) times more likely to be fully responsible for patient care with each additional postgraduate year. Decreasing case complexity, increasing clinic workload, and advanced nonmedical degrees among attending staff were negatively associated with supervision intensity, although associations varied by supervision level. CONCLUSIONS These data are consistent with the progressive independence hypothesis in graduate medical education and offer empirical support for the 4-part RSI method to quantify the intensity of resident supervision for research, program evaluation, and resident assessment purposes. Before informing policy, however, more scientific research in actual teaching settings is needed to better understand the relationships among patient outcomes, clinic workload, case complexity, and graduate medical education experience in resident supervision and professional development.

[1]  Steven S. Henley,et al.  Measuring the Intensity of Resident Supervision in the Department of Veterans Affairs: The Resident Supervision Index , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[2]  M. Fava,et al.  The Impact of Nonclinical Factors on Care Use for Patients with Depression: A STAR*D Report , 2009, CNS neuroscience & therapeutics.

[3]  Eric S. Holmboe,et al.  Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. , 2009, JAMA.

[4]  D. Meltzer,et al.  On-call supervision and resident autonomy: from micromanager to absentee attending. , 2009, The American journal of medicine.

[5]  G. Regehr,et al.  ‘It’s a cultural expectation…’ The pressure on medical trainees to work independently in clinical practice , 2009, Medical education.

[6]  G. Regehr,et al.  Preserving professional credibility: grounded theory study of medical trainees’ requests for clinical support , 2009, BMJ : British Medical Journal.

[7]  Lorelei Lingard,et al.  Point-of-Care Assessment of Medical Trainee Competence for Independent Clinical Work , 2008, Academic medicine : journal of the Association of American Medical Colleges.

[8]  J. Tilburt,et al.  Do we practice what we preach? A qualitative assessment of resident-preceptor interactions for adherence to evidence-based practice. , 2008, Journal of evaluation in clinical practice.

[9]  Hardeep Singh,et al.  Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. , 2007, Archives of internal medicine.

[10]  J. Tilburt,et al.  How do doctors use information in real-time? A qualitative study of internal medicine resident precepting. , 2007, Journal of evaluation in clinical practice.

[11]  L. Lingard,et al.  Questioning Competence: A Discourse Analysis of Attending Physicians’ Use of Questions to Assess Trainee Competence , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[12]  G. Regehr,et al.  Clinical Oversight: Conceptualizing the Relationship Between Supervision and Safety , 2007, Journal of General Internal Medicine.

[13]  T. Huddle,et al.  Viewpoint: Taking Apart the Art: The Risk of Anatomizing Clinical Competence , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[14]  Fedde Scheele,et al.  Viewpoint: Competency-Based Postgraduate Training: Can We Bridge the Gap between Theory and Clinical Practice? , 2007 .

[15]  K. Parakh Assessment in medical education. , 2007, The New England journal of medicine.

[16]  D. Irby,et al.  Assessment in medical education. , 2007, The New England journal of medicine.

[17]  Charles McCulloch,et al.  House staff team workload and organization effects on patient outcomes in an academic general internal medicine inpatient service. , 2007, Archives of internal medicine.

[18]  Janet Grant,et al.  AMEE Guide No. 27: Effective educational and clinical supervision , 2007, Medical teacher.

[19]  K. Shojania,et al.  Graduate Medical Education and Patient Safety: A Busyand Occasionally HazardousIntersection , 2006, Annals of Internal Medicine.

[20]  Robert J. Anderson,et al.  What do attending physicians contribute in a house officer-based ambulatory continuity clinic? , 2006, Journal of General Internal Medicine.

[21]  K. Itani,et al.  Surgical resident supervision in the operating room and outcomes of care in Veterans Affairs hospitals. , 2005, American journal of surgery.

[22]  G. Regehr,et al.  Progressive Independence in Clinical Training: A Tradition Worth Defending? , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[23]  James J. Heckman,et al.  Using matching, instrumental variables and control functions to estimate economic choice models , 2004 .

[24]  Janet Tucker,et al.  Patient volume, staffing, and workload in relation to risk-adjusted outcomes in a random stratified sample of UK neonatal intensive care units: a prospective evaluation , 2002, The Lancet.

[25]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[26]  G. Velmahos,et al.  Around-the-dock Attending Radiology Coverage is Essential to Avoid Mistakes in the Care of Trauma Patients , 2001, The American surgeon.

[27]  Kashner Tm Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. , 1998 .

[28]  D. Lubarsky,et al.  Valuing the Work Performed by Anesthesiology Residents and the Financial Impact on Teaching Hospitals in the United States of a Reduced Anesthesia Residency Program Size , 1998, Anesthesia and analgesia.

[29]  T. Brennan,et al.  The effect of supervision of residents on quality of care in five university‐affiliated emergency departments , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[30]  A. Hendricks,et al.  PRIVATE HEALTH INSURANCE AND VETERANS USE OF VETERANS AFFAIRS CARE , 1998 .

[31]  J. Mullahy Much Ado About Two: Reconsidering Retransformation and the Two-Part Model in Health Economics , 1998, Journal of health economics.

[32]  A. Feinstein System, supervision, standards, and the 'epidemic' of negligent medical errors. , 1997, Archives of internal medicine.

[33]  C. Griffith,et al.  Housestaff experience, workload, and test ordering in a neonatal intensive care unit , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[34]  D M Irby,et al.  Teaching and learning in ambulatory care settings: a thematic review of the literature , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[35]  G. Xakellis,et al.  Ambulatory medical education: teachers' activities, teaching cost, and residents' satisfaction , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[36]  R. Wears,et al.  Resident supervision in the operating room: does this impact on outcome? , 1993, The Journal of trauma.

[37]  M. Gennis,et al.  Supervision in the outpatient clinic , 1993, Journal of General Internal Medicine.

[38]  M McKee,et al.  Does the current use of junior doctors in the United Kingdom affect the quality of medical care? , 1992, Social science & medicine.

[39]  M. Hewson,et al.  An inventory to improve clinical teaching in the general internal medicine clinic , 1990, Medical education.

[40]  D A Asch,et al.  The Libby Zion case. One step forward or two steps backward? , 1988, The New England journal of medicine.

[41]  David C Aron,et al.  Measuring progressive independence with the resident supervision index: theoretical approach. , 2010, Journal of graduate medical education.

[42]  S. Fihn,et al.  Did I answer your question? , 2007, Journal of General Internal Medicine.

[43]  Fedde Scheele,et al.  Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[44]  Olle ten Cate,et al.  Trust, competence, and the supervisor's role in postgraduate training , 2006, BMJ : British Medical Journal.

[45]  M. Clyde,et al.  Model Uncertainty , 2003 .

[46]  T. M. Kashner,et al.  Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. , 1998, Medical care.