Faculty and the Observation of Trainees’ Clinical Skills: Problems and Opportunities

The clinical skills of medical interviewing, physical examination, and counseling remain vital to the effective care of patients, yet research continues to document serious deficiencies in clinical skills among students and residents. The most important method of evaluation is the direct observation of trainees performing these clinical skills. Standardized patients and other simulation technologies are important and reliable tools for teaching clinical skills and evaluating competence and will be incorporated in the near future as part of the United States Medical Licensing Examination. Standardized patients and simulation, however, cannot and should not replace the direct observation by faculty of trainees’ clinical skills with actual patients. Faculty are in the best position to document improvement over time and to certify trainees have attained sophisticated levels of skill in medical interviewing, physical examination, and counseling. Unfortunately, current evidence suggests significant deficiencies in faculty direct observation evaluation skills. The author outlines the nature of the problems in clinical skills and their evaluation by faculty and ends with recommendations to improve the current state of faculty skills in evaluation.

[1]  Michael Stinson,et al.  Evidence-Based Physical Diagnosis , 2001, Annals of Internal Medicine.

[2]  M. Heins,et al.  Perceptions of medical school faculty members and students on clinical clerkship feedback. , 1984, Journal of medical education.

[3]  E. Rich,et al.  The diagnostic value of the medical history. Perceptions of internal medicine physicians. , 1987, Archives of internal medicine.

[4]  M. Nathanson,et al.  Physical examination. Frequently observed errors. , 1976 .

[5]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[6]  K. Skeff,et al.  Improving Clinical Teaching: Evaluation of a National Dissemination Program , 1992 .

[7]  W. Levinson,et al.  Clinician-Educators in Academic Medical Centers: A Two-Part Challenge , 1998, Annals of Internal Medicine.

[8]  J Lescop,et al.  Using standardized patients in licensing/certification examinations: comparison of two tests in Canada. , 1997, Family medicine.

[9]  G. L. Engel Are Medical Schools Neglecting Clinical Skills , 1976 .

[10]  W. Levinson,et al.  Informed decision making in outpatient practice: time to get back to basics. , 1999, JAMA.

[11]  R. Frankel,et al.  A model of empathic communication in the medical interview. , 1997, JAMA.

[12]  Youde Wang,et al.  Growing use of standardized patients in teaching and evaluation in medical education , 1994 .

[13]  S Mangione,et al.  Physical diagnosis skills of physicians in training: a focused assessment. , 1995, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[14]  I. K. Todd A thorough pulmonary exam and other myths. , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[15]  I R McWhinney,et al.  The doctor/patient relationship and its effect upon outcome. , 1979, The Journal of the Royal College of General Practitioners.

[16]  D. Simpson,et al.  A survey of sued and nonsued physicians and suing patients. , 1989, Archives of internal medicine.

[17]  L. Nieman,et al.  Cardiac auscultatory skills of internal medicine and family practice trainees. A comparison of diagnostic proficiency. , 1997, JAMA.

[18]  D M Long,et al.  Competency‐based Residency Training: The Next Advance in Graduate Medical Education , 2000, Acta neurochirurgica. Supplement.

[19]  Antonio Godoy Clinical judgement. , 1985, The Journal of the Royal College of General Practitioners.

[20]  Eugene B. Brody,et al.  The Silent World of Doctor and Patient , 1986 .

[21]  G. Bordage,et al.  Nature of the clinical difficulties of first-year family medicine residents under direct observation. , 1992, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[22]  David B. Swanson,et al.  Assessment of clinical skills with standardized patients: State of the art , 1990 .

[23]  J. Norcini,et al.  The Mini-CEX (Clinical Evaluation Exercise): A Preliminary Investigation , 1995, Annals of Internal Medicine.

[24]  G. Miller The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[25]  M. Stewart,et al.  Doctor-patient communication: the Toronto consensus statement. , 1991, BMJ.

[26]  M Verma,et al.  Assessment of clinical competence , 1994 .

[27]  M. Donnelly,et al.  Assessing surgical residents' and medical students' interpersonal skills. , 1994, The Journal of surgical research.

[28]  H. Krumholz,et al.  Characteristics of physician leaders working to improve the quality of care in acute myocardial infarction. , 2003, Joint Commission journal on quality and safety.

[29]  K. Skeff,et al.  Factorial validation of a widely disseminated educational framework for evaluating clinical teachers , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[30]  J. Butterworth,et al.  Auscultatory Acumen in the General Medical Population , 1960 .

[31]  Paul Batalden,et al.  General competencies and accreditation in graduate medical education. , 2002, Health affairs.

[32]  T. Hassard,et al.  Assessing practicing physicians in two settings using standardized patients , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[33]  E. Raftery,et al.  Examination of the heart: an investigation into variation. , 1967, American journal of epidemiology.

[34]  G Bordage,et al.  Why did I miss the diagnosis? Some cognitive explanations and educational implications. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[35]  W. Levinson,et al.  Integrating Clinician‐Educators into Academic Medical Centers: Challenges and Potential Solutions , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[36]  S B Soumerai,et al.  Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial. , 1998, JAMA.

[37]  M. Boohan,et al.  Basic clinical skills: don’t leave teaching to the teaching hospitals , 2000, Medical education.

[38]  F Sturmans,et al.  Does competence of general practitioners predict their performance? Comparison between examination setting and actual practice. , 1991, BMJ.

[39]  J. Rethans,et al.  Assessment of practicing family physicians: comparison of observation in a multiple-station examination using standardized patients with observation of consultations in daily practice. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[40]  D. Misch Evaluating Physicians' Professionalism and Humanism: The Case for Humanism “Connoisseurs” , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[41]  L. Caplan,et al.  The accuracy of bedside neurological diagnoses , 1990, Annals of neurology.

[42]  J P Mullooly,et al.  Physician-patient communication. The relationship with malpractice claims among primary care physicians and surgeons. , 1997, JAMA.

[43]  J. Hampton,et al.  Relative contributions of history-taking, physical examination, and laboratory investigation to diagnosis and management of medical outpatients. , 1975, British medical journal.

[44]  D. Kassebaum,et al.  Shortcomings in the evaluation of students' clinical skills and behaviors in medical school. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[45]  M B Donnelly,et al.  The Objective Structured Clinical Examination The New Gold Standard for Evaluating Postgraduate Clinical Performance , 1995, Annals of surgery.

[46]  C. Brailovsky,et al.  Construct validity of the québec licensing examination SP‐based OSCE , 1997 .

[47]  K. Skeff Evaluation of a method for improving the teaching performance of attending physicians. , 1983, The American journal of medicine.

[48]  J. Li Assessment of basic physical examination skills of internal medicine residents , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[49]  M. Stewart Effective physician-patient communication and health outcomes: a review. , 1995, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[50]  L. Pangaro,et al.  How well do internal medicine faculty members evaluate the clinical skills of residents? , 1992, Annals of internal medicine.

[51]  J E Johnson,et al.  Medical house staff performance in physical examination. , 1986, Archives of internal medicine.

[52]  W Kirch,et al.  Misdiagnosis at a university hospital in 4 medical eras. , 1996, Medicine.

[53]  A. K. Sachdeva,et al.  Variability in the clinical skills of residents entering training programs in surgery. , 1995, Surgery.

[54]  Engel Gl Editorial: Are Medical Schools neglecting clinical skills? , 1976 .

[55]  J. Dacre,et al.  A study of pre‐registration house officers’ clinical skills , 2000, Medical education.

[56]  E. Campbell,et al.  Preparedness of internal medicine and family practice residents for treating common conditions. , 2002, JAMA.

[57]  G. Caranasos,et al.  Evaluating the interview performance of internal medicine interns , 1989, Academic medicine : journal of the Association of American Medical Colleges.

[58]  Eugene Vayda,et al.  Opinion leaders vs audit and feedback to implement practice guidelines. Delivery after previous cesarean section. , 1991, JAMA.

[59]  N. Wray,et al.  Detection and correction of house staff error in physical diagnosis. , 1983, JAMA.

[60]  M. Stewart,et al.  Communication patterns of primary care physicians. , 1997, JAMA.

[61]  H. Barrows An overview of the uses of standardized patients for teaching and evaluating clinical skills. AAMC , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[62]  M. C. Peterson,et al.  Contributions of the history, physical examination, and laboratory investigation in making medical diagnoses. , 1992, The Western journal of medicine.

[63]  C. Pfeiffer,et al.  The rise and fall of students' skill in obtaining a medical history , 1998, Medical education.

[64]  E. Hanna,et al.  Defensible assessment of the competency of the practicing physician , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[65]  D. Elliot,et al.  Evaluation of physical examination skills. Reliability of faculty observers and patient instructors. , 1987, JAMA.

[66]  F. Platt,et al.  Clinical Hypocompetence: The Interview , 1979 .

[67]  J. Ende Feedback in clinical medical education. , 1983, JAMA.

[68]  J E Dacre,et al.  A study of pre‐registration house officers’ clinical skills , 2000 .

[69]  J. Carline,et al.  History-taking and preventive medicine skills among primary care physicians: an assessment using standardized patients. , 1998, The American journal of medicine.

[70]  M. Donnelly,et al.  The relationship between faculty ward evaluations, OSCE, and ABSITE as measures of surgical intern performance. , 1995, American journal of surgery.

[71]  T Richards,et al.  Chasms in communication. , 1990, BMJ.

[72]  G. L. Engel The deficiencies of the case presentation as a method of clinical teaching. Another approach. , 1971, The New England journal of medicine.