Evaluation of physical examination skills. Reliability of faculty observers and patient instructors.

Effective teaching of physical examination skills requires an evaluation system that can identify trainees who need further instruction. To study the evaluation of physical examination skills by faculty observers and patient instructors, the reliability of their observation of medical students performing a general physical examination was measured. Faculty observers did not reliably evaluate 32% of examination skills. Faculty agreement was lowest when observing components of the head, neck, and abdominal examinations. Patient instructors, with limited faculty training, reliably evaluated 83% of those skills that were reliably assessed by the faculty. These findings demonstrate limitations in the current methods of evaluating performance and point out the need to examine systems of trainee assessment.

[1]  L. Koran,et al.  The reliability of clinical methods, data and judgments (second of two parts). , 1975, The New England journal of medicine.

[2]  P. Diehr,et al.  Reproducibility of Clinical Data and Decisions in the Management of Upper Respiratory Illnesses: A Comparison of Physicians and Non-physician Providers , 1979, Medical care.

[3]  Inter-observer error among surgeons and nurses in presymptomatic detection of breast disease. , 1981, Journal of chronic diseases.

[4]  L. G. Davies,et al.  OBSERVER VARIATION IN REPORTS ON ELECTROCARDIOGRAMS , 1958, British heart journal.

[5]  K. K. Anderson,et al.  The use of instructor-patients to teach physical examination techniques. , 1978, Journal of medical education.

[6]  P. Stillman,et al.  Patient instructors as teachers and evaluators. , 1980, Journal of medical education.

[7]  M. Nathanson,et al.  Physical examination. Frequently observed errors. , 1976 .

[8]  J E Johnson,et al.  Medical house staff performance in physical examination. , 1986, Archives of internal medicine.

[9]  J. H. Baron,et al.  Variation Between Observers in Describing Mucosal Appearances in Proctocolitis* , 1964, British medical journal.

[10]  B. J. Andrew.  The use of behavioral checklists to assess physical examination skills. , 1977, Journal of medical education.

[11]  J W Mayer,et al.  "Harvey," the cardiology patient simulator: pilot studies on teaching effectiveness. , 1980, The American journal of cardiology.

[12]  C. Hinz.  Direct observation as a means of teaching and evaluating clinical skills. , 1966, Journal of medical education.

[13]  B. Barzansky,et al.  Initial instruction in the pelvic examination in the United States and Canada, 1983. , 1985, American journal of obstetrics and gynecology.

[14]  R. Wood,et al.  Algorithm-Directed Care by Nonphysician Practitioners in a Pediatric Population: Part I: Adherence to Algorithm Logic and Reproducibility of Nonphysician Practitioner Data-Gathering Behavior , 1983, Medical care.

[15]  N. Wray,et al.  Detection and correction of house staff error in physical diagnosis. , 1983, JAMA.

[16]  G. L. Engel.  Are Medical Schools Neglecting Clinical Skills , 1976 .

[17]  A. Feinstein,et al.  Clinical biostatistics: LIV. The biostatistics of concordance , 1981 .

[18]  D. Nardone,et al.  Instruction in patient evaluation: problems identified by course directors. , 1980, Journal of medical education.

[19]  R. Miller,et al.  Training practical instructors (programmed patients) to teach basic physicial examination. , 1977, Journal of medical education.