Does competence of general practitioners predict their performance? Comparison between examination setting and actual practice.

OBJECTIVE--To study the differences and the relation between what a doctor actually does in daily practice (performance) and what he or she is capable of doing (competence) by using national standards for general practice. DESIGN--General practitioners were consulted by four standardised (simulated) patients portraying four different cases during normal surgery hours. Later the doctors participated in a controlled practice test, for which they were asked to perform to the best of their ability. In the test they saw exactly the same standardised cases but in different patients. The patients reported on the consultations. SETTING--Province of Limburg, the Netherlands. SUBJECTS--442 general practitioners invited by a letter. 137 (31%) agreed to participate, of whom 36 were selected and visited. MAIN OUTCOME MEASURES--Number of actions taken during the consultations across complaints and for each category of complaint: the competence and performance total scores. Combination of scores with duration of consultations (efficiency-time score). Correlation between scores in the competence and performance part. RESULTS--Mean (SD) total score across complaints for competence was 49% higher than in the performance test (81.8 (11) compared with 54.7 (10.1), p less than 0.0001). The Pearson correlation across complaints between the competence total score and the performance total score of the participating physicians was -0.04 (not significant). When efficiency and consultation time of the consultations were taken into account, the correlation was 0.45 (p less than 0.01). CONCLUSIONS--Assessment of competence under examination circumstances can have predictive value for performance in actual practice only when factors such as efficiency and consultation time are taken into account. Below standard performance of physicians does not necessarily reflect a lack of competence. Performance and competence should be considered as distinct constructs.

[1]  F Sturmans,et al.  Assessment of the performance of general practitioners by the use of standardized (simulated) patients. , 1991, The British journal of general practice : the journal of the Royal College of General Practitioners.

[2]  L. Brooks,et al.  The development of expertise in dermatology. , 1989, Archives of dermatology.

[3]  H. Schmidt,et al.  A cognitive perspective on medical expertise: theory and implication [published erratum appears in Acad Med 1992 Apr;67(4):287] , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[4]  P. Maguire,et al.  Assessing clinical competence. , 1989, BMJ.

[5]  J. S. Todd Do practice guidelines guide practice? , 1990, The New England journal of medicine.

[6]  H L Kundel,et al.  Visual scanning, pattern recognition and decision-making in pulmonary nodule detection. , 1978, Investigative radiology.

[7]  Geoffrey R. Norman,et al.  Assessing "clinical competence". , 1968, British medical journal.

[8]  V. Patel,et al.  Contextual factors in the activation of first diagnostic hypotheses: expert‐novice differences , 1987, Medical education.

[9]  C. Woodward,et al.  Measuring physicians' performances by using simulated patients. , 1985, Journal of medical education.

[10]  M. Enkin,et al.  Do practice guidelines guide practice? The effect of a consensus statement on the practice of physicians. , 1989, The New England journal of medicine.

[11]  J. Rethans,et al.  Simulated patients in general practice: a different look at the consultation. , 1987, British medical journal.

[12]  P. Hobus,et al.  Contextual Factors in the Activation of First Hypotheses: Expert-Novice Differences. , 1986 .

[13]  D. Swanson,et al.  Ensuring the clinical competence of medical school graduates through standardized patients. , 1987, Archives of internal medicine.

[14]  F. Sturmans,et al.  Competence and performance: two different concepts in the assessment of quality of medical care. , 1990, Family practice.

[15]  David B. Swanson,et al.  Assessment of clinical skills with standardized patients: State of the art , 1990 .

[16]  P Tugwell,et al.  A comparison of resident performance on real and simulated patients. , 1982, Journal of medical education.

[17]  R. Baker PEER REVIEW IN GENERAL PRACTICE , 1988 .

[18]  F. Sturmans,et al.  A method for introducing standardized (simulated) patients into general practice consultations. , 1991, The British journal of general practice : the journal of the Royal College of General Practitioners.