Physician‐patient encounters: The structure of performance in family and general office practice

Introduction: The College of Physicians and Surgeons of Ontario, the regulatory authority for physicians in Ontario, Canada, conducts peer assessments of physicians' practices as part of a broad quality assurance program. Outcomes are summarized as a single score and there is no differentiation between performance in various aspects of care. In this study we test the hypothesis that physician performance is multidimensional and that dimensions can be defined in terms of physician‐patient encounters. Methods: Peer assessment data from 532 randomly selected family practitioners were analyzed using factor analysis to assess the dimensional structure of performance. Content validity was confirmed through consultation sessions with 130 physicians. Multiple‐item measures were constructed for each dimension and reliability calculated. Analysis of variance determined the extent to which multiple‐item measure scores would vary across peer assessment outcomes. Results: Six performance dimensions were confirmed: acute care, chronic conditions, continuity of care and referrals, well care and health maintenance, psychosocial care, and patient records. Discussion: Physician performance is multidimensional, including types of physician‐patient encounters and variation across dimensions, as demonstrated by individual practice. A conceptual framework for multidimensional performance may inform the design of meaningful evaluation and educational recommendations to meet the individual performance of practicing physicians.

[1]  A. Laduca,et al.  The Design of a New Physician Licensure Examination , 1984, Evaluation & the health professions.

[2]  R G McAuley,et al.  Results of the peer assessment program of the College of Physicians and Surgeons of Ontario. , 1984, Canadian Medical Association journal.

[3]  C. Goldsmith,et al.  Five-year results of the peer assessment program of the College of Physicians and Surgeons of Ontario. , 1990, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[4]  J. Carline,et al.  Use of peer ratings to evaluate physician performance. , 1993, JAMA.

[5]  Mike Robinson,et al.  Evaluation of medical audit. , 1994, Journal of epidemiology and community health.

[6]  A. Laduca,et al.  Validation of Professional Licensure Examinations , 1994, Evaluation & the health professions.

[7]  Ccfp,et al.  Family practice in Ontario. How physician demographics affect practice patterns. , 1994, Canadian family physician Medecin de famille canadien.

[8]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[9]  D. Dupras,et al.  Use of an objective structured clinical examination to determine clinical competence , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[10]  J. Rethans,et al.  Assessment of competence in technical clinical skills of general practitioners , 1995, Medical education.

[11]  A. Lawthers,et al.  Designing and using measures of quality based on physician office records , 1995, The Journal of ambulatory care management.

[12]  Robert H. Brook,et al.  Part 2: Measuring Quality of Care , 1996 .

[13]  E. McGlynn,et al.  Part 2: Measuring Quality of Care , 1996 .

[14]  J. Rethans,et al.  Performance‐based assessment in continuing medical education for general practitioners: construct validity , 1996, Medical education.

[15]  A. Champlain,et al.  Assessing the factor structure of a nationally administered standardized patient examination. , 1997 .

[16]  D. Klass,et al.  Assessing the factor structure of a nationally administered standardized patient examination , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[17]  P. Norton,et al.  What factors affect quality of care? Using the Peer Assessment Program in Ontario family practices. , 1997, Canadian family physician Medecin de famille canadien.

[18]  D. Solomon,et al.  Setting standards and defining quality of performance in the validation of a standardized‐patient examination format , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[19]  J. Rethans,et al.  Structure and process: the relationship between practice management and actual clinical performance in general practice. , 1998, Family practice.

[20]  N. Donen No to mandatory continuing medical education, yes to mandatory practice auditing and professional educational development. , 1998, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[21]  P. Norton,et al.  Long-term follow-up in the Peer Assessment Program for nonspecialist physicians in Ontario, Canada. , 1998, The Joint Commission journal on quality improvement.

[22]  R D Fox,et al.  Continuing medical education: Learning and change: implications for continuing medical education , 1998, BMJ.

[23]  J. Rethans,et al.  Assessment of general practitioners by video observation of communicative and medical performance in daily practice: issues of validity, reliability and feasibility , 1999, Medical education.

[24]  E V Dunn,et al.  Evaluating the effectiveness of 2 educational interventions in family practice. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[25]  J. Rethans,et al.  Assessment of practicing family physicians: comparison of observation in a multiple-station examination using standardized patients with observation of consultations in daily practice. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[26]  P. Norton,et al.  A longitudinal study of performance of physicians' office practices: data from the Peer Assessment Program in Ontario, Canada. , 1999, The Joint Commission journal on quality improvement.

[27]  Grol,et al.  Effect of a short skills training course on competence and performance in general practice , 2000, Medical education.

[28]  D. Klass Reevaluation of clinical competency. , 2000, American journal of physical medicine & rehabilitation.

[29]  H. Krumholz,et al.  Can practice guidelines be transported effectively to different settings? Results from a multicenter interventional study. , 2001, The Joint Commission journal on quality improvement.

[30]  N. Weinberg Using performance measures to identify plans of action to improve care. , 2001, The Joint Commission journal on quality improvement.

[31]  T. Walley,et al.  Why do GPs not implement evidence-based guidelines? A descriptive study. , 2001, Family practice.

[32]  R. Grol Improving the quality of medical care: building bridges among professional pride, payer profit, and patient satisfaction. , 2001, JAMA.

[33]  J. Cox,et al.  A qualitative study of evidence in primary care: what the practitioners are saying. , 2002, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[34]  I C McManus,et al.  Linking assessment to learning: a new route to quality assurance in medical practice , 2002, Medical education.

[35]  D. Asch,et al.  Conceptual challenges in tailoring physician performance assessment to individual practice , 2002, Medical education.

[36]  Kristopher J Preacher,et al.  Repairing Tom Swift's Electric Factor Analysis Machine , 2003 .