Association between licensing examination scores and resource use and quality of care in primary care practice.

CONTEXT Clinical competence is a determinant of the quality of care delivered, and may be associated with use of health care resources by primary care physicians. Clinical competence is assumed to be assessed by licensing examinations, yet there is a paucity of information on whether scores achieved predict subsequent practice. OBJECTIVE To determine if licensing examination scores were associated with selected aspects of quality of care and resource use in initial primary care practice. DESIGN Prospective cohort study of recently licensed family physicians, followed up for the first 18 months of practice. SETTING The Quebec health care system. PARTICIPANTS A total of 614 family physicians who passed the licensing examination between 1991 and 1993 and entered fee-for-service practice in Quebec. MAIN OUTCOME MEASURES All patients seen by physicians were identified by the universal health insurance board and all health services provided to these patients were retrieved for the 18 months prior to (baseline) and after (follow-up) the physicians' entry into practice. Medical service and prescription claims files were used to measure rates of resource use (specialty consultation, symptom-relief prescribing compared with disease-specific prescribing) and quality of care (inappropriate prescribing, mammography screening). Baseline data were used to adjust for differences in practice population. RESULTS Study physicians saw a total of 1116389 patients, of whom 113535 (10.2%) were elderly and 83391 (7.5%) were women aged 50 to 69 years. Physicians with higher licensing examination scores referred more of their patients for consultation (3.8/1000 patients per SD increase in score; 95% confidence interval [CI], 1.2-7.0; P = .005), prescribed to elderly patients fewer inappropriate medications (-2.7/1000 patients per SD increase in score; 95% CI, -4.8 to -0.7; P=.009) and more disease-specific medications relative to symptom-relief medications (3.9/1000 patients per SD increase in score; 95% CI, 0.3 to 7.4; P= .03), and referred more women aged 50 to 69 years (6.6/1000 patients per SD increase in score; 95% CI, 1.2-11.9; P = .02) for mammography screening. If patients of physicians with the lowest scores had experienced the same rates of consultation, prescribing, and screening as patients of physicians with the highest scores, an additional 3027 patients would have been referred, 179 fewer elderly patients would have been prescribed symptom-relief medication, 912 more elderly patients would have been prescribed disease-specific medication, 189 fewer patients would have received inappropriate medication, and 121 more women would have received mammography screening. CONCLUSIONS Licensing examination scores are significant predictors of consultation, prescribing, and mammography screening rates in initial primary care practice.

[1]  H Pohl,et al.  Medication prescribing errors in a teaching hospital. , 1990, JAMA.

[2]  W. Phillips,et al.  Cancer screening by primary care physicians: a comparison of rates obtained from physician self-report, patient survey, and chart audit. , 1995, American journal of public health.

[3]  H. Morgenstern,et al.  Inappropriate Medication Prescribing in Skilled-Nursing Facilities , 1992, Annals of Internal Medicine.

[4]  R. Tamblyn,et al.  The use of prescription claims databases in pharmacoepidemiological research: the accuracy and comprehensiveness of the prescription claims database in Québec. , 1995, Journal of clinical epidemiology.

[5]  L. Irwig,et al.  Encouraging attendance at screening mammography: knowledge, attitudes and intentions of general practitioners , 1989, The Medical journal of Australia.

[6]  O'Connor Am,et al.  Importance of physician's role highlighted in survey of women's breast screening practices. , 1995 .

[7]  P. Bashook,et al.  Continuing medical education: Recertification and the maintenance of competence , 1998, BMJ.

[8]  N. Bellamy,et al.  A survey of current prescribing practices of anti‐inflammatory and urate‐lowering drugs in gouty arthritis in New South Wales and Queensland , 1989, The Medical journal of Australia.

[9]  D. Swanson,et al.  The relationship between clinical science performance in 20 medical schools and performance on Step 2 of the USMLE licensing examination. 1994‐95 Validity Study Group for USMLE Step 1 and 2 Pass/Fail Standards , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[10]  J. Santell Projecting future drug expenditures--1994. , 1994, American journal of hospital pharmacy.

[11]  S. Mcphee,et al.  Cancer screening by primary care physicians. Can we explain the differences? , 1991, The Journal of family practice.

[12]  P. Szilagyi,et al.  Does quality of care affect rates of hospitalization for childhood asthma? , 1996, Pediatrics.

[13]  R. Tallis,et al.  Inappropriate medication is a major cause of adverse drug reactions in elderly patients. , 1992, Age and ageing.

[14]  J. Gabe Towards a sociology of tranquillizer prescribing. , 1990, British journal of addiction.

[15]  S. Verhulst,et al.  Examination of nonresponse bias in a major residency follow‐up study , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[16]  C. Clancy,et al.  Gatekeeping revisited--protecting patients from overtreatment. , 1992, The New England journal of medicine.

[17]  R. Wright,et al.  Community-Oriented Primary Care: The Cornerstone of Health Care Reform , 1993 .

[18]  P P Lamy,et al.  Physicians' Knowledge of Prescribing for the Elderly , 1985, Journal of the American Geriatrics Society.

[19]  J. Williams,et al.  Determinants of Primary Medical Practice in Adult Cancer Prevention , 1986, Medical care.

[20]  J. Knottnerus,et al.  Comparing the quality of referrals of general practitioners with high and average referral rates: an independent panel review. , 1990, The British journal of general practice : the journal of the Royal College of General Practitioners.

[21]  C M Ashton,et al.  The Association between the Quality of Inpatient Care and Early Readmission , 1995, Annals of Internal Medicine.

[22]  N. Calman,et al.  Variability in consultation rates and practitioner level of diagnostic certainty. , 1992, The Journal of family practice.

[23]  C. Elam,et al.  NBME Part I versus USMLE Step 1: predicting scores based on preadmission and medical school performances , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[24]  S B Soumerai,et al.  Pharmacists as Agents of Change for Rational Drug Therapy , 1995, International Journal of Technology Assessment in Health Care.

[25]  S. Roth Nonsteroidal anti-inflammatory drugs: gastropathy, deaths, and medical practice. , 1988, Annals of internal medicine.

[26]  A. Hohmann Gender Bias in Psychotropic Drug Prescribing in Primary Care , 1989, Medical care.

[27]  J. Williams,et al.  Determinants of preventive practices in fee-for-service primary care. , 1990, American journal of preventive medicine.

[28]  J. A. Johnson,et al.  Drug-Related Morbidity and Mortality: A Cost-of-Illness Model , 1995 .

[29]  R. Niblock,et al.  Unsuspected patterns of drug utilization revealed by interrogation of a regional general practitioner prescribing database , 1992 .

[30]  John C. Beck,et al.  Explicit criteria for determining inappropriate medication use in nursing home residents. UCLA Division of Geriatric Medicine. , 1991 .

[31]  P. Grand'maison,et al.  Large-scale use of an objective, structured clinical examination for licensing family physicians. , 1992, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[32]  S. Iliffe Medication review for older people in general practice. , 1994, Journal of the Royal Society of Medicine.

[33]  F. Connell,et al.  Adequacy of well-child care and immunizations in US infants born in 1988. , 1994, JAMA.

[34]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[35]  Ferguson Ri,et al.  The Nelson general practice prescribing project. Part I: A pilot audit of the regional prescribing profile. , 1990 .

[36]  R. Luckmann,et al.  Characteristics of Primary Care Office Systems as Predictors of Mammography Utilization , 1993, Annals of Internal Medicine.

[37]  E. Trako,et al.  A national census of those attending UK accident and emergency departments with asthma. The UK National Asthma Task Force. , 1997, Journal of accident & emergency medicine.

[38]  C P Bradley,et al.  Uncomfortable prescribing decisions: a critical incident study. , 1992, BMJ.

[39]  F H Lawler,et al.  Patient and physician perspectives regarding treatment of diabetes: compliance with practice guidelines. , 1997, The Journal of family practice.

[40]  R Tamblyn,et al.  Unnecessary Prescribing of NSAIDs and the Management of NSAID-Related Gastropathy in Medical Practice , 1997, Annals of Internal Medicine.

[41]  N. Wareham,et al.  A district confidential enquiry into deaths due to asthma. , 1993, Thorax.

[42]  M. Roland,et al.  General practitioner outpatient referrals: do good doctors refer more patients to hospital? , 1991, BMJ.

[43]  D. Himmelstein,et al.  Inappropriate drug prescribing for the community-dwelling elderly. , 1994, JAMA.

[44]  B. Crabtree,et al.  Effects of Age, Education, and Physician Advice on Utilization of Screening Mammography , 1989, Journal of the American Geriatrics Society.

[45]  G. Tognoni,et al.  A Comprehensive Assessment of the Avoidability of Long-Term Complications of Diabetes. A case-control study. SID-AMD Italian Study Group for the Implementation of the St. Vincent Declaration , 1996, Diabetes Care.

[46]  J. Carline,et al.  Predictive validity of certification by the American Board of Internal Medicine. , 1989, Annals of internal medicine.

[47]  P. Corey,et al.  Incidence of Adverse Drug Reactions in Hospitalized Patients , 2012 .

[48]  M. Foets,et al.  Sex differences among recipients of benzodiazepines in Dutch general practice. , 1993, BMJ.

[49]  A. Legorreta,et al.  Compliance with national asthma management guidelines and specialty care: a health maintenance organization experience. , 1998, Archives of internal medicine.

[50]  M. Abrahamowicz,et al.  Questionable prescribing for elderly patients in Quebec. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[51]  H L Lipton,et al.  Drug Utilization Review in Ambulatory Settings: State of the Science and Directions for Outcomes Research , 1993, Medical care.

[52]  D B Reuben,et al.  Explicit criteria for determining inappropriate medication use in nursing home residents. UCLA Division of Geriatric Medicine. , 1991, Archives of internal medicine.

[53]  R. Haynes,et al.  A critical appraisal of the efficacy of continuing medical education. , 1984, JAMA.

[54]  J. Lexchin Why are we still poisoning the elderly so often? , 1993, Canadian family physician Medecin de famille canadien.

[55]  R. Sergott,et al.  Diagnostic management by gatekeepers is not cost effective for neuro-ophthalmology. , 1994, Ophthalmology.

[56]  R. Pineault,et al.  Factors influencing physicians' preventive practices. , 1989, American journal of preventive medicine.

[57]  B. Starfield,et al.  Primary care, financing and gatekeeping in western Europe. , 1994, Family practice.

[58]  Holtshousen Ws,et al.  Prescribing behaviors of family physicians in the treatment of osteoarthritis. , 1992 .

[59]  E. Wynder,et al.  Preventive cardiology in primary care. , 1994, Atherosclerosis.

[60]  S. Fox,et al.  The impact of physician compliance on screening mammography for older women. , 1991, Archives of internal medicine.

[61]  J. Avorn,et al.  Economic and Policy Analysis of University-based Drug “Detailing , 1986, Medical care.

[62]  H. Mcgavock,et al.  Some patterns of prescribing by urban general practitioners , 1988, British medical journal.

[63]  J. Avorn,et al.  Improving drug prescribing in primary care: a critical analysis of the experimental literature. , 1989, The Milbank quarterly.

[64]  C. Hertzman,et al.  Trends and determinants of prescription drug expenditures in the elderly: data from the British Columbia Pharmacare Program. , 1993, Inquiry : a journal of medical care organization, provision and financing.

[65]  D. Wilkin,et al.  Variation in general practitioners' referral rates to consultants. , 1987, The Journal of the Royal College of General Practitioners.

[66]  R Wilkins,et al.  Use of postal codes and addresses in the analysis of health data. , 1993, Health reports.

[67]  R. Tamblyn Is the Public being Protected? Prevention of Suboptimalmedical Practice Through Training Programs and Credentialing Examinations , 1994, Evaluation & the health professions.

[68]  Fitzhugh Mullan,et al.  Community Oriented Primary Care , 1982 .

[69]  M. Holm Prescription of benzodiazepines in general practice in the county of Arhus, Denmark. , 1988, Danish medical bulletin.

[70]  D. Molloy,et al.  Physician characteristics and prescribing for elderly people in New Brunswick: relation to patient outcomes. , 1995, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[71]  A. Coulter,et al.  Do referral rates vary widely between practices and does supply of services affect demand? A study in Milton Keynes and the Oxford region. , 1989, The Journal of the Royal College of General Practitioners.

[72]  H. Khine,et al.  Profile of children requiring emergency treatment for asthma. , 1997, Annals of allergy, asthma & immunology : official publication of the American College of Allergy, Asthma, & Immunology.

[73]  J. Kruse,et al.  Factors Influencing Women's Decision to Undergo Mammography , 1987, Obstetrics and gynecology.

[74]  C. Elam,et al.  Using preadmission and medical school performances to predict scores on the USMLE step 2 examination , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[75]  J. Guralnik,et al.  Preventive services for breast and cervical cancer in U.S. office-based practices. , 1996, Preventive medicine.

[76]  Carlson Bl,et al.  Physician compliance with mammography guidelines: a retrospective chart review. , 1989 .

[77]  R. Tamblyn,et al.  Changing clinical practice: Which interventions work? , 1993 .