Neurobehavioral Performance of Residents After Heavy Night Call Versus After Alcohol Ingestion

CONTEXT The Institute of Medicine has called for increased rigor of education research and funding to support educational innovation. However, funding for medical education research is scarce. The costs of conducting studies in medical education and how such research is currently funded have not been systematically evaluated. OBJECTIVES To determine how medical education research studies that were recently published were funded and to approximate the costs of conducting these studies. DESIGN, SETTING, AND PARTICIPANTS We conducted a cross-sectional survey of first authors of medical education studies published from September 1, 2002, to December 31, 2003. Original medical education research studies conducted at US institutions and published in 13 prominent peer-reviewed journals were included. MAIN OUTCOME MEASURES For each study we measured duration, percentage of the authors' total work commitment ("percentage effort") devoted to the study, resources used and their costs, attainment of funding, and the first author's estimated cost of conducting the study. The cost of each study was calculated by multiplying the percentage effort of each author for the duration of the study by the national median salary for each author, according to specialty and academic rank, and then adding the costs of resources used. RESULTS Responses were received from authors of 243 (84%) of 290 identified medical education studies. The median calculated cost of conducting the 243 studies was 24,471 dollars (interquartile range [IQR], 11,531 dollars-63 808 dollars). The median authors' estimate of study cost was 10,000 dollars (IQR, 4000 dollars-25 000 dollars). Some funding was obtained for 72 (29.6%) of the studies. Of studies that were funded, the median amount of funding was 15,000 dollars (IQR, 5000 dollars-66,500 dollars). The median calculated cost of funded studies was 37,315 dollars (IQR, 18,731 dollars-82,393 dollars). Private foundation grants were the most common funding source (n = 30 [41.7%]). Factors independently associated with attaining funding were training in grant writing (odds ratio, 2.05; 95% confidence interval, 1.11-3.79) and number of medical education studies published by the first author (odds ratio, 2.4; 95% confidence interval, 1.24-4.63). CONCLUSIONS The majority of published medical education research is not formally funded, and the studies that do receive support are substantially underfunded. To realize the Institute of Medicine's directive and to improve the quality of medical research, policy reform that increases funding for medical education scholarship will likely be required.

[1]  Amy C. Brodkey The Role of the Pharmaceutical Industry in Teaching Psychopharmacology: A Growing Problem , 2005, Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry.

[2]  Linda Casebeer,et al.  Multicomponent Internet continuing medical education to promote chlamydia screening. , 2005, American journal of preventive medicine.

[3]  S. Retchin,et al.  Contemporary Challenges and Opportunities at Academic Health Centers , 2005, Journal of healthcare management / American College of Healthcare Executives.

[4]  Robert Fletcher,et al.  Systematic Review: The Relationship between Clinical Experience and Quality of Health Care , 2005, Annals of Internal Medicine.

[5]  R. Golub Theme Issue on Medical Education: Call for Papers , 2005 .

[6]  Moira Stewart,et al.  Effectiveness of case-based on-line learning of evidence-based practice guidelines. , 2005, Family medicine.

[7]  M. Whitcomb Using clinical outcomes data to reform medical education. , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[8]  N. Bennett,et al.  Physicians' Internet information‐seeking behaviors , 2004, The Journal of continuing education in the health professions.

[9]  Suzanne Austin Boren,et al.  eLearning: A review of Internet‐based continuing medical education , 2004, The Journal of continuing education in the health professions.

[10]  M. Bellin,et al.  Medical Students’ Exposure to Pharmaceutical Industry Marketing: A Survey at One U.S. Medical School , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[11]  T. Brennan,et al.  Financial Conflicts of Interest in Physicians' Relationships with the Pharmaceutical Industry — Self-Regulation in the Shadow of Federal Prosecution , 2004 .

[12]  D. Blumenthal Doctors and drug companies. , 2004, The New England journal of medicine.

[13]  Helen Burstin,et al.  A Call for Outcomes Research in Medical Education , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[14]  S. Wright,et al.  Educational research at Johns Hopkins University School of Medicine: a grassroots development. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[15]  J. Carline Funding Medical Education Research: Opportunities and Issues , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[16]  W. Dauphinee,et al.  The Need for Evidence in Medical Education: The Development of Best Evidence Medical Education as an Opportunity to Inform, Guide, and Sustain Medical Education Research , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[17]  K. Mann,et al.  A RIME Perspective on the Quality and Relevance of Current and Future Medical Education Research , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[18]  S. Wartman Revisiting the Idea of a National Center for Health Professions Education Research , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[19]  G. Regehr Trends in Medical Education Research , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[20]  K. Ho,et al.  Interactive on‐line continuing medical education: Physicians' perceptions and experiences , 2004, The Journal of continuing education in the health professions.

[21]  T. Stukel,et al.  Educational epidemiology: applying population-based design and analytic approaches to study medical education. , 2004, JAMA.

[22]  S. Cobb,et al.  Internet continuing education for health care professionals: An integrative review , 2004, The Journal of continuing education in the health professions.

[23]  D. Kern,et al.  An emerging renaissance in medical education , 2004, Journal of general internal medicine.

[24]  Michel Wensing,et al.  What drives change? Barriers to and incentives for achieving evidence‐based practice , 2004, The Medical journal of Australia.

[25]  Marie Diener-West,et al.  Results of an Academic Promotion and Career Path Survey of Faculty at the Johns Hopkins University School of Medicine , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[26]  M. Ray,et al.  Designing Tailored Web-Based Instruction to Improve Practicing Physicians' Preventive Practices , 2003, Journal of medical Internet research.

[27]  R. Kravitz,et al.  How does direct-to-consumer advertising (DTCA) affect prescribing? A survey in primary care environments with and without legal DTCA. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[28]  S. Wright,et al.  Looking forward to promotion , 2003, Journal of General Internal Medicine.

[29]  Robert Rosenthal,et al.  Repeated-measures contrasts for "multiple-pattern" hypotheses. , 2003, Psychological methods.

[30]  C. Peterson Health professions education: a bridge to quality. , 2003, Tar heel nurse.

[31]  D. Irby,et al.  Educational innovations in academic medicine and environmental trends , 2003, Journal of General Internal Medicine.

[32]  C. Sueta,et al.  Trends in lipid management among patients with coronary artery disease: has diabetes received the attention it deserves? , 2003, Diabetes care.

[33]  T. Walley,et al.  Influences on GPs' decision to prescribe new drugs-the importance of who says what. , 2003, Family practice.

[34]  C. Gross,et al.  Scope and impact of financial conflicts of interest in biomedical research: a systematic review. , 2003, JAMA.

[35]  S. Peiró,et al.  Accuracy of pharmaceutical advertisements in medical journals , 2003, The Lancet.

[36]  K. Galt,et al.  Student Understanding of the Relationship Between the Health Professions and the Pharmaceutical Industry , 2003, Teaching and learning in medicine.

[37]  D. Prideaux,et al.  Research in medical education: asking the right questions , 2002, Medical education.

[38]  D. Clair,et al.  Brave New Brain: Conquering Mental Illness in the Era of the Genome , 2002, Heredity.

[39]  M. Whitcomb Research in medical education: what do we know about the link between what doctors are taught and what they do? , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[40]  C. Torgerson,et al.  Educational research and randomised trials , 2002, Medical education.

[41]  R. Califf,et al.  A national survey of provisions in clinical-trial agreements between medical schools and industry sponsors. , 2002, The New England journal of medicine.

[42]  Heidi S Chumley-Jones,et al.  Web‐based Learning: Sound Educational Method or Hype? A Review of the Evaluation Literature , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[43]  M. Whitcomb CME reform: an imperative for improving the quality of medical care. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[44]  Paul E Mazmanian,et al.  Continuing medical education and the physician as a learner: guide to the evidence. , 2002, JAMA.

[45]  Darshak M Sanghavi,et al.  Randomized Trial of an Internet Curriculum on Herbs and Other Dietary Supplements for Health Care Professionals , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[46]  R. Maiuro,et al.  Can Internet-based education improve physician confidence in dealing with domestic violence? , 2002, Family medicine.

[47]  A. Detsky,et al.  Relationships between authors of clinical practice guidelines and the pharmaceutical industry. , 2002, JAMA.

[48]  J R Hoffman,et al.  An innovative approach to educating medical students about pharmaceutical promotion. , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[49]  A S Detsky,et al.  Effect of restricting contact between pharmaceutical company representatives and internal medicine residents on posttraining attitudes and behavior. , 2001, JAMA.

[50]  S. Mcphee,et al.  Of principles and pens: attitudes and practices of medicine housestaff toward pharmaceutical industry promotions. , 2001, The American journal of medicine.

[51]  A. Relman,et al.  Separating continuing medical education from pharmaceutical marketing. , 2001, JAMA.

[52]  G. Bordage,et al.  An outcomes research perspective on medical education: the predominance of trainee assessment and satisfaction , 2001, Medical education.

[53]  J. Epstein,et al.  A web‐based tutorial improves practicing pathologists' Gleason grading of images of prostate carcinoma specimens obtained by needle biopsy , 2000, Cancer.

[54]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[55]  Thomas K. Hazlet,et al.  A physician survey of the effect of drug sample availability on physicians’ behavior , 2000, Journal of General Internal Medicine.

[56]  T. Bodenheimer,et al.  Uneasy alliance--clinical investigators and the pharmaceutical industry. , 2000, The New England journal of medicine.

[57]  V R Curran,et al.  Web‐based continuing medical education (II): Evaluation study of computer‐mediated continuing medical education , 2000, The Journal of continuing education in the health professions.

[58]  V R Curran,et al.  Web‐based continuing medical education (I): Field test of a hybrid computer‐mediated instructional delivery system , 2000, The Journal of continuing education in the health professions.

[59]  A. Wazana,et al.  Physicians and the pharmaceutical industry: is a gift ever just a gift? , 2000, JAMA.

[60]  E. Bass,et al.  Innovations in education and clinical practice , 1999, Journal of General Internal Medicine.

[61]  N. Freemantle,et al.  Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? , 1999, JAMA.

[62]  J. Kaczorowski,et al.  Problem-based small-group learning via the Internet among community family physicians: a randomized controlled trial. , 1999, M.D. computing : computers in medical practice.

[63]  G. Parsell,et al.  Research in medical education: finding its place , 1999, Medical education.

[64]  D. Bloch,et al.  A simple method of sample size calculation for linear and logistic regression. , 1998, Statistics in medicine.

[65]  M. Albanese,et al.  An institutionally funded program for educational research and development grants: it makes dollars and sense , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[66]  D. Buchwald,et al.  Work activities of clinician-educators , 1998, Journal of General Internal Medicine.

[67]  C. Edmiston,et al.  Evaluation of Processes and Indicators in Infection Control (EPIC) Study , 1998, Infection Control & Hospital Epidemiology.

[68]  B. Barnes,et al.  Creating the practice‐learning environment: using information technology to support a new model of continuing medical education , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[69]  David Siegel,et al.  Trends in Antihypertensive Drug Use in the United States: Do the JNC V Recommendations Affect Prescribing? , 1997 .

[70]  Carl J. Huberty,et al.  Multiple Testing and Statistical Power With Modified Bonferroni Procedures , 1997 .

[71]  W. Sandberg,et al.  The Effect of Educational Gifts from Pharmaceutical Firms on Medical Students' Recall of Company Names or Products , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[72]  A. Taylor-Vaisey,et al.  Translating guidelines into practice: a systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines , 1997 .

[73]  D. Stryer,et al.  Characteristics of materials distributed by drug companies , 1996, Journal of General Internal Medicine.

[74]  W P McKinney,et al.  Physicians, pharmaceutical sales representatives, and the cost of prescribing. , 1996, Archives of family medicine.

[75]  D. Rennie,et al.  Influences on the Quality of Published Drug Studies , 1996, International Journal of Technology Assessment in Health Care.

[76]  M. Cho,et al.  The Quality of Drug Studies Published in Symposium Proceedings , 1996, Annals of Internal Medicine.

[77]  J. Berlin,et al.  When pharmaceutical manufacturers' employees present grand rounds, what do residents remember? , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[78]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[79]  B. Hodges,et al.  Interactions with the pharmaceutical industry: experiences and attitudes of psychiatry residents, interns and clerks. , 1995, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[80]  M. Ziegler,et al.  The accuracy of drug information from pharmaceutical sales representatives. , 1995, JAMA.

[81]  F. Hafferty,et al.  The hidden curriculum, ethics teaching, and the structure of medical education , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[82]  S. Wartman,et al.  Research in medical education: the challenge for the next decade , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[83]  M. Chren,et al.  Physicians' behavior and their interactions with drug companies. A controlled study of physicians who requested additions to a hospital drug formulary. , 1994, JAMA.

[84]  L. White,et al.  Pharmaceutical representatives and emergency medicine residents: a national survey. , 1993, Annals of emergency medicine.

[85]  D B Witzke,et al.  Beliefs and practices of emergency medicine faculty and residents regarding professional interactions with the biomedical industry. , 1993, Annals of emergency medicine.

[86]  J. Mckenney,et al.  Summary of the second report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel II) , 1993, JAMA.

[87]  D. Mark,et al.  The effect on resident attitudes of regulatory policies regarding pharmaceutical representative activities , 1993, Journal of General Internal Medicine.

[88]  R. Haynes,et al.  Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. , 1992, JAMA.

[89]  A G Mainous,et al.  Attitudes of medical school faculty toward gifts from the pharmaceutical industry , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[90]  J. Orlowski,et al.  The effects of pharmaceutical firm enticements on physician prescribing patterns. There's no such thing as a free lunch. , 1992, Chest.

[91]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[92]  W P McKinney,et al.  Attitudes of internal medicine faculty and residents toward professional interaction with pharmaceutical sales representatives. , 1990, Journal of the American Medical Association (JAMA).

[93]  B. Thompson The Importance of Planned or Focused Comparisons in OVA Research , 1988 .

[94]  Bower Ad,et al.  Family physicians and generic drugs: a study of recognition, information sources, prescribing attitudes, and practices. , 1987 .

[95]  R Hartley,et al.  Scientific versus commercial sources of influence on the prescribing behavior of physicians. , 1982, The American journal of medicine.

[96]  J. McNally Self-Directed Learning, A Guide for Learners and Teachers , 1976 .

[97]  Robin B Harris,et al.  Can internet-based continuing medical education improve physicians’ skin cancer knowledge and skills? , 2007, Journal of General Internal Medicine.

[98]  Sebastian Schneeweiss,et al.  A Medicare database review found that physician preferences increasingly outweighed patient characteristics as determinants of first-time prescriptions for COX-2 inhibitors. , 2005, Journal of clinical epidemiology.

[99]  J. Corrigan,et al.  COMMITTEE ON DATA STANDARDS FOR PATIENT SAFETY , 2004 .

[100]  Linda T. Kohn,et al.  Academic Health Centers: Leading Change in the 21st Century , 2004 .

[101]  Clinical and Laboratory Investigations Diagnosis of pigmented skin lesions by dermoscopy: web-based training improves diagnostic performance of non-experts , 2003 .

[102]  P. Maurette,et al.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[103]  T. Maurer,et al.  The effectiveness of an Internet-based tutorial in improving primary care physicians' skin cancer triage skills. , 2002, Journal of cancer education : the official journal of the American Association for Cancer Education.

[104]  E. Kosunen,et al.  General practitioners' attitudes and ethical decisions in end-of-life care after a year of interactive Internet-based training. , 2002, Journal of cancer education : the official journal of the American Association for Cancer Education.

[105]  Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report. , 2002, Circulation.

[106]  William K. Horton,et al.  Designing Web based training: how to teach anyone anything anywhere anytime , 2000 .

[107]  Karen Smith-Gratto,et al.  Strengthening Learning on the Web: Programmed Instruction and Constructivism , 2000 .

[108]  L. Kohn,et al.  COMMITTEE ON QUALITY OF HEALTH CARE IN AMERICA , 2000 .

[109]  Janet Grant,et al.  Best Evidence Medical Education , 2000, Advances in health sciences education : theory and practice.

[110]  Michael L. Dennis,et al.  Practical power analysis for substance abuse health services research. , 1997 .

[111]  Greg Kearsley,et al.  Explorations in learning and instruction: The theory into practice database , 1994 .

[112]  D. Vinson,et al.  Medical students' attitudes toward pharmaceutical marketing: possibilities for change. , 1993, Family medicine.

[113]  Daniel Steinberg,et al.  Report of the National Cholesterol Education Program Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults. The Expert Panel. , 1988, Archives of internal medicine.

[114]  M. Bowman,et al.  Changes in drug prescribing patterns related to commercial company funding of continuing medical education. , 1988, The Journal of continuing education in the health professions.

[115]  Marjorie A. Bowman,et al.  The impact of drug company funding on the content of continuing medical education , 1986 .

[116]  R. G. Lacsamana,et al.  Where do we go from here? , 1986, The Journal of the Florida Medical Association.

[117]  F Haayer,et al.  Rational prescribing and sources of information. , 1982, Social science & medicine.

[118]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[119]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .