Proposed Standards for Medical Education Submissions to the Journal of General Internal Medicine

To help authors design rigorous studies and prepare clear and informative manuscripts, improve the transparency of editorial decisions, and raise the bar on educational scholarship, the Deputy Editors of the Journal of General Internal Medicine articulate standards for medical education submissions to the Journal. General standards include: (1) quality questions, (2) quality methods to match the questions, (3) insightful interpretation of findings, (4) transparent, unbiased reporting, and (5) attention to human subjects’ protection and ethical research conduct. Additional standards for specific study types are described. We hope these proposed standards will generate discussion that will foster their continued evolution.

[1]  David A Cook,et al.  Quality of reporting of experimental studies in medical education: a systematic review , 2007, Medical education.

[2]  David A Cook,et al.  Reliability and Validity of Scores from the Index of Learning Styles , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[3]  Georges Bordage,et al.  Experimental study design and grant writing in eight steps and 28 questions , 2003, Medical education.

[4]  G. Regehr.  Reporting of Statistical Analyses , 2001 .

[5]  J. Bligh,et al.  Evaluating educational interventions , 1999, BMJ.

[6]  Steven M Downing,et al.  Validity threats: overcoming interference with proposed interpretations of assessment data , 2004, Medical education.

[7]  Stefania M. Mojon-Azzi,et al.  Scientific Misconduct: From Salami Slicing to Data Fabrication , 2004, Ophthalmic Research.

[8]  Michael T. Kane,et al.  An argument-based approach to validity. , 1992 .

[9]  B. Schneider,et al.  Standards for Reporting on Empirical Social Science Research in AERA Publications American Educational Research Association , 2006 .

[10]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[11]  William C. McGaghie,et al.  Problem statement, conceptual framework, and research question , 2001 .

[12]  David A Cook,et al.  Reflections on experimental research in medical education , 2010, Advances in health sciences education : theory and practice.

[13]  D. Cook,et al.  Current concepts in validity and reliability for psychometric instruments: theory and application. , 2006, The American journal of medicine.

[14]  R. Frankel,et al.  Evaluating the quality of qualitative research , 1991, Journal of General Internal Medicine.

[15]  Brian Hodges,et al.  Research in Medical Education: Balancing Service and Science* , 2006, Advances in health sciences education : theory and practice.

[16]  Michael Fordis,et al.  Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. , 2006, JAMA.

[17]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[18]  David A. Cook,et al.  Predictive Validity Evidence for Medical Education Research Study Quality Instrument Scores: Quality of Submissions to JGIM’s Medical Education Special Issue , 2008, Journal of General Internal Medicine.

[19]  William C. McGaghie,et al.  The Reputation of Medical Education Research: Quasi-Experimentation and Unresolved Threats to Validity , 2008, Teaching and learning in medicine.

[20]  Matthias Egger,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies , 2007, PLoS medicine.

[21]  T. Hakulinen,et al.  [Presentation of results]. , 1988, Duodecim; laaketieteellinen aikakauskirja.

[22]  D. Borsboom.  Educational Measurement (4th ed.) , 2009 .

[23]  Jean Ker,et al.  Guidelines for evaluating papers on educational interventions , 1999, BMJ.

[24]  Helen Burstin,et al.  A Call for Outcomes Research in Medical Education , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[25]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[26]  J. Tomkowiak,et al.  To IRB or Not to IRB? , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[27]  G. Bordage.  Moving the field forward: going beyond quantitative-qualitative. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[28]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[29]  N. Powe,et al.  A Systematic Review of the Methodological Rigor of Studies Evaluating Cultural Competence Training of Health Professionals , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[30]  J. Drazen,et al.  Full disclosure and the funding of biomedical research. , 2008, The New England journal of medicine.

[31]  David A Cook,et al.  Association between funding and quality of published medical education research. , 2007, JAMA.

[32]  K. Mann,et al.  A RIME Perspective on the Quality and Relevance of Current and Future Medical Education Research , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[33]  D. Prideaux,et al.  Research in medical education: asking the right questions , 2002, Medical education.

[34]  David A Cook,et al.  A systematic review of titles and abstracts of experimental studies in medical education: many informative elements missing. , 2007, Medical education.

[35]  J. Morrison.  Developing research questions in medical education: the science and the art , 2002, Medical education.

[36]  Gang Xu,et al.  A Visitor's Guide to Effect Sizes – Statistical Significance Versus Practical (Clinical) Importance of Research Findings , 2004, Advances in health sciences education : theory and practice.

[37]  H. Schmidt,et al.  Description, justification and clarification: a framework for classifying the purposes of research in medical education , 2008, Medical education.

[38]  D. Cook,et al.  Users' guides to the medical literature: XXIII. Qualitative research in health care B. What are the results and how do they help me care for my patients? Evidence-Based Medicine Working Group. , 2000, JAMA.

[39]  D. Altman,et al.  Multiple significance tests: the Bonferroni method , 1995, BMJ.

[40]  Luc Côté,et al.  Appraising qualitative research articles in medicine and medical education , 2005, Medical teacher.

[41]  J. Shea,et al.  Mind the gap: some reasons why medical education research is different from health services research , 2001, Medical education.

[42]  David W Nierenberg,et al.  Educational epidemiology: applying population-based design and analytic approaches to study medical education. , 2004, JAMA.

[43]  Pamela A. Moss,et al.  Standards for Reporting on Empirical Social Science Research in AERA Publications American Educational Research Association , 2006 .

[44]  Sarah Lord,et al.  When Is Measuring Sensitivity and Specificity Sufficient To Evaluate a Diagnostic Test, and When Do We Need Randomized Trials? , 2006, Annals of Internal Medicine.

[45]  D. Cook,et al.  Users' guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. , 2000, JAMA.

[46]  E. Boyer.  Scholarship Reconsidered: Priorities of the Professoriate , 1990 .

[47]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[48]  Harlan M Krumholz,et al.  Guest authorship and ghostwriting in publications related to rofecoxib: a case study of industry documents from rofecoxib litigation. , 2008, JAMA.

[49]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[50]  Arthur P. Young,et al.  Scholarship assessed: Evaluation of the professoriate , 1998 .

[51]  R. Elliott,et al.  Evolving guidelines for publication of qualitative research studies in psychology and related fields. , 1999, The British journal of clinical psychology.

[52]  I. Olkin,et al.  Meta-analysis of observational studies in epidemiology - A proposal for reporting , 2000 .

[53]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[54]  Steven M Downing,et al.  Reliability: on the reproducibility of assessment data , 2004, Medical education.

[55]  D. Cook.  The Research We Still Are Not Doing: An Agenda for the Study of Computer-Based Learning , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[56]  Medical education and theory-driven research , 1994, Journal of general internal medicine.

[57]  K. Devers.  How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research. , 1999, Health services research.

[58]  Diana H. J. M. Dolmans,et al.  International handbook of research in medical education , 2002 .

[59]  Castl Survey.  The Carnegie Foundation for the Advancement of Teaching , 1910, Nature.

[60]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[61]  S. Downing,et al.  Face validity of assessments: faith‐based interpretations or evidence‐based science? , 2006, Medical education.

[62]  Lorraine Carter,et al.  How to Conduct Surveys: A Step-by-Step Guide , 2010 .

[63]  D. Moher,et al.  Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. , 2008, Annals of internal medicine.

[64]  Don C Des Jarlais,et al.  Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. , 2004, American journal of public health.

[65]  Bruce Thompson,et al.  Research Synthesis: Effect Sizes , 2006 .

[66]  D. Cook,et al.  Developing scholarly projects in education: A primer for medical teachers , 2007, Medical teacher.

[67]  Geoffrey R. Norman,et al.  Biostatistics: The Bare Essentials , 1993 .

[68]  K. Malterud.  Qualitative research: standards, challenges, and guidelines , 2001, The Lancet.

[69]  G Bordage,et al.  Reasons Reviewers Reject and Accept Manuscripts: The Strengths and Weaknesses in Medical Education Reports , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[70]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2007, Preventive medicine.

[71]  D. Cook,et al.  What is the validity evidence for assessments of clinical teaching? , 2005, Journal of General Internal Medicine.

[72]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[73]  Geoffrey R. Norman,et al.  Comprar Biostatistics: The Bare Essentials with CDROM | David L. Streiner | 9781550093476 | BC Decker , 2007 .

[74]  G Bordage,et al.  An outcomes research perspective on medical education: the predominance of trainee assessment and satisfaction , 2001, Medical education.

[75]  Donald L. Kirkpatrick,et al.  Great Ideas Revisited. Techniques for Evaluating Training Programs. Revisiting Kirkpatrick's Four-Level Model. , 1996 .

[76]  Edbert B. Hsu,et al.  Challenges in Systematic Reviews of Educational Intervention Studies , 2005, Annals of Internal Medicine.

[77]  G. Bordage.  Considerations on preparing a paper for publication , 1989 .

[78]  J A Shea,et al.  Toward Setting a Research Agenda for Systematic Reviews of Evidence of the Effects of Medical Education , 2001, Teaching and learning in medicine.

[79]  Norman E. Wallen,et al.  How to Design and Evaluate Research in Education , 1990 .

[80]  G Bordage,et al.  Review criteria for research manuscripts. , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[81]  L. Cronbach,et al.  Designing evaluations of educational and social programs , 1983 .

[82]  Shelby D. Reed,et al.  Economic Implications of Potential Changes to Regulatory and Reimbursement Policies for Medical Devices , 2007, Journal of General Internal Medicine.

[83]  A. Caelleigh,et al.  Reference to the Literature and Documentation , 2001 .

[84]  S. Downing.  Validity: on the meaningful interpretation of assessment data , 2003, Medical education.