Problem statement, conceptual framework, and research question

Following the common IMRaD format for scientific research reports, the authors present review criteria and discuss background information and issues related to the review criteria for each section of a research report. Introduction. The authors discuss the criteria reviewers should be aware of for establishing the context for the research study: prior literature to introduce and describe the problem statement, the conceptual framework (theory) underlying the problem, the relevance of the research questions, and the justification of their research design and methods. Method. The authors discuss a variety of methods used to advance knowledge and practice in the health professions, including quantitative research on educational interventions, qualitative observational studies, test and measurement development projects, case reports, expository essays, and quantitative and qualitative research synthesis. As background information for reviewers, the authors discuss how investigators use these and other methods in concert with data-collection instruments, samples of research participants, and data-analysis procedures to address educational, policy, and clinical questions. The authors explain the key role that research methods play in scholarship and the role of the reviewer in judging their quality, details, and richness. Results. The author describes issues related to reporting statistical analyses in the results, particularly data that do not have many of the properties that were anticipated when the data analysis was planned. Further, the author discusses the presentation of the body of evidence collected within the study, offering information for reviewers on evaluating the selection and organization of data, the balance between descriptive and inferential statistics, narrative presentation, contextualization of qualitative data, and the use of tables and figures. Discussion. The authors provide information to enable reviewers to evaluate whether the interpretation of the evidence is adequately discussed and appears reliable, valid, and trustworthy. Further, they discuss how reviewers can weigh interpretations, given the strengths and limitations of the study, and can judge the generalizability and practical significance of conclusions drawn by investigators. Title, authors, and abstract. The author discusses a reviewer’s responsibility in judging the title, authors, and abstract of a manuscript submitted for publication. While this triad orients the reader at the beginning of the review process, only after the manuscript is analyzed thoroughly can these elements be effectively evaluated. Other. The authors discuss the reviewer’s role in evaluating the clarity and effectiveness of a study’s written presentation and issues of scientific conduct (plagiarism, proper attribution of ideas and materials, prior publication, conflict of interest, and institutional review board approval). Acad. Med. 2001;76:922–951.

[1]  P. Ranelli,et al.  Writing for Social Scientists; How To Start and Finish Your Thesis, Book, or Article , 1989 .

[2]  Diana H. J. M. Dolmans,et al.  International handbook of research in medical education , 2002 .

[3]  Janet Newkirk Medical Writing: the Technic and the Art , 1949 .

[4]  L. Roberts,et al.  An Invitation for Medical Educators to Focus on Ethical and Policy Issues in Research and Scholarly Practice , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[5]  R. Riegelman Studying a Study and Testing a Test: How to Read the Medical Literature , 1981 .

[6]  A. Caelleigh Role of the journal editor in sustaining integrity in research , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[7]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[8]  A. Overbeke,et al.  [The structured summary: a tool for reader and author]. , 1990, Nederlands tijdschrift voor geneeskunde.

[9]  J Froom,et al.  Deficiencies in structured medical abstracts. , 1993, Journal of clinical epidemiology.

[10]  P. Meehl Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. , 1978 .

[11]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[12]  E. Brunswik Systematic and Representative Design of Psychological Experiments. With Results in Physical and Social Perception , 1949 .

[13]  D. Rennie,et al.  Prevalence of articles with honorary authors and ghost authors in peer-reviewed medical journals. , 1998, JAMA.

[14]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[15]  D. Rosenhan On being sane in insane places , 1973, Science.

[16]  Gregory P. Lee Methodological Issues and Strategies in Clinical Research—edited by Alan E. Kazdin; Washington, D.C., American Psychological Association, 1992, 765 pages, $59.95 hardcover, $39.95 paperbound , 1992 .

[17]  J H Gibbon,et al.  The Inquiring Mind. , 1949, Annals of surgery.

[18]  E. Huth,et al.  Guidelines on authorship of medical papers. , 1986, Annals of internal medicine.

[19]  F Godlee,et al.  Definition of “authorship” may be changed , 1996, BMJ.

[20]  S. Goodman,et al.  Do readers and peer reviewers agree on manuscript quality? , 1994, JAMA.

[21]  William H. Barker,et al.  CLINICAL EPIDEMIOLOGY: THE ESSENTIALS. , 1984 .

[22]  T R Einarson,et al.  Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[23]  Questionnaire construction and question writing for research in medical education. , 1988, Medical education.

[24]  B. Maher,et al.  Stimulus sampling in clinical research: representative design reviewed. , 1978, Journal of consulting and clinical psychology.

[25]  P. Rochon,et al.  Studying a Study and Testing a Test: How to Read the Health Science Literature , 1997, Journal of the Royal College of Physicians of London.

[26]  Daniel C. West,et al.  Critical thinking in graduate medical education: A role for concept mapping assessment? , 2000, JAMA.

[27]  B. Dawson-Saunders,et al.  Basic and Clinical Biostatistics , 1993 .

[28]  D. Rennie CONSORT revised--improving the reporting of randomized trials. , 2001, JAMA.

[29]  E. Huth,et al.  Structured abstracts for papers reporting clinical trials. , 1987, Annals of internal medicine.

[30]  Medical journal editors' uniform requirements for manuscripts submitted to biomedical journals. , 2003, Journal of wound care.

[31]  Mimi Zeiger,et al.  Essentials of Writing Biomedical Research Papers , 1991 .

[32]  Norman E. Wallen,et al.  How to Design and Evaluate Research in Education , 1990 .

[33]  R. Fincher,et al.  Comparison of ambulatory knowledge of third‐year students who learned in ambulatory settings with that of students who learned in inpatient settings , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[34]  D F Horrobin,et al.  The philosophical basis of peer review and the suppression of innovation. , 1990, JAMA.

[35]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[36]  W C McGaghie,et al.  Quantitative concept mapping in pulmonary physiology: comparison of student and faculty knowledge structures. , 2000, Advances in physiology education.

[37]  R M Pitkin,et al.  Accuracy of data in abstracts of published research articles. , 1999, JAMA.

[38]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[39]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[40]  M. Shapiro,et al.  The contributions of authors to multiauthored biomedical research papers. , 1994, JAMA.

[41]  Stephen B. Gruber,et al.  Clinical Epidemiology: The Architecture of Clinical Research , 1986, The Yale Journal of Biology and Medicine.

[42]  Warren S. Browner,et al.  Publishing and presenting clinical research , 1999 .

[43]  W. McGaghie,et al.  Medical and Veterinary Students' Structural Knowledge of Pulmonary Physiology Concepts , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[44]  P. A. Martin Writing a useful literature review for a quantitative research project. , 1997, Applied nursing research : ANR.

[45]  R. Slone Coauthors' contributions to major papers published in the AJR: frequency of undeserved coauthorship. , 1996, AJR. American journal of roentgenology.

[46]  W. Eyler Uniform requirements for manuscripts submitted to biomedical journals. , 1980, Canadian Medical Association journal.

[47]  Philip J. Schmeider Stealing into Print: Fraud, Plagiarism, and Misconduct in Scientific Publishing , 1993 .

[48]  K. R. Hammond Human judgment and social policy , 1980 .

[49]  A. Parry Handbook of Qualitative Research , 2002 .

[50]  David A. Erlandson Doing Naturalistic Inquiry: A Guide to Methods , 1993 .

[51]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[52]  W. McGaghie,et al.  Development and evaluation of musculoskeletal performance measures for an objective structured clinical examination , 1994 .

[53]  S B Thacker,et al.  A proposal for more informative abstracts of review articles. , 1988, Annals of internal medicine.

[54]  K. Haller Conducting A Literature Review , 1988, MCN. The American journal of maternal child nursing.

[55]  W. B. Fye Medical authorship: traditions, trends, and tribulations. , 1990, Annals of internal medicine.

[56]  R. Rosenfeld The Seven Habits of Highly Effective Data Users , 1998, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[57]  T. Mizrahi,et al.  Getting rid of patients : contradictions in the socialization of physicians , 1987 .

[58]  A. Peshkin The Goodness of Qualitative Research , 1993 .

[59]  Jacob Cohen The earth is round (p < .05) , 1994 .

[60]  Stephen H. Gehlbach,et al.  Interpreting the medical literature , 1988 .

[61]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[62]  Corrine Glesne,et al.  Becoming Qualitative Researchers: An Introduction , 1991 .

[63]  H. Barrows Simulated patients in medical teaching. , 1968, Canadian Medical Association journal.

[64]  J. Williams Children of Crisis, A study of courage and fear , 1968 .

[65]  A. Sockloff,et al.  Statistical power analysis for the behavioral sciences: (revised edition), by Jacob Cohen. New York: Academic Press, 1977, xv + 474 pp., $24.50. , 1978 .

[66]  유창조 Naturalistic Inquiry , 2022, The SAGE Encyclopedia of Research Design.

[67]  J. Drenth,et al.  Multiple authorship: the contribution of senior authors. , 1998, JAMA.

[68]  M. Lecompte,et al.  Ethnography and Qualitative Design in Educational Research , 1984 .

[69]  A. Peshkin The Color of Strangers, the Color of Friends: The Play of Ethnicity in School and Community , 1991 .

[70]  A. Overbeke,et al.  What are the factors determining authorship and the order of the authors' names? A study among authors of the Nederlands Tijdschrift voor Geneeskunde (Dutch Journal of Medicine). , 1998, JAMA.

[71]  Robert A. Day Scientific English: A Guide for Scientists and Other Professionals , 1992 .

[72]  J. Millman,et al.  The specification and development of tests of achievement and ability. , 1989 .

[73]  Warburton Sw,et al.  Should patients in quality-improvement activities have the same protections as participants in research studies? , 2000, JAMA.

[74]  David B. Swanson,et al.  Assessment of clinical skills with standardized patients: State of the art , 1990 .

[75]  M. Knowles The Modern Practice of Adult Education: From Pedagogy to Andragogy , 1970 .

[76]  H.B. Michaelson,et al.  How to write and publish a scientific paper , 1981, Proceedings of the IEEE.

[77]  I Chalmers,et al.  Underreporting research is scientific misconduct. , 1990, JAMA.

[78]  Lois Ann Colaianni,et al.  UNIFORM REQUIREMENTS FOR MANUSCRIPTS SUBMITTED TO BIOMEDICAL JOURNALS , 2000 .

[79]  I. Olkin,et al.  Meta-analysis of observational studies in epidemiology - A proposal for reporting , 2000 .

[80]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[81]  Thomas J. Williams Choosing the Right Stuff: The Psychological Selection of Astronauts and Cosmonauts , 1995 .

[82]  R. Glass,et al.  What does authorship mean in a peer-reviewed medical journal? , 1996, JAMA.

[83]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[84]  D. C. Howell Statistical Methods for Psychology , 1987 .

[85]  Samuel Shye,et al.  Introduction to Facet Theory: Content Design and Intrinsic Data Analysis in Behavioral Research , 1994 .

[86]  L. Delbeke Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[87]  W. Barclay,et al.  Forgive and Remember: Managing Medical Failure , 1979 .

[88]  Edward J. Huth,et al.  Writing and Publishing in Medicine , 1999 .

[89]  Elspeth Finch,et al.  A Qualitative Study Identifying Stressors Associated With Adapting to Problem-Based Learning , 1998 .

[90]  E. Epstein,et al.  Boys in White: Student Culture in Medical School , 1962 .

[91]  C. Lambert From Proposal to Publication: an Informal Guide to Writing About Nursing Research , 1989 .

[92]  Z. Bankowski,et al.  Council for International Organizations of Medical Sciences , 1991 .

[93]  W. McGaghie,et al.  Handbook for the Academic Physician , 1986 .

[94]  R M Pitkin,et al.  Can the accuracy of abstracts be improved by providing specific instructions? A randomized controlled trial. , 1998, JAMA.

[95]  D. Rennie,et al.  When authorship fails. A proposal to make contributors accountable. , 1997, JAMA.

[96]  Samuel T. Mayo,et al.  Statistical methods in education and psychology , 1979 .