A Problem Based Learning Meta Analysis: Differences across Problem Types, Implementation Types, Disciplines, and Assessment Levels.

Problem based learning (PBL) in its most current form originated in Medical Education but has since been used in a variety of disciplines (Savery & Duff y, 1995) at a variety of educational levels (Savery, 2006). Although recent meta analyses have been conducted (Dochy, Segers, Van den Bossche, & Gijbels, 2003; Gijbels, Dochy, Van den Bossche, & Segers, 2005) that attempted to go beyond medical education, they found only one study in economics and were unable to explain large portions of the variance across results. This work builds upon their eff orts as a meta-analysis that crosses disciplines as well as categorizes the types of problems used (Jonassen, 2000), the PBL approach employed (Barrows, 1986), and the level of assessment (Gijbels et al., 2005; Sugrue, 1993, 1995). Across 82 studies and 201 outcomes the fi ndings favor PBL (dw = 0.13, +/.025) with a lack of homogeneity (Q = 954.27) that warrants a closer examination of moderating factors.

[1]  Janet D. Ward,et al.  Teaching Strategies for FCS: Student Achievement in Problem-Based Learning Versus Lecture-Based Instruction. , 2004 .

[2]  Les Firbank,et al.  Intermediate Statistics: A Modern Approach , 1992 .

[3]  C. Silén,et al.  Students' conceptions of underlying principles in medical physiology: an interview study of medical students' understanding in a PBL curriculum. , 2007, Advances in physiology education.

[4]  Tom Ingebritsen,et al.  Problem-based Learning in an On-line Biotechnology Course , 2002 .

[5]  W. Beachey A comparison of problem-based learning and traditional curricula in baccalaureate respiratory therapy education. , 2007, Respiratory care.

[6]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[7]  C. Enarson,et al.  Influence of curriculum type on student performance in the United States Medical Licensing Examination Step 1 and Step 2 exams: problem-based learning vs. lecture-based curriculum. , 2001 .

[8]  B F Richards,et al.  Ratings of students' performances in a third‐year internal medicine clerkship: a comparison between problem‐based and lecture‐based curricula , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[9]  Kimberly Hoffman,et al.  Problem-Based Learning Outcomes: Ten Years of Experience at the University of Missouri—Columbia School of Medicine , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Sally J. Kennedy Learning and transfer compared in two teaching methods: Online problem -based learning and the traditional lecture method , 2007 .

[11]  Susan Hemstreet,et al.  Examining How Middle School Students Use Problem-Based Learning Software. , 1998 .

[12]  S. Bevins,et al.  Clinical Performances of Physical Therapist Students in Problem‐Based, Mixed‐Model, and Traditional Curricula , 2005 .

[13]  John R. Mergendoller,et al.  Comparing Problem-Based Learning and Traditional Instruction in High School Economics , 2000 .

[14]  M. Segers,et al.  Effects of problem-based learning: a meta- analysis , 2003 .

[15]  J. Samet,et al.  The New Mexico experiment: educational innovation and institutional change , 1989, Academic medicine : journal of the Association of American Medical Colleges.

[16]  Amy Ceconi Influence of Problem-Based Learning Instruction on Decision-Making Skills in Respiratory Therapy Students , 2006 .

[17]  R. F. Smith,et al.  Problem‐based Learning in Analytical Science Undergraduate Teaching , 1998 .

[18]  E S Berner,et al.  COMPARISON OF PROBLEM-BASED AND TRADITIONAL EDUCATION ON STUDENT PERFORMANCE IN THE OBSTETRICS AND GYNECOLOGY CLERKSHIP , 1993, Obstetrics and gynecology.

[19]  M. Donnelly,et al.  Knowledge gain in a problem‐based surgery clerkship , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[20]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[21]  Orhan Akinoğlu,et al.  The Effects of Problem-Based Active Learning in Science Education on Students' Academic Achievement, Attitude and Concept Learning. , 2007 .

[22]  James D. Cheaney,et al.  Problem-Based Learning in an Online Course: A Case Study. , 2006 .

[23]  R. Robbs,et al.  A Comparison of Problem-Based Learning and Standard Curriculum Students: Three Years of Retrospective Data , 1998 .

[24]  Ronald L. VanSickle,et al.  Problem-Solving Instruction and Students' Acquisition, Retention and Structuring of Economics Knowledge. , 2000 .

[25]  Finch The effect of problem‐based learning on the academic performance of students studying podiatric medicine in Ontario , 1999, Medical education.

[26]  M. Baron,et al.  A Comparison of Traditional Teaching Methods and Problem-Based Learning in an Addiction Studies Class , 2003 .

[27]  R. Tamblyn,et al.  Problem-based learning : an approach to medical education , 1980 .

[28]  K E Lewis,et al.  The problem-based learning approach in baccalaureate nursing education: how effective is it? , 1987, Nursing papers. Perspectives en nursing.

[29]  K. Glanz,et al.  Problem‐based learning: cognitive retention and cohort traits of randomly selected participants and decliners , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[30]  Gene V. Glass,et al.  Meta-Analysis: The Quantitative Synthesis of Research Findings , 2006 .

[31]  John W. Saye,et al.  Student Engagement with Social Issues in a Multimedia-supported Learning Environment. , 1999 .

[32]  Howard D. White,et al.  SCIENTIFIC COMMUNICATION AND LITERATURE RETRIEVAL , 2019, The Handbook of Research Synthesis and Meta-Analysis.

[33]  J. Mergendoller,et al.  The Effectiveness of Problem-Based Instruction: A Comparative Study of Instructional Methods and Student Characteristics. , 2006 .

[34]  V R Neufeld,et al.  The "McMaster Philosophy": an approach to medical education. , 1974, Journal of medical education.

[35]  David W. Dalton,et al.  Effects of Problem-Based, Networked Hypermedia, and Cooperative Strategies on Visual Literacy Instruction. , 1998 .

[36]  R. Tomczak The Effects of Problem-based Learning on National Board Scores, Clinical Evaluations and Residency Selection of Medical Students , 1991 .

[37]  J. Kaczorowski,et al.  Problem-based small-group learning via the Internet among community family physicians: a randomized controlled trial. , 1999, M.D. computing : computers in medical practice.

[38]  A. Plant,et al.  A Randomized Trial of a Problem‐based Learning Approach for Teaching Epidemiology , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[39]  Stephen Yang Problem-based learning on the World Wide Web in an undergraduate kinesiology class: An integrative approach to education , 2002 .

[40]  Innocent Iheanyichukwu Usoh An investigation into the effectiveness of problem -based learning in an engineering technology program at Nashville State Technical Community College , 2003 .

[41]  David H. Jonassen,et al.  Toward a design theory of problem solving , 2000 .

[42]  E. Lehman,et al.  Differences Between Students in Problem-Based and Lecture-Based Curricula Measured by Clerkship Performance Ratings at the Beginning of the Third Year , 2002, Teaching and learning in medicine.

[43]  Gary J Bouchard The Effect Of A Problem-Based Learning Curriculum On Performance On The Physician Assistant National Certifying Examination , 2004 .

[44]  Thomas M. Duffy,et al.  Problem Based Learning: An instructional model and its constructivist framework , 1995 .

[45]  William R. Shadish,et al.  Combining estimates of effect size. , 1994 .

[46]  Cees P M van der Vleuten,et al.  Does problem‐based learning lead to deficiencies in basic science knowledge? An empirical case on anatomy , 2003, Medical education.

[47]  John D. Bransford,et al.  A theory-driven approach to assessing the cognitive effects of PBL , 1997 .

[48]  Albert J. J. A. Scherpbier,et al.  An Analysis of Progress Test Results of PBL and Non-PBL Students. , 1998 .

[49]  T. Alleyne,et al.  Problem-based compared with traditional methods at the Faculty of Medical Sciences, University of the West Indies: a model study , 2002, Medical teacher.

[50]  J. Tysinger,et al.  Implementing problem-based learning in a family medicine clerkship. , 1998, Family medicine.

[51]  H. Barrows Problem‐based learning in medicine and beyond: A brief overview , 1996 .

[52]  D. C. Tosteson,et al.  New Pathways to Medical Education: Learning To Learn at Harvard Medical School. , 1994 .

[53]  M. F. Tasar,et al.  Eurasia Journal of Mathematics, Science & Technology Education , 2008 .

[54]  Rafa M. Kasim,et al.  What Can Studies of Problem-Based Learning Tell Us? Synthesizing and Modeling PBL Effects on National Board of Medical Examination Performance: Hierarchical Linear Modeling Meta-Analytic Approach , 1999, Advances in health sciences education : theory and practice.

[55]  Brenda Sugrue,et al.  A Theory‐Based Framework for Assessing Domainl‐Specific Problem‐Solving Ability , 2005 .

[56]  Ellen Stevens,et al.  Problem-based learning instruction versus traditional instruction on self-directed learning, motivation, and grades of undergraduate computer science students , 2002 .

[57]  V L Patel,et al.  Effects of conventional and problem‐based medical curricula on problem solving , 1991, Academic medicine : journal of the Association of American Medical Colleges.

[58]  J N Walton,et al.  An outcomes assessment of a hybrid-PBL course in treatment planning. , 1997, Journal of dental education.

[59]  John Pearson Investigating ICT using problem-based learning in face-to-face and online learning environments , 2006, Computers & Education.

[60]  Cindy E. Hmelo-Silver,et al.  Goals and Strategies of a Problem-based Learning Facilitator , 2006 .

[61]  Sevinç Gülseçen,et al.  Teaching ICT to Teacher Candidates Using PBL: A Qualitative and Quantitative Evaluation , 2006, J. Educ. Technol. Soc..

[62]  C. Shuler,et al.  Comparative achievement on National Dental Board Examination Part I between dental students in problem-based learning and traditional educational tracks. , 1998, Journal of dental education.

[63]  J. Colliver Effectiveness of Problem‐based Learning Curricula: Research and Theory , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[64]  Kenneth Gilhooly,et al.  Cognitive psychology and medical diagnosis , 1990 .

[65]  R. Bone,et al.  An experiment in medical education. A critical analysis using traditional criteria. , 1991, JAMA.

[66]  John R. Savery,et al.  Overview of Problem-Based Learning: Definitions and Distinctions. , 2006 .

[67]  D. Langille,et al.  Comparison of problem‐based learning and lecture format in continuing medical education on headache diagnosis and management , 1998, Medical education.

[68]  Charles M. Reigeluth,et al.  Instructional Design Theories and Models : An Overview of Their Current Status , 1983 .

[69]  Howard S. Barrows,et al.  Is it Truly Possible to Have Such a Thing as dPBL? , 2002 .

[70]  H P Boshuizen,et al.  The development of diagnostic competence: comparison of a problem‐based, an integrated, and a conventional medical curriculum , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[71]  K. Mann,et al.  Comparing achievement on the Medical Council of Canada Qualifying Examination Part I of students in conventional and problem‐based learning curricula , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[72]  R. Blake,et al.  Faculty Evaluation of the Clinical Performances of Students in a Problem-Based Learning Curriculum , 1998 .

[73]  Harris Cooper,et al.  Integrating Research: A Guide for Literature Reviews , 1989 .

[74]  A. Sandra Willis,et al.  Problem-Based Learning in a General Psychology Course , 2003 .

[75]  P. R. Gordon,et al.  A Taste of Problem-based Learning Increases Achievement of Urban Minority Middle-School Students. , 2001 .

[76]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[77]  Chun-Yen Chang,et al.  Comparing the Impacts of a Problem-Based Computer-Assisted Instruction and the Direct-Interactive Teaching Method on Student Science Achievement , 2001 .

[78]  Howard S. Barrows,et al.  Large Group Problem-based Learning: A possible solution for the ‘2 sigma problem’ , 1986 .

[79]  Joan L. Anderson Predicting Final GPA of Graduate School Students: Comparing Artificial Neural Networking and Simultaneous Multiple Regression , 2006 .

[80]  D. T. Vernon,et al.  Does problem‐based learning work? A meta‐analysis of evaluative research , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[81]  Assessment of Exam Performance After Change to Problem-Based Learning: Differential Effects by Question Type , 1998 .

[82]  Cindy E. Hmelo-Silver,et al.  Cognitive Transfer Revisited: Can We Exploit New Media to Solve Old Problems on a Large Scale? , 2006 .

[83]  Scott D. Johnson,et al.  Enhancing Electrical Troubleshooting Skills in a Computer-Coached Practice Environment , 1993, Interact. Learn. Environ..

[84]  M. Albanese,et al.  Problem‐based learning: why curricula are likely to show little effect on knowledge and clinical skills , 2000, Medical education.

[85]  Peggy A. Ertmer,et al.  Validity and Problem-Based Learning Research: A Review of Instruments Used to Assess Intended Learning Outcomes , 2016 .

[86]  John R. Mergendoller,et al.  Problem-Based Learning and High School Macroeconomics: A Comparative Study of Instructional Methods , 2005 .

[87]  Jeffrey W Wills,et al.  The Development of Diagnostic Competence: Comparison of a Problem-Based, and Integrated, and a Conventional Medical Curriculum. Schmidt HC, Machiels-Bongaerts M, Hermans H, ten Cate TJ, Venekamp R, Boshuizen HPA. Acad Med. 1996;7:658-664. , 1996 .

[88]  Cindy E. Hmelo,et al.  Problem-Based Learning: Effects on the Early Acquisition of Cognitive Skill in Medicine , 1998 .

[89]  C. Shuler,et al.  Problem-based learning versus a traditional educational methodology: a comparison of preclinical and clinical periodontics performance. , 2005, Journal of dental education.

[90]  S. Kalishman,et al.  Performances on the NBME I, II, and III by medical students in the problem‐based learning and conventional tracks at the University of New Mexico , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[91]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[92]  W B Spaulding,et al.  The undergraduate medical curriculum (1969 model): McMaster university. , 1969, Canadian Medical Association journal.

[93]  M. Bovée,et al.  Comparison of two teaching methods in a chiropractic clinical science course. , 2000, Journal of allied health.

[94]  F. van Dijk,et al.  Problem-based learning versus lecture-based learning in postgraduate medical education. , 2003, Scandinavian journal of work, environment & health.

[95]  H F Claessen,et al.  Recall of medical information by students and doctors , 1985, Medical education.

[96]  C. Woodward,et al.  Unravelling the meaning of global comparative ratings of interns. , 1981, Annual Conference on Research in Medical Education. Conference on Research in Medical Education.

[97]  L. Berkson Problem‐based learning: have the expectations been met? , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[98]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[99]  Robyn Tamblyn,et al.  An Evaluation of Problem-Based Learning in Small Groups Utilizing a Simulated Patient. , 1976 .

[100]  R. W. Smith,et al.  Problem-based ACLS instruction: a model approach for undergraduate emergency medical education. , 1989, Annals of emergency medicine.

[101]  Robert G. Petersdorf,et al.  The undergraduate medical curriculum , 1992, Journal of General Internal Medicine.

[102]  J. C. Donovan,et al.  An independent study program within a medical curriculum. , 1977, Journal of medical education.

[103]  Huantian Cao,et al.  Multimedia and Problem-Based Instruction in the Textiles Laboratory , 2005 .

[104]  James P. Stevens,et al.  Intermediate Statistics: A Modern Approach , 1990 .

[105]  M. Segers,et al.  Effects of problem-based learning: a meta- analysis , 2003 .

[106]  B. Ransil,et al.  Assessment of preclinical problem-based learning versus lecture-based learning. , 1997, Journal of dental education.

[107]  S. Kalishman,et al.  Residency performance of graduates from a problem‐based and a conventional curriculum , 1990, Medical education.

[108]  Harris Cooper,et al.  Integrating research: A guide for literature reviews, 2nd ed. , 1989 .

[109]  Shelagh A. Gallagher,et al.  Content Acquisition in Problem-Based Learning: Depth versus Breadth in American Studies , 1996 .

[110]  D Mårtenson,et al.  Medical chemistry: evaluation of active and problem‐oriented teaching methods , 1985, Medical education.

[111]  M. McGee A comparison of traditional learning and problem-based learning in pharmacology education for athletic training students , 2003 .

[112]  Brenda Sugrue Specifications for the Design of Problem-Solving Assessments in Science. Project 2.1. Designs for Assessing Individual and Group Problem-Solving. , 1993 .

[113]  R B Haynes,et al.  Effect of problem-based, self-directed undergraduate education on life-long learning. , 1993, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[114]  A. Paton,et al.  Medical education 2000. , 1987, Postgraduate medical journal.

[115]  M. Albanese,et al.  Problem‐based Learning: A Review of Literature on Its Outcomes and Implementation Issues , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[116]  W. Antepohl,et al.  Problem‐based learning versus lecture‐based learning in a course of basic pharmacology: a controlled, randomized study , 1999, Medical education.

[117]  H S Barrows,et al.  A taxonomy of problem‐based learning methods , 1986, Medical education.

[118]  C. Woodward,et al.  A randomized controlled trial assessing the impact of problem-based versus didactic teaching methods in CME. , 1988, Research in medical education : proceedings of the ... annual Conference. Conference on Research in Medical Education.

[119]  M. Donnelly,et al.  Developing students' cognitive skills in a problem‐based surgery clerkship , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[120]  Arthur Kaufman,et al.  Implementing problem-based medical education : lessons from successful innovations , 1985 .