A Research Synthesis of the Effectiveness, Replicability, and Generality of the VaNTH Challenge‐based Instructional Modules in Bioengineering

Background Between 2000 and 2006 the Vanderbilt, Northwestern, Texas and Harvard/MIT Engineering Research Center (VaNTH/ERC) developed, tested, and implemented a set of educational innovations based largely on the ideas presented in the book How People Learn (HPL) and an instructional design known as the the STAR Legacy Cycle. The motivation for this study was to synthesize the results of this work. Published and unpublished experimental and quasi-experimental assessments were included in this synthesis. Purpose (Hypothesis) The fundamental hypotheses tested were whether a set of modules involving challenge-based instruction and other course innovations, often involving advanced computer-based technologies, improved student performance in a variety of educational settings and student populations, and whether improvements could be achieved by instructors other than the developers of the innovations. Design/Method Meta-analysis of effects from thirty-three separate modules in five courses in bioengineering domains was undertaken, along with three case studies. Results Results from the experimental (randomized) and stronger-quasi experimental studies revealed a weighted effect size of 0.655 (p < 0.001). Studies using randomized designs produced smaller effects, and studies using measures of transfer and adaptive expertise to index outcomes produced larger effects. Analyses also revealed that the results can be replicated by instructors other than the developers of the modules, in a variety of student populations and educational settings, and at other institutions. Conclusions Overall, the challenge-based modules and other innovations have moderate overall effects on improved student performance. They can be implemented successively by other instructors in a variety of educational settings and student populations.

[1]  Taylor Martin,et al.  Teaching for adaptive expertise in biomedical engineering ethics , 2005, Science and engineering ethics.

[2]  Michael J. Prince,et al.  Inductive Teaching and Learning Methods: Definitions, Comparisons, and Research Bases , 2006 .

[3]  Larry Howard.  Adaptive learning technologies for bioengineering education. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[4]  Sean P Brophy,et al.  Challenge-based instruction in biomedical engineering: a scalable method to increase the efficiency and effectiveness of teaching and learning in biomedical engineering. , 2005, Medical engineering & physics.

[5]  Sean Brophy,et al.  Effectiveness of Challenge‐Based Instruction in Biomechanics , 2006 .

[6]  Ann F. McKenna,et al.  Inquiry-based Laboratory Instruction Throws Out the "Cookbook" and Improves Learning , 2003 .

[7]  J. Colliver.  Effectiveness of Problem‐based Learning Curricula: Research and Theory , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[8]  Sean Brophy,et al.  Implementation And Assessment Of Challenge Based Instruction In A Biomedical Optics Course , 2003 .

[9]  Robert D. Sherwood,et al.  Biomedical Engineering and Cognitive Science as the Basis for Secondary Science Curriculum Development: A Three Year Study , 2005 .

[10]  Sean P Brophy,et al.  Roles for learning sciences and learning technologies in biomedical engineering education: a review of recent advances. , 2002, Annual review of biomedical engineering.

[11]  Melissa J. Geist,et al.  The effect of a bioengineering unit across high school contexts: An initial investigation in urban, suburban, and rural domains , 2006 .

[12]  Joseph V. Bonventre,et al.  2006-2162: NOVEL MODULE IMPROVES INTERDISCIPLINARY LEARNING OF GLOMERULAR FILTRATION , 2006 .

[13]  M. Segers,et al.  Effects of problem-based learning: a meta- analysis , 2003 .

[14]  D.S. Cordray,et al.  The value of the VaNTH Engineering Research Center , 2003, IEEE Engineering in Medicine and Biology Magazine.

[15]  Bugrahan Yalvac,et al.  Teaching writing in a laboratory‐based engineering course with a “How People Learn” framework , 2006 .

[16]  Ann F. McKenna,et al.  Evaluation of a Challenge‐based Human Metabolism Laboratory for Undergraduates , 2008 .

[17]  John H. Newman,et al.  Instructional Module in Fourier Spectral Analysis, Based on Principles of “How People Learn” , 2003 .

[18]  Thomas R. Harris,et al.  AC 2007-1712: "WHAT WORKS" IN ENGINEERING EDUCATION? A META-ANALYSIS OF VANTH/ERC BIOMEDICAL ENGINEERING MODULES , 2007 .

[19]  Marcus G. Pandy,et al.  Assessing Adaptive Expertise in Undergraduate Biomechanics , 2004 .

[20]  M. Segers,et al.  Effects of problem-based learning: a meta- analysis , 2003 .

[21]  Taylor Martin,et al.  Comparison of Student Learning in Challenge-based and Traditional Instruction in Biomedical Engineering , 2007, Annals of Biomedical Engineering.

[22]  Thomas R. Harris,et al.  A Closer Look At The Vanth/Erc Biomedical Engineering Modules: A Method To Examine The Effects Of Selected Core Components Of The “Legacy Cycle” And Hpl Model , 2007 .

[23]  Marlene Scardamalia,et al.  Computer-Supported Intentional Learning Environments , 1989 .

[24]  Daniel L. Schwartz,et al.  Software for managing complex learning: Examples from an educational psychology course , 1999 .

[25]  R. Barr,et al.  Challenge-based instruction: the VaNTH biomechanics learning modules , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[26]  Jimmy Nguyen,et al.  Development of Online Ultrasound Instructional Module and Comparison to Traditional Teaching Methods , 2002 .

[27]  Ronald E. Barr,et al.  Classroom Testing Of Vanth Biomechanics Learning Modules , 2004 .