The impact of a simulation-based learning design project on student learning

This study examined the effects of a sophisticated simulation-based task on students' learning of course-related content, ability to deal with complex, open-ended problems, and attitudes toward the Interactive Site Investigation Software (ISIS) and the course. Students were required to conduct a hazardous waste site investigation using the simulation software designed specifically for the course. ISIS simulated physical processes as well as real-world engineering processes. Assessment of student outcomes was based on the use of constructed-response knowledge maps to measure content understanding, and surveys to measure student attitudes and use of cognitive processes. Students reported very positive attitudes toward the ISIS experience, appeared to have gained substantial knowledge over the course of ISIS use, and perceived the ISIS activity as being generally effective in improving their skills in dealing with complex projects, linking theory to real world applications, and improving their problem-solving performance. Our assessment of student outcomes was a successful first attempt, but more work is needed to validate our measures with advanced students, particularly when the task is complex and requires interdisciplinary knowledge.

[1]  Michael McCracken,et al.  Assessment and evaluation in problem-based learning , 1997, Proceedings Frontiers in Education 1997 27th Annual Conference. Teaching and Learning in an Era of Change.

[2]  D. C. Hughes,et al.  Getting at deep learning: a problem-based approach , 1994 .

[3]  W.A. Wulf.  How shall we satisfy the long-term educational needs of engineers? , 2000, Proceedings of the IEEE.

[4]  Gregory K. W. K. Chung,et al.  Computer-Based Collaborative Knowledge Mapping To Measure Team Processes and Team Outcomes. , 1999 .

[5]  Cynthia J. Atman,et al.  A design attribute framework for course planning and learning assessment , 2000, IEEE Trans. Educ..

[6]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[7]  Flora P. McMartin,et al.  Methods to improve the validity and sensitivity of a self/peer assessment instrument , 2000, IEEE Trans. Educ..

[8]  Ronald L. Miller,et al.  Defining the outcomes: a framework for EC-2000 , 2000, IEEE Trans. Educ..

[9]  Flora P. McMartin,et al.  Establishing the trustworthiness of scenario assignments as assessment tools for undergraduate engineering education , 1999, FIE'99 Frontiers in Education. 29th Annual Frontiers in Education Conference. Designing the Future of Science and Engineering Education. Conference Proceedings (IEEE Cat. No.99CH37011.

[10]  E. W. Banios.  Teaching engineering practices , 1991, Proceedings Frontiers in Education Twenty-First Annual Conference. Engineering Education in a New World Order.

[11]  Charles M. Vest.  Engineering Education for a Changing World , 1992 .

[12]  A. Agogino,et al.  Capturing student's teamwork and open-ended design performance in an undergraduate multimedia engineering design class , 1998, FIE '98. 28th Annual Frontiers in Education Conference. Moving from 'Teacher-Centered' to 'Learner-Centered' Education. Conference Proceedings (Cat. No.98CH36214).

[13]  Richard A. Volz,et al.  Performance theory based outcome measurement in engineering education and training , 2000, IEEE Trans. Educ..

[14]  Cynthia J. Atman,et al.  Concept maps for engineering education: a cognitively motivated tool supporting varied assessment functions , 2000, IEEE Trans. Educ..

[15]  W. C. Newstetter,et al.  A developmental approach to assessing design skills and knowledge , 1997, Proceedings Frontiers in Education 1997 27th Annual Conference. Teaching and Learning in an Era of Change.

[16]  E. Baker,et al.  Construct Validation of an Approach to Modeling Cognitive Structure of U.S. History Knowledge , 1996 .

[17]  Ah Nash.  Engineering Education for a Changing World , 1976 .

[18]  J. Heywood.  Problems in the design of assessment led curricula , 1999, FIE'99 Frontiers in Education. 29th Annual Frontiers in Education Conference. Designing the Future of Science and Engineering Education. Conference Proceedings (IEEE Cat. No.99CH37011.

[19]  J.L. Newcomer.  Design: the future of engineering and engineering technology education , 1999, FIE'99 Frontiers in Education. 29th Annual Frontiers in Education Conference. Designing the Future of Science and Engineering Education. Conference Proceedings (IEEE Cat. No.99CH37011.

[20]  Robert Waters,et al.  Why? When an otherwise successful intervention fails , 1999, ITiCSE '99.

[21]  M. Cline,et al.  Problem based learning via open ended projects in Carnegie Mellon University's Chemical Engineering undergraduate laboratory , 1997, Proceedings Frontiers in Education 1997 27th Annual Conference. Teaching and Learning in an Era of Change.

[22]  Patrice Frison,et al.  Resources, tools, and techniques for problem based learning in computing , 1998, ITiCSE-WGR '98.

[23]  R. L. Mertz.  A capstone design course [electrical engineering] , 1997 .

[24]  J. E. Seat,et al.  Making design teams work , 1996, Technology-Based Re-Engineering Engineering Education Proceedings of Frontiers in Education FIE'96 26th Annual Conference.

[25]  David H. Jonassen,et al.  Structural Knowledge: Techniques for Representing, Conveying, and Acquiring Structural Knowledge , 1993 .

[26]  B. M. Aller.  "Just like they do in industry": Concerns about teamwork practices in engineering design courses , 1993, Proceedings of IEEE Frontiers in Education Conference - FIE '93.

[27]  B. Bond,et al.  The difficult part of capstone design courses , 1995, Proceedings Frontiers in Education 1995 25th Annual Conference. Engineering Education for the 21st Century.

[28]  D. Jacobson,et al.  Ten myths of cooperative learning in engineering education , 1998, FIE '98. 28th Annual Frontiers in Education Conference. Moving from 'Teacher-Centered' to 'Learner-Centered' Education. Conference Proceedings (Cat. No.98CH36214).

[29]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[30]  W.T. Neumann,et al.  A comparison of alternative approaches to the capstone experience: case studies versus collaborative projects , 1998, FIE '98. 28th Annual Frontiers in Education Conference. Moving from 'Teacher-Centered' to 'Learner-Centered' Education. Conference Proceedings (Cat. No.98CH36214).

[31]  B. Helland,et al.  Assessment techniques for a learning-centered curriculum: evaluation design for Adventures in Supercomputing , 1996, Technology-Based Re-Engineering Engineering Education Proceedings of Frontiers in Education FIE'96 26th Annual Conference.

[32]  M.S. Trevisan,et al.  Assessing students design capabilities in an introductory design class , 1999, FIE'99 Frontiers in Education. 29th Annual Frontiers in Education Conference. Designing the Future of Science and Engineering Education. Conference Proceedings (IEEE Cat. No.99CH37011.

[33]  Robert L. Mertz,et al.  A Capstone Design Course , 1997 .