Assessing impacts of a learning-cycle-based module on students' conceptual sustainability knowledge using concept maps and surveys

Abstract As engineers will be the designers of projects that will have lasting economic, environmental, and social impacts, it is important to ensure that students are equipped with the necessary conceptual knowledge to engage in sustainable design. Reforms in engineering education are needed to ensure that sustainability content is included in undergraduate curricula. In addition, previous work has demonstrated that beyond curricular content, innovative pedagogical approaches are also important for enhancing student learning. The goal of this work was to examine the impacts of a learning-cycle-based sustainability module on students' conceptual understanding of sustainability. The module was integrated into a senior-level, civil and environmental engineering capstone design course at a large, research-intensive university in the southeastern United States. Concept maps and student self-report surveys were used to compare learning gains for students in the modified design course (intervention cohort) to those in the traditional design course (control cohort). Concept map results indicated that improvements in knowledge depth, breadth, and interconnectedness were significantly greater for the intervention, as compared to the control cohort. Furthermore, while both cohorts initially over-emphasized the environmental dimension of sustainability, only those students in the intervention cohort demonstrated a more balanced understanding of sustainability at the end of the course. Survey results did not show the significant learning gains seen in concept maps, but it is expected that students' survey responses were biased by their negative perceptions of the module itself at the end of the semester. Future module implementations, which can be adapted for a variety of engineering and even non-engineering disciplines, should ensure more complete integration into the target course to improve student perceptions of the learning experience. Overall, this study provides theoretically-grounded, empirically-tested learning materials and assessment methods than can be adapted in other engineering courses.

[1]  N. Dixon,et al.  The Kolb Model Modified for Classroom Activities , 1987 .

[2]  Angela R. Bielefeldt Incorporating a Sustainability Module into First-Year Courses for Civil and Environmental Engineering Students , 2011 .

[3]  Anna L. Carew,et al.  Teaching sustainability as a contested concept: capitalizing on variation in engineering educators' conceptions of environmental, social and economic sustainability , 2008 .

[4]  Paul Cobb,et al.  Constructivist, emergent, and sociocultural perspectives in the context of developmental research , 1996 .

[5]  Karel Mulder,et al.  What do EESD “experts” think sustainability is? Which pedagogy is suitable to learn it?: Results from interviews and Cmaps analysis gathered at EESD 2008 , 2012 .

[6]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[7]  Mary Katherine Watson,et al.  Student Perceptions of Sustainability Education in Civil and Environmental Engineering at the Georgia Institute of Technology , 2013 .

[8]  Mary Besterfield-Sacre,et al.  Scoring Concept Maps: An Integrated Rubric for Assessing Engineering Education , 2004 .

[9]  Michael J. Prince,et al.  Inductive Teaching and Learning Methods: Definitions, Comparisons, and Research Bases , 2006 .

[10]  A. Wals,et al.  Convergence Between Science and Environmental Education , 2014, Science.

[11]  Mary Katherine Watson,et al.  Assessment and improvement of sustainability education in civil and environmental engineering , 2013 .

[12]  Robert L. Nagel,et al.  An Innovative Two-Year Engineering Design Capstone Experience at James Madison University , 2013 .

[13]  Sabina Kleitman,et al.  Ecological and person-oriented aspects of metacognitive processes in test-taking. , 2001 .

[14]  Eric Williams,et al.  Adding sustainability to the engineer's toolbox: a challenge for engineering educators. , 2007, Environmental science & technology.

[15]  Maria Araceli Ruiz-Primo,et al.  On the Use Of Concept Maps As An Assessment Tool in Science: What We Have Learned so Far 1 El uso de mapas conceptuales como instrumento de evaluación del aprovechamiento en ciencias: lo que sabemos hasta ahora , 2000 .

[16]  Matías Recabarren,et al.  Modifying the Student's Resistance Towards Active Learning with More Active-learning , 2015 .

[17]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[18]  M. Barth,et al.  Higher Education for Sustainable Development: Students’ Perspectives on an Innovative Approach to Educational Change , 2011 .

[19]  Gloria Gomez,et al.  CmapTools: A Knowledge Modeling and Sharing Environment , 2004 .

[20]  Virginia P Sisiopiku,et al.  Introducing Sustainability into the Civil Engineering Curriculum , 2015 .

[21]  Ding Yuan,et al.  Incorporating Sustainable Engineering Design Principles into Senior Design Proposals , 2015 .

[22]  Magdalena Svanström,et al.  Assessing “Wicked Sustainability Problem” – Literacy in Engineering Education , 2015 .

[23]  D. Kolb,et al.  Experiential Learning Theory: Previous Research and New Directions , 2000 .

[24]  Nathalie Lourdel,et al.  Sustainable development cognitive map: a new method of evaluating student understanding , 2007 .

[25]  R. Shavelson,et al.  Problems and Issues in the Use of Concept Maps in Science Assessment. , 1996 .

[26]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[27]  Mary Lundeberg,et al.  Cultural influences on confidence : Country and gender , 2000 .

[28]  S. Martin,et al.  Sustainability, Systems Thinking and Professional Practice , 2005 .

[29]  G. Tuncer,et al.  University Students' Perception on Sustainable Development: A Case Study from Turkey , 2008 .

[30]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[31]  J. Novak The Theory Underlying Concept Maps and How To Construct Them , 2004 .

[32]  Thomas P. Seager,et al.  Sustainable Engineering Science for Resolving Wicked Problems , 2012 .

[33]  John N. Harb,et al.  Use of the Kolb Learning Cycle and the 4MAT System in Engineering Education , 1993 .

[34]  Caroline R. Noyes,et al.  Use of Concept Maps to Assess Student Sustainability Knowledge , 2014 .

[35]  H. Suen,et al.  Concept Map Assessment of Classroom Learning: Reliability, Validity, and Logistical Practicality , 1999 .

[36]  Karel Mulder,et al.  Conceptual maps: measuring learning processes of engineering students concerning sustainable development , 2008 .

[37]  J. Fitzpatrick Encyclopedia of nursing research , 1998 .

[38]  Michael O. Rodgers,et al.  Assessing Conceptual Knowledge Using Three Concept Map Scoring Methods , 2016 .

[39]  Paul D. Eggen,et al.  Educational Psychology: Windows on Classrooms , 1998 .

[40]  Phillip C. Wankat,et al.  Teaching Engineering , 1992 .

[41]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[42]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[43]  Lisa D. McNair,et al.  Using Concept Maps to Assess Interdisciplinary Integration of Green Engineering Knowledge. , 2009 .

[44]  Henry Lester Smith,et al.  Educational research, principles and practices , 1944 .

[45]  Aman Yadav,et al.  Problem‐based Learning: Influence on Students' Learning in an Electrical Engineering Course , 2011 .

[46]  Elise Barrella,et al.  Comparing the Outcomes of Horizontal and Vertical Integration of Sustainability Content into Engineering Curricula Using Concept Maps , 2016 .

[47]  Karel Mulder,et al.  What do engineering students learn in sustainability courses? The effect of the pedagogical approach , 2010 .

[48]  Michael O. Rodgers,et al.  Assessing curricula contribution to sustainability more holistically: Experiences from the integration of curricula assessment and students' perceptions at the Georgia Institute of Technology , 2013 .

[49]  Ulrich Steger,et al.  The Business Case for Corporate Sustainability:: Literature Review and Research Options , 2005 .

[50]  Cynthia J. Atman,et al.  Concept maps for engineering education: a cognitively motivated tool supporting varied assessment functions , 2000, IEEE Trans. Educ..

[51]  R. Shavelson,et al.  On the Validity of Cognitive Interpretations of Scores From Alternative Concept-Mapping Techniques , 2001 .

[52]  Rodrigo Lozano,et al.  Assessing Cardiff University’s Curricula Contribution to Sustainable Development Using the STAUNCH(RTM) System , 2011 .

[53]  F. Kagawa Dissonance in Students' Perceptions of Sustainable Development and Sustainability: Implications for Curriculum Change. , 2007 .

[54]  Julie E. Mills,et al.  Engineering Education, Is Problem-Based or Project-Based Learning the Answer , 2003 .