A methodology for improving active learning engineering courses with a large number of students and teachers through feedback gathering and iterative refinement

In the last decade, engineering education has evolved in many ways to meet society demands. Universities offer more flexible curricula and put a lot of effort on the acquisition of professional engineering skills by the students. In many universities, the courses in the first years of different engineering degrees share program and objectives, having a large number of students and teachers. These common courses are expected to provide the students with meaningful learning experiences, which could be achieved by using active learning. The use of active learning in engineering courses improves traditional teaching by promoting students’ participation and engagement, although active learning courses can be very sensitive to differences in learning paces or team conflicts; this being a challenge for the widespread adoption of active learning in courses with many students and teachers. This paper proposes a methodology that facilitates the detection and reaction to problems in active learning engineering courses with many students and teachers. This methodology is based on gathering feedback (from students and teachers) and decision-making processes at selected milestones. The methodology integrates intra-edition mechanisms in order to detect problems and react as the courses are being taught, and inter-edition mechanisms to ensure the persistence of necessary changes in the courses design. The methodology has been successfully applied during four consecutive editions to improve an undergraduate active learning programming course with an average of 257 students and 9 teachers per edition. An extended validation of expert educators suggests that this methodology can also be applied to traditional engineering courses.

[1]  Natascha van Hattum-Janssen,et al.  Teaching a CS introductory course: An active approach , 2009, Comput. Educ..

[2]  Alejandra Martínez-Monés,et al.  Studying participation networks in collaboration using mixed methods , 2006, Int. J. Comput. Support. Collab. Learn..

[3]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[4]  David M. Shannon,et al.  Student ratings of college teaching: a comparison of faculty and their students , 2010 .

[5]  Celia Gahan,et al.  Doing Qualitative Research Using QSR NUD*IST , 1998 .

[6]  P. A. Cohen Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies , 1981 .

[7]  H. Marsh Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[8]  Caroline Daly Evaluation for new learning contexts - how can it be 'fit for purpose'? , 2008 .

[9]  Cheryl Davis Bullock,et al.  Online Collection of Midterm Student Feedback , 2003 .

[10]  John B. Mitchell,et al.  Web-based student evaluations of professors: the relations between perceived quality, easiness and sexiness , 2004 .

[11]  Yuankun Yao,et al.  How Do Faculty Make Formative Use of Student Evaluation Feedback?: A Multiple Case Study , 2005 .

[12]  Kathleen T. Brinko The Practice of Giving Feedback to Improve Teaching: What Is Effective?. , 1993 .

[13]  Thomas J. Brumm,et al.  Continuous Engineering Course Improvement through Synergistic use of Multiple Assessment , 2005 .

[14]  William Oliver,et al.  Revitalizing an undergraduate physics program: A case study of the University of Arkansas , 2013 .

[15]  Charles K. Fadel,et al.  21st Century Skills: Learning for Life in Our Times , 2009 .

[16]  Stefano Barone,et al.  TESF Methodology for Statistics Education Improvement , 2010 .

[17]  Peter A. Cohen,et al.  Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings , 1980 .

[18]  N. Denzin,et al.  The Sage handbook of qualitative research, 3rd ed. , 2005 .

[19]  Heather Leary,et al.  A Problem Based Learning Meta Analysis: Differences across Problem Types, Implementation Types, Disciplines, and Assessment Levels. , 2009 .

[20]  Esat Alpay Student attraction to engineering through flexibility and breadth in the curriculum , 2013 .

[21]  Carlos Delgado Kloos,et al.  GLASS: a learning analytics visualization tool , 2012, LAK '12.

[22]  Thomas A. Angelo,et al.  Classroom Assessment Techniques: A Handbook for College Teachers. Second Edition. , 1993 .

[23]  B. Tuckman DEVELOPMENTAL SEQUENCE IN SMALL GROUPS. , 1965, Psychological bulletin.

[24]  Imad H. Elhajj,et al.  Turning Student Groups into Effective Teams , 2004 .

[25]  Harry V. Roberts,et al.  TQM for Professors and Students. , 1993 .

[26]  N. Denzin,et al.  The Sage Handbook of Qualitative Research , 2007 .

[27]  Harvey Mellar,et al.  Quality enhancement for e-learning courses: The role of student feedback , 2010, Comput. Educ..

[28]  Alejandra Martínez-Monés,et al.  Multiple case studies to enhance project-based learning in a computer architecture course , 2005, IEEE Transactions on Education.

[29]  Herbert W. Marsh,et al.  Midterm feedback from students: Its relationship to instructional improvement and students' cognitive and affective outcomes. , 1979 .

[30]  Iria Estévez-Ayres,et al.  Course quality improvement using mid-semester feedback , 2011 .

[31]  Bruce A. Weinberg,et al.  Evaluating Methods for Evaluating Instruction: The Case of Higher Education , 2007 .

[32]  Roger Hadgraft,et al.  Engineering Education and the Development of Expertise , 2011 .

[33]  Sheri Sheppard,et al.  Educating Engineers: Designing for the Future of the Field. Book Highlights. , 2008 .

[34]  Howard K Wachtel,et al.  Student Evaluation of College Teaching Effectiveness: a brief review , 1998 .

[35]  Rebecca Brent,et al.  ACTIVE LEARNING: AN INTRODUCTION * , 2009 .

[36]  Clark Bouton,et al.  Students in learning groups: Active learning through conversation , 1983 .

[37]  Abu Bakar Mohammad,et al.  Students' feedback in the continuous quality improvement cycle of engineering education , 2011, 2011 IEEE Global Engineering Education Conference (EDUCON).

[38]  David G. Moursund,et al.  Project-based learning using information technology , 1999 .