Tools for assessing student learning in mechanical design courses

Assessing student learning and evaluating the effects of innovation in teaching remain a challenge for design educators and researchers. This paper describes the development of a set of assessment tools for use in evaluating pedagogical improvements in project-based mechanical design courses. An ethnographic study was undertaken to identify the design concepts and skills that students struggle to learn or apply. Four categories of concepts were identified as difficult for students: problem definition, evaluation of concepts, communication and comprehension, and prototyping strategies. In order to support interventions to improve students’ learning in these areas, an assessment tool was designed and pilot tested with expert and novice participants. The results from this test will be used to develop an inventory of questions that can be used by educators and researchers to monitor student learning in mechanical design courses, and evaluate the efficacy of new teaching methods and tools.

[1]  T. Kline.  Psychological Testing: A Practical Approach to Design and Evaluation , 2005 .

[2]  Cynthia J. Atman,et al.  Tackling the research-to-teaching challenge in engineering design education , 2006 .

[3]  Jami J. Shah,et al.  Applied Tests of Design Skills—Part 1: Divergent Thinking , 2012 .

[4]  W. C. Newstetter,et al.  A developmental approach to assessing design skills and knowledge , 1997, Proceedings Frontiers in Education 1997 27th Annual Conference. Teaching and Learning in an Era of Change.

[5]  Lucienne Blessing,et al.  Understanding the differences between how novice and experienced designers approach design tasks , 2003 .

[6]  Cynthia J. Atman,et al.  Engineering Design Processes: A Comparison of Students and Expert Practitioners , 2007 .

[7]  Said Shakerin.  The Art of Estimation , 2006 .

[8]  Margot A. Vigeant,et al.  Development of the Heat and Energy Concept Inventory: Preliminary Results on the Prevalence and Persistence of Engineering Students' Misconceptions , 2012 .

[9]  Brian Frank,et al.  Development of a Design Skill Assessment Tool , 2010 .

[10]  R. Belk,et al.  Assessing Trustworthiness in Naturalistic Consumer Research , 1989 .

[11]  D. Hestenes,et al.  Force concept inventory , 1992 .

[12]  Jonathan Evans,et al.  Problem-solving Strategies and Expertise in Engineering Design. , 1997 .

[13]  E. Mazur,et al.  Peer Instruction: Ten years of experience and results , 2001 .

[14]  Reid Bailey,et al.  Assessing Engineering Design Process Knowledge , 2006 .

[15]  R.L. Upchurch,et al.  A Simulation Task to Assess Students’ Design Process Skill , 2005, Proceedings Frontiers in Education 35th Annual Conference.