Chapter 3 – Studying Engineering Design Learning: Four Verbal Protocol Studies

Publisher Summary This chapter focuses specifically on the use of verbal protocol analysis (VPA) to characterize the design learning and knowing of students in engineering schools. Verbal protocol analysis is a rigorous methodology used to document and understand the processes associated with cognitive activities, such as design. The four verbal protocol studies presented here provide insights into engineering student design processes. These studies, and others like them, can form a strong research foundation for improving design learning in the engineering curriculum. The VPA methodology is applied to the study of engineering student design processes and the results of each of the four studies have been summarized in the chapter. A synthesis of the overall results is discussed and some ideas about the implications of the results for engineering design education are presented. In the last decade, engineering design has become a central topic in discussions of engineering education reform, leading to a strong need to understand the processes of engineering student designers. The assumption behind verbal-protocol analysis is that as long as the subject is simply talking about what they are doing, the talking does not significantly change the approach they use to perform the activity. The implementation of verbal protocol analysis can be time-consuming, and the results challenging to interpret. However, the process of verbal-protocol analysis research is relatively straightforward.

[1]  C.J. Atman,et al.  Graphical representations of engineering design behavior , 1998, FIE '98. 28th Annual Frontiers in Education Conference. Moving from 'Teacher-Centered' to 'Learner-Centered' Education. Conference Proceedings (Cat. No.98CH36214).

[2]  John S. Gero,et al.  An approach to the analysis of design protocols , 1998 .

[3]  C. Bereiter,et al.  Three Levels of Goal Orientation in Learning , 1991 .

[4]  N. Cross,et al.  Design Expertise Amongst Student Designers , 1994 .

[5]  Carolyn M. James The Role of Planning in Simple Digital Circuit Design. , 1994 .

[6]  Sheri Sheppard,et al.  Examples of Freshman Design Education , 1997 .

[7]  Cynthia J. Atman,et al.  Freshman engineers' performance when solving design problems , 1999 .

[8]  Cynthia J. Atman,et al.  An application of protocol analysis to the engineering design process , 1996 .

[9]  Cynthia J. Atman,et al.  Teaching engineering design: Can reading a textbook make a difference? , 1996 .

[10]  Spencer P. Magleby,et al.  A Survey of Capstone Engineering Courses in North America , 1995 .

[11]  J. Novak,et al.  Educational Psychology: A Cognitive View , 1969 .

[12]  Cynthia J. Atman,et al.  Characterizing Engineering Student Design Processes An Illustration Of Iteration , 2000 .

[13]  Louis L. Bucciarelli,et al.  Designing Engineers , 1994 .

[14]  S. W. Gyeszly,et al.  Protocol analysis of the engineering systems design process , 1991 .

[15]  C.J. Atman,et al.  Cognitive processes in iterative design behavior , 1999, FIE'99 Frontiers in Education. 29th Annual Frontiers in Education Conference. Designing the Future of Science and Engineering Education. Conference Proceedings (IEEE Cat. No.99CH37011.

[16]  Tat Y. Lee,et al.  Design methods used by undergraduate engineering students , 1989 .

[17]  Karen M. Bursic,et al.  Verbal Protocol Analysis as a Method to Document Engineering Student Design Processes , 1998 .

[18]  Cynthia J. Atman,et al.  Describing Student Design Behavior , 1997 .

[19]  Thomas G. Dietterich,et al.  A model of the mechanical design process based on empirical data , 1988, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[20]  Cynthia J. Atman,et al.  A comparison of freshman and senior engineering design processes , 1999 .

[21]  Neil A. M. Maiden,et al.  Analysing the Novice Analyst: Cognitive Models in Software Engineering , 1992, Int. J. Man Mach. Stud..

[22]  John C. Tang,et al.  An Observational Methodology for Studying Group Design Activity , 1991 .

[23]  Cynthia J. Atman,et al.  Information Gathering: A Critical Step for Quality in the Design Process , 1997 .

[24]  Raymonde Guindon Designing the design process: exploiting opportunistic thoughts , 1990 .

[25]  M. Chi Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[26]  Rivka Oxman,et al.  Viewpoint Observing the observers: research issues in analysing design activity , 1995 .