AC 2007-1505: BREADTH IN DESIGN PROBLEM SCOPING: USING INSIGHTS FROM EXPERTS TO INVESTIGATE STUDENT PROCESSES

Method and Background In this study we used two methods for analyzing expert data: verbal protocol analysis (VPA) and narrative analysis. VPA has been effectively used to describe the design processes employed by engineering students, expert designers, and expert-novice comparative research. VPA involves asking participants to "think aloud" while performing the following design task: In the past, the Midwest has experienced massive flooding of the Mississippi River. What factors would you take into account in designing a retaining wall system for the Mississippi? Each participant worked individually and had up to 30 minutes to complete the design task. Verbal responses were audio recorded and transcribed for subsequent coding and interpretation. Narrative analysis entails a close reading of the transcripts seeking to identify content categories (particularly those not highlighted in the VPA) but also to trace the logic or structure underlying the respondent's answer. (See full length paper at the link below for a complete description of methods.)

[1]  Karen M. Bursic,et al.  Verbal Protocol Analysis as a Method to Document Engineering Student Design Processes , 1998 .

[2]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[3]  Donald A. Schön,et al.  The Reflective Practitioner: How Professionals Think in Action. , 1987 .

[4]  R. Franzosi.  Narrative Analysis—Or Why (and How) Sociologists Should Be Interested In Narrative , 1998 .

[5]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[6]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[7]  Cynthia J. Atman,et al.  Freshman engineers' performance when solving design problems , 1999 .

[8]  M. Chi.  Two Approaches to the Study of Experts' Characteristics , 2006 .

[9]  Cynthia J. Atman,et al.  Engineering Design Processes: A Comparison of Students and Expert Practitioners , 2007 .

[10]  Cynthia J. Atman,et al.  Engineering design factors: how broadly do students define problems? , 2000, 30th Annual Frontiers in Education Conference. Building on A Century of Progress in Engineering Education. Conference Proceedings (IEEE Cat. No.00CH37135).

[11]  W. Newstetter,et al.  Design Knowing and Learning: Cognition in Design Education , 2001 .

[12]  D. Clandinin,et al.  Narrative Inquiry: Experience and Story in Qualitative Research , 1999 .

[13]  K. Ericsson,et al.  Prospects and limits of the empirical study of expertise: an introduction , 1991 .

[14]  C. Atman,et al.  Considering Context: A Study of First‐Year Engineering Students , 2007 .

[15]  Linda Candy,et al.  Creative design of the Lotus bicycle: implications for knowledge support systems research , 1996 .

[16]  Thomas G. Dietterich,et al.  A model of the mechanical design process based on empirical data , 1988, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[17]  Mary Besterfield-Sacre,et al.  The ABET “Professional Skills” — Can They Be Taught? Can They Be Assessed? , 2005 .

[18]  Nigel Cross,et al.  Expertise in engineering design , 1998 .

[19]  F. Gobet.  The Cambridge handbook of expertise and expert performance , 2006 .

[20]  Cynthia J. Atman,et al.  Educating effective engineering designers: the role of reflective practice , 2003 .

[21]  Tat Y. Lee,et al.  Design methods used by undergraduate engineering students , 1989 .

[22]  Cynthia J. Atman,et al.  A comparison of freshman and senior engineering design processes , 1999 .

[23]  Nigel Cross,et al.  Analysing design activity , 1996 .

[24]  Daniel D. Frey,et al.  Engineering design thinking, teaching, and learning , 2006 .

[25]  J. Bruner.  The Culture of Education , 1996 .

[26]  Daryl E. Chubin,et al.  Diversifying the Engineering Workforce , 2005 .

[27]  M. Chi.  Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[28]  John R. Dixon,et al.  Design Theory and Methodology , 1989 .

[29]  Durward K. Sobek,et al.  Linking design process to customer satisfaction through virtual design of experiments , 2006 .

[30]  M. Scardamalia,et al.  Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise , 1993 .

[31]  Jonathan Evans,et al.  Problem-solving Strategies and Expertise in Engineering Design. , 1997 .

[32]  Nigel Cross,et al.  Design cognition: results from protocol and other empirical studies of design activity , 2016 .

[33]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .