Linking design process to customer satisfaction through virtual design of experiments

This work seeks to better understand how design processes affect design outcomes. Design process data were collected from journals kept as a part of mechanical engineering capstone design projects at Montana State University. Student processes were characterized by time coding journal entries using a 3 × 4 matrix of process variables. The data were modeled using a principal components artificial neural network, and the model used in a virtual designed experiment to obtain estimates for design process factors that significantly affect client satisfaction. Results indicate that greater client satisfaction is achieved through: greater problem definition (PD) activity and idea generation at conceptual design levels, and PD and engineering analysis activities at the system design level. Whereas, design activity at the detailed level associates with lower client satisfaction. These results support some aspects of existing models of “good” design process, and suggest adaptations of the models for novice designers.

[1]  Robert P. Smith,et al.  Product development process modeling , 1999 .

[2]  David G. Ullman,et al.  The Mechanical Design Process , 1992 .

[3]  Chris A McMahon,et al.  Information Access Diagrams: A Technique for Analyzing the Usage of Design Information , 1996 .

[4]  Karl T. Ulrich,et al.  Product Design and Development , 1995 .

[5]  Shufeng Tan,et al.  Reducing data dimensionality through optimizing neural network inputs , 1995 .

[6]  Steven D. Eppinger,et al.  Evaluation of design process alternatives using signal flow graphs , 2000 .

[7]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[8]  Jay B. Brockman.  Evaluation of student design processes , 1996, Technology-Based Re-Engineering Engineering Education Proceedings of Frontiers in Education FIE'96 26th Annual Conference.

[9]  Murray Smith,et al.  Neural Networks for Statistical Modeling , 1993 .

[10]  W. P Lewis,et al.  An analysis of professional skills in design: implications for education and research , 2002 .

[11]  Steven D. Eppinger,et al.  Generalized models of design iteration using signal flow graphs , 1995 .

[12]  Yousef Haik,et al.  Engineering Design Process , 2002 .

[13]  John S. Gero,et al.  Strategic knowledge differences between an expert and a novice designer , 2001 .

[14]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[15]  Peter Matthews,et al.  Extracting Experience through Protocol Analysis , 2001 .

[16]  J. Ramalho-Santos,et al.  Cronbach's alpha: a tool for assessing the reliability of scales , 1999 .

[17]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[18]  Patricia Brackin,et al.  Techniques For Assessing Industrial Projects In Engineering Design Courses , 2001 .

[19]  Jane Darke,et al.  The primary Generator and the Design Process , 1979 .

[20]  H. Simon,et al.  Protocol Analysis: Verbal Reports as Data , 1986 .

[21]  D. Sobek.  Preliminary Findings From Coding Student Design Journals , 2002 .

[22]  Xianming Shi,et al.  Applying artificial neural networks and virtual experimental design to quality improvement of two industrial processes , 2004 .

[23]  D. V. Steward,et al.  The design structure system: A method for managing the design of complex systems , 1981, IEEE Transactions on Engineering Management.

[24]  Cynthia J. Atman,et al.  Characterizing Engineering Student Design Processes An Illustration Of Iteration , 2000 .

[25]  Petra Badke-Schaub,et al.  Résumé of 12 years interdisciplinary empirical studies of engineering design in Germany , 1999 .

[26]  M. B. Waldron,et al.  Mechanical Design: Theory and Methodology , 2007 .

[27]  Durward K. Sobek,et al.  Iteration in Engineering Design: Inherent and Unavoidable or Product of Choices Made? , 2003 .

[28]  Lucienne Blessing,et al.  Understanding the differences between how novice and experienced designers approach design tasks , 2003 .

[29]  Richard Birmingham,et al.  Understanding engineering design : context, theory and practice , 1997 .

[30]  Eric W. Johnson,et al.  Analysis and refinement of iterative design processes , 1997 .

[31]  John R. Dixon,et al.  A review of research in mechanical engineering design. Part I: Descriptive, prescriptive, and computer-based models of design processes , 1989 .

[32]  W. Newstetter,et al.  Design Knowing and Learning: Cognition in Design Education , 2001 .

[33]  Vikas Kewal Jain,et al.  Relating design process to design outcomes in engineering capstone projects , 2003 .

[34]  Nigel Cross,et al.  Expertise in Design: an overview , 2004 .

[35]  Steven D. Eppinger,et al.  Generalised models of design interation using signal flow graphs , 1997 .

[36]  Sun-Yuan Kung,et al.  Principal Component Neural Networks: Theory and Applications , 1996 .

[37]  Louis L. Bucciarelli,et al.  Designing Engineers , 1994 .

[38]  Robert P. Smith,et al.  A predictive model of sequential iteration in engineering design , 1997 .

[39]  Wolfgang Beitz,et al.  Engineering Design: A Systematic Approach , 1984 .

[40]  Patricia Brackin,et al.  Methods Of Assessing Student Learning In Capstone Design Projects With Industry: A Five Year Review , 2002 .

[41]  Durward K. Sobek,et al.  Two Instruments for Assessing Design Outcomes of Capstone Projects , 2004 .

[42]  David Maffin,et al.  Engineering Design Models: Context, theory and practice , 1998 .

[43]  W. Newstetter,et al.  Novice Conceptions of Design: Implications for the Design of Learning Environments , 2001 .

[44]  Cynthia J. Atman,et al.  An application of protocol analysis to the engineering design process , 1996 .

[45]  Durward K. Sobek.  Use Of Journals To Evaluate Student Design Processes , 2002 .

[46]  Madara Ogot,et al.  Engineering Design: A Project-Based Introduction , 2004 .

[47]  Nigel Cross,et al.  Engineering design methods , 1989 .

[48]  Brad Warner,et al.  Understanding Neural Networks as Statistical Tools , 1996 .