On Validating Engineering Design Decision Support Tools

In this article, an argument for validation of design-decision methods is presented. In the process of justifying the need for validation, several criteria for a valid design-decision method are introduced. These criteria represent a starting point from which the research community can continue to debate and ponder the validation issue. Under these criteria, a critical empirical investigation of two popular decision support methods, the House of Quality and Suh’s Axiomatic Design, is presented via a simple design problem and both are shown to violate some portion of the proposed definition of validity. The goal of this article is to raise awareness of potential flaws in popular design-decision aids and to promote debate on design validation within the concurrent engineering research community.

[1]  Donald G. Saari.  Mathematical structure of voting paradoxes , 2000 .

[2]  Yan Jin,et al.  An Agent-Based Decision Network for Concurrent Engineering Design , 2001, Concurr. Eng. Res. Appl..

[3]  G. Hazelrigg.  Systems Engineering: An Approach to Information-Based Design , 1996 .

[4]  Farrokh Mistree,et al.  AN IMPLEMENTATION OF EXPECTED UTILITY THEORY IN DECISION BASED DESIGN , 1998 .

[5]  John Terninko,et al.  Step by Step Qfd: Customer Driven Product Design , 1997 .

[6]  George A. Hazelrigg,et al.  A Framework for Decision-Based Engineering Design , 1998 .

[7]  Stuart Pugh,et al.  Creating Innovative Products Using Total Design , 1996 .

[8]  D. E. Bell,et al.  Decision Making: DESCRIPTIVE, NORMATIVE, AND PRESCRIPTIVE INTERACTIONS IN DECISION MAKING , 1988 .

[9]  J. Hauser,et al.  The House of Quality , 1988 .

[10]  Nam P. Suh,et al.  principles in design , 1990 .

[11]  Christoph Roser.  A flexible design methodology , 2000 .

[12]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[13]  C. Merle Crawford.  How Puritan-Bennett used the house of quality : John R. Hauser, Sloan Management Review (Spring 1993), pp. 61-70 , 1994 .

[14]  Achille Messac,et al.  Physical programming - Effective optimization for computational design , 1996 .

[15]  J. Matheson,et al.  The Smart Organization: Creating Value Through Strategic R&D , 1997 .

[16]  J. Gibbons,et al.  Nonparametric Methods for Quantitative Analysis. , 1997 .

[17]  Kemper Lewis,et al.  A Framework for Flexible Systems and Its Implementation in Multiattribute Decision Making , 2004 .

[18]  N. Suh.  Axiomatic Design of Mechanical Systems , 1995 .

[19]  Stephen R. Kimbleton.  The role of computer system models in performance evaluation , 1972, CACM.

[20]  Andrew Kusiak.  Expert Systems: Strategies and Solutions in Manufacturing Design and Planning , 1988 .

[21]  Russell R. Barton,et al.  INTEGRATING MARKETING MODELS WITH QUALITY FUNCTION DEPLOYMENT , 2003 .

[22]  Wei Chen,et al.  An Approach to Decision-Based Design With Discrete Choice Analysis for Demand Modeling , 2003 .

[23]  D. E. Bell,et al.  Decision making: Descriptive, normative, and prescriptive interactions. , 1990 .

[24]  Keijiro Masui,et al.  Quality Function Deployment for Environment (QFDE) to Support Design for Environment (DFE) , 2002 .

[25]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.