Human behavior and domain knowledge in parameter design of complex systems

The design of complex systems involves selecting design parameters to satisfy the required constraints while meeting desired performance objectives. These parameters are often coupled and their relationships not easily understood. This paper presents results of an experiment to understand how designers solve parameter design problems, in the context of desalination systems. Subjects with different desalination expertise were asked to complete design tasks involving seawater reverse osmosis plants. Results confirmed that designers had difficulties understanding the sensitivity of coupled variables. More desalination knowledge was linked to better performance and designers with limited desalination knowledge tended to perform the worst due to having partial or incorrect domain knowledge. These findings have implications in design tool development and education.

[1]  N. Munro,et al.  PID controllers: recent tuning methods and design to specification , 2002 .

[2]  J. Peto,et al.  Asymptotically Efficient Rank Invariant Test Procedures , 1972 .

[3]  Mary Frecker,et al.  Metamodel-Driven Interfaces for Engineering Design: Impact of Delay and Problem Size on User Performance , 2005 .

[4]  Patrick M. Reed,et al.  A framework for Visually Interactive Decision-making and Design using Evolutionary Multi-objective Optimization (VIDEO) , 2007, Environ. Model. Softw..

[5]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[6]  Ozgur Ozkan,et al.  Cognitive strategies of analogical reasoning in design: Differences between expert and novice designers , 2013 .

[7]  Christopher McComb,et al.  Studying Human Design Teams via Computational Teams of Simulated Annealing Agents , 2015 .

[8]  Gerd Fricke,et al.  Successful individual approaches in engineering design , 1996 .

[9]  Daniel D. Frey,et al.  Cognition and complexity: An experiment on the effect of coupling in parameter design , 2002 .

[10]  John H. Lienhard,et al.  Effectiveness-mass transfer units (ε-MTU) model of a reverse osmosis membrane mass exchanger , 2014 .

[11]  Lucienne Blessing,et al.  Understanding the differences between how novice and experienced designers approach design tasks , 2003 .

[12]  Jonathan Evans,et al.  Problem-solving Strategies and Expertise in Engineering Design. , 1997 .

[13]  Timothy W. Simpson,et al.  Evaluation of a Graphical Design Interface for Design Space Visualization , 2004 .

[14]  Daniel D. Frey,et al.  Detecting mistakes in engineering models: the effects of experimental design , 2012 .

[15]  Jami J. Shah,et al.  Empirical Studies of Designer Thinking: Past, Present, and Future , 2015 .

[16]  K. A. Ericsson,et al.  The Scientific Study of Expert Levels of Performance: general implications for optimal learning and creativity 1 , 1998 .

[17]  Steven Dubowsky,et al.  A Computer Architecture for the Automatic Design of Modular Systems With Application to Photovoltaic Reverse Osmosis , 2014 .

[18]  John S. Gero,et al.  The structure of concurrent cognitive actions: a case study on novice and expert designers , 2002 .

[19]  R. Rudel,et al.  Estimating correlation with multiply censored data arising from the adjustment of singly censored data. , 2007, Environmental science & technology.

[20]  Eswaran Subrahmanian,et al.  Equations aren’t enough: informal modeling in design , 1993, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[21]  Joaquim R. R. A. Martins,et al.  Multidisciplinary Design Optimization for Complex Engineered Systems: Report From a National Science Foundation Workshop , 2011 .

[22]  Paul Thomas Grogan,et al.  Interoperable simulation gaming for strategic infrastructure systems design , 2014 .

[23]  Xiaolong Zhang,et al.  The Importance of Training for Interactive Trade Space Exploration: A Study of Novice and Expert Users , 2011, J. Comput. Inf. Sci. Eng..

[24]  Raphael T. Haftka,et al.  Structural optimization complexity: what has Moore’s law done for us? , 2004 .

[25]  Mary Frecker,et al.  Assessing the Impact of Graphical Design Interfaces on Design Efficiency and Effectiveness , 2003, J. Comput. Inf. Sci. Eng..

[26]  Mary Frecker,et al.  Impact of response delay and training on user performance with text-based and graphical user interfaces for engineering design , 2007 .

[27]  Raymonde Guindon.  Designing the design process: exploiting opportunistic thoughts , 1990 .

[28]  Mary Frecker,et al.  Supporting knowledge exploration and discovery in multi-dimensional data with interactive multiscale visualisation , 2012 .

[29]  Stefan H. Thomke,et al.  Managing Experimentation in the Design of New Products , 1998 .

[30]  Timothy W. Simpson,et al.  Trade Space Exploration: Assessing the Benefits of Putting Designers ''Back-in-the-Loop'' during Engineering Optimization , 2011 .

[31]  Karen M. Feigh,et al.  An Experimental Study of Continuous and Discrete Visualization Paradigms for Interactive Trade Space Exploration , 2013, J. Comput. Inf. Sci. Eng..

[32]  David Jason Gerber,et al.  Measuring the impact of scale and coupling on solution quality for building design problems , 2014 .

[33]  Jonathan Cagan,et al.  Synergistic human-agent methods for deriving effective search strategies: the case of nanoscale design , 2015 .

[34]  Nigel Cross,et al.  Expertise in Design: an overview , 2004 .

[35]  Jonathan Cagan,et al.  Simulated Annealing and the Generation of the Objective Function: A Model of Learning During Problem Solving , 1997, Comput. Intell..

[36]  Maria C. Yang,et al.  A Study of Student Design Team Behaviors in Complex System Design , 2012, Journal of Mechanical Design.

[37]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007 .

[38]  François Maréchal,et al.  Multi-objective optimization of RO desalination plants , 2008 .