Design Heuristics: Extraction and Classification Methods With Jet Propulsion Laboratory's Architecture Team

This study offers insight into the processes of expert designers at the Jet Propulsion Laboratory (JPL) and how they use heuristics in the design process. A methodology for the extraction, classification, and characterization of heuristics is presented. Ten expert participants were interviewed to identify design heuristics used during early stage space mission design at JPL. In total, 101 heuristics were obtained, classified, and characterized. The use of interviews to extract heuristics allowed for researchers to confirm that those heuristics were indeed used by designers. Through the use of post-interview surveys, participants characterized heuristics based on attributes including source/origin, applicability based on concept maturity, frequency of use, reliability, and tendency to evolve. These findings are presented, and statistically significant correlations were found between the participant perceptions of frequency of use, reliability, and evolution of a heuristic. A positive correlation was found between frequency of use and reliability while negative correlations were found between frequency of use and evolution, and reliability and evolution. Survey results and analysis aim to identify valid attributes for assessing the applicability and value of multiple heuristics for design practice in early space mission formulation. [DOI: 10.1115/1.4044160]

[1]  Christiaan J. J. Paredis,et al.  Design Heuristics: A Conceptual Framework and Preliminary Method for Extraction , 2017 .

[2]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .

[3]  M. Larkin,et al.  The interview , 2004, The Lancet.

[4]  Shanna R. Daly,et al.  Design Heuristics in Engineering Concept Generation , 2012 .

[5]  N. Denzin,et al.  The SAGE handbook of qualitative research , 2005 .

[6]  H. Simon.  Rational Decision Making in Business Organizations , 1978 .

[7]  Colleen M. Seifert,et al.  Creativity through design heuristics: A case study of expert product design , 2011 .

[8]  Johan Malmqvist,et al.  Requirements management in practice: findings from an empirical study in the automotive industry , 2006 .

[9]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[10]  Bert Bras,et al.  A Method of Finding Biologically Inspired Guidelines for Environmentally Benign Design and Manufacturing , 2014 .

[11]  Leslie Woods,et al.  Grounded Theory: A practical guide for management, business and market researchers Christina Goulding Grounded Theory: A practical guide for management, business and market researchers Sage Publications No of pages: 186 £18.99 0761966838 0761966838 [Formula: see text]. , 2003, Nurse researcher.

[12]  Wei Chen,et al.  Decision Making in Engineering Design , 2006 .

[13]  Kristin L. Wood,et al.  Prototype Partitioning Based on Requirement Flexibility , 2004 .

[14]  Jan Hauke,et al.  Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data , 2011 .

[15]  Christopher McComb,et al.  Mining Process Heuristics From Designer Action Data via Hidden Markov Models , 2017 .

[16]  Paul Collopy,et al.  Value-Driven Design , 2011 .

[17]  Johnny Saldaña,et al.  Fundamentals of Qualitative Research , 2011 .

[18]  Linsey Julie,et al.  Observation of a Highly Innovative Group – Directions for Future Research , 2016 .

[19]  Seda Yilmaz,et al.  How do designers generate new ideas? Design heuristics across two disciplines , 2015, Design Science.

[20]  Carolyn Conner Seepersad,et al.  Principles of Product Flexibility , 2006 .

[21]  Billy V. Koen,et al.  Definition of the engineering method , 1985 .

[22]  Joan Ervin,et al.  Exploring Mission Concepts with the JPL Innovation Foundry A-Team , 2013 .

[23]  John P. W. Stark,et al.  Spacecraft systems engineering , 1995 .

[24]  Tim C. McAloone,et al.  Fuzzy decision support for tools selection in the core front end activities of new product development , 2013 .

[25]  Paul V. Johnson,et al.  Exploring the science trade space with the JPL Innovation Foundry A-Team , 2018, Concurr. Eng. Res. Appl..

[26]  Bill Gillham,et al.  Case Study Research Methods , 2000 .

[27]  Vincenzo Arrichiello.  Introduction to Systems Engineering , 2014, CIISE.

[28]  Seda Yilmaz,et al.  A Comparison of Cognitive Heuristics Use between Engineers and Industrial Designers , 2010, DCC.

[29]  S. Kvale,et al.  InterViews: Learning the Craft of Qualitative Research Interviewing , 1996 .

[30]  Maria C. Yang,et al.  Design Principles: Literature Review, Analysis, and Future Directions , 2016 .

[31]  Brent Sherwood,et al.  JPL Innovation Foundry , 2013 .

[32]  Gabrielle Durepos,et al.  Encyclopedia of case study research , 2010 .

[33]  Kristin L. Wood,et al.  Innovations in Design Through Transformation: A Fundamental Study of Transformation Principles , 2009 .

[34]  Cassandra Telenko,et al.  A Compilation of Design for Environment Guidelines , 2016 .

[35]  Christina Goulding.  Grounded Theory: A Practical Guide for Management, Business and Market Researchers , 2002 .

[36]  Seda Yilmaz,et al.  Evidence-based design heuristics for idea generation , 2016 .

[37]  Seda Yilmaz,et al.  Cognitive Heuristic Use In Engineering Design Ideation , 2010 .

[38]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.

[39]  Cassandra Telenko,et al.  A Methodology for Identifying Environmentally Conscious Guidelines for Product Design , 2010 .

[40]  Brigitte Moench,et al.  Engineering Design A Systematic Approach , 2016 .

[41]  N. Maccoby,et al.  The interview: a tool of social science , 1954 .

[42]  Robert D. Campbell,et al.  A Method for Identifying Design Principles for the Developing World , 2011, DAC 2011.

[43]  Seda Yilmaz,et al.  Design Heuristics in Innovative Products , 2016 .

[44]  James D. Wright,et al.  Handbook of Survey Research. , 1985 .

[45]  Mark Adler,et al.  Recent improvements in JPL's mission formulation process , 2010, 2010 IEEE Aerospace Conference.

[46]  Christiaan J. J. Paredis,et al.  Optimization Under Uncertainty Versus Algebraic Heuristics: A Research Method for Comparing Computational Design Methods , 2017, DAC 2017.

[47]  Christiaan J. J. Paredis,et al.  A Conceptual Framework for Value-Driven Design and Systems Engineering , 2014 .

[48]  Mark Adler,et al.  Measuring the Maturity of Robotic Planetary Mission Concepts , 2010 .

[49]  John Ziemer,et al.  Space mission concept development using concept maturity levels; JPL Innovation Foundry , 2013 .

[50]  Darren A. Keese,et al.  Empirically-Derived Principles for Designing Products With Flexibility for Future Evolution , 2007 .

[51]  James R. Wertz,et al.  Space Mission Analysis and Design , 1992 .

[52]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .