Initial mental representations of design problems: Differences between experts and novices

Defining and structuring wicked design problems has a major influence on subsequent problem solving, and demands a considerable level of skill. Previous research on mental representations in design is scarce, and has been largely based on students or individual experts. This study explored the differences in the initial mental representations of real-life product development problems between advanced product development engineering students and recommended, professional experts. Expert mental representations were found to demonstrate superior extent, depth and level of detail, accommodating more interconnections and being more geared toward action. The results indicate that targeting relevancy perceptions to locate interconnections and promote proactivity can be a key factor in developing product development education to better match the requirements faced by professionals.

[1]  J. Dixon,et al.  Strategies and problem representations: Implications for models of changing cognitive structure. Commentary on “Learning new problem-solving strategies leads to changes in problem representation” by M.W. Alibali, K.M. Ockuly and A.D. Fischer , 2009 .

[2]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[3]  J. Crant.  Proactive Behavior in Organizations , 2000 .

[4]  Peggy P. Ho,et al.  Building Better: GSA's National 3D-4D-BIM Program , 2010 .

[5]  Michael Frese,et al.  Helping to improve suggestion systems: predictors of making suggestions in companies , 1999 .

[6]  Cynthia J. Atman,et al.  Educating effective engineering designers: the role of reflective practice , 2003 .

[7]  John S. Gero,et al.  Strategic knowledge differences between an expert and a novice designer , 2001 .

[8]  Gary Klein,et al.  Decision-Centered Training , 1995 .

[9]  Adam M. Grant,et al.  The dynamics of proactivity at work , 2008 .

[10]  Mildred L. G. Shaw,et al.  Modeling expert knowledge , 1990 .

[11]  Martha W. Alibali,et al.  Learning new problem-solving strategies leads to changes in problem representation , 2009 .

[12]  M. Frese,et al.  4. Personal initiative: An active performance concept for work in the 21st century , 2001 .

[13]  Donald A. and Wigging Glenn Schon,et al.  Kinds of Seeing and Their Functions in Designing , 1988 .

[14]  N. Cross,et al.  Design Expertise Amongst Student Designers , 1994 .

[15]  Rajkumar Roy,et al.  Comparing the cognitive actions of design engineers and cost estimators , 2008 .

[16]  Linden J. Ball,et al.  Spontaneous analogising in engineering design: a comparative analysis of experts and novices , 2004 .

[17]  S. Sonnentag.  Expertise in professional software design: a process study. , 1998, The Journal of applied psychology.

[18]  Kees Dorst,et al.  Analysing design activity: new directions in protocol analysis , 1995 .

[19]  K. Dorst,et al.  Briefing and Reframing , 2010 .

[20]  Michael Frese,et al.  Sociodemographic factors, entrepreneurial orientation, personal initiative, and environmental problems in Uganda. , 2000 .

[21]  Lelyn D. Saner,et al.  Expertise in ill-defined problem-solving domains as effective strategy use , 2005, Memory & cognition.

[22]  B. Rittle-Johnson,et al.  Developing Conceptual Understanding and Procedural Skill in Mathematics: An Iterative Process. , 2001 .

[23]  Willemien Visser,et al.  Use of episodic knowledge and information in design problem solving , 1995 .

[24]  Nick Turner,et al.  Modeling the antecedents of proactive behavior at work. , 2006, The Journal of applied psychology.

[25]  N. Charness.  Memory for Chess Positions: Resistance to Interference. , 1976 .

[26]  Nigel Cross,et al.  Creativity in the design process: co-evolution of problem–solution , 2001 .

[27]  M. Frese,et al.  Making Things Happen : Reciprocal Relationships between Work Characteristics and Personal Initiative ( PI ) in a Four-Wave Longitudinal Structural Equation Model , 2008 .

[28]  Sara L. Beckman,et al.  Innovation as a Learning Process: Embedding Design Thinking , 2007 .

[29]  Jonathan Evans,et al.  Problem-solving Strategies and Expertise in Engineering Design. , 1997 .

[30]  Isaac José Antonio Luquetti dos Santos,et al.  Nuclear power plant shift supervisor's decision making during microincidents , 2005 .

[31]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[32]  Mark H. Bickhard,et al.  Why Children Don't Have To Solve the Frame Problems: Cognitive Representations Are Not Encodings. , 2001 .

[33]  Masaki Suwa,et al.  Unexpected discoveries and S-invention of design requirements , 2000 .

[34]  G. Lockhead.  Cognition and Thought , 1966 .

[35]  Donald A. Sch.  The reflective practitioner: how professionals think in action , 1983 .

[36]  Kees Dorst,et al.  The core of ‘design thinking’ and its application , 2011 .

[37]  Lucienne Blessing,et al.  Understanding the differences between how novice and experienced designers approach design tasks , 2003 .

[38]  B. Lawson.  Schemata, gambits and precedent: some factors in design expertise , 2004 .

[39]  Willemien Visser,et al.  The Cognitive Artifacts of Designing , 2006 .

[40]  Vesna Popovic,et al.  Expertise development in product design-strategic and domain-specific knowledge connections , 2004 .

[41]  Rachael Carkett,et al.  ‘He’s different, he’s got ‘Star Trek’ vision’: supporting the expertise of conceptual design engineers , 2004 .

[42]  J. Pine,et al.  Chunking mechanisms in human learning , 2001, Trends in Cognitive Sciences.

[43]  M. Scardamalia,et al.  Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise , 1993 .

[44]  A. D. D. Groot.  Thought and Choice in Chess , 1978 .

[45]  T. S. Bateman,et al.  The proactive component of organizational behavior: A measure and correlates , 1993 .

[46]  K. A. Ericsson,et al.  The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance , 2006 .

[47]  Stephen J. Read,et al.  The effects of expertise on financial problem solving: Evidence for goal-directed, problem-solving scripts , 1990 .

[48]  Marian Petre,et al.  How expert engineering teams use disciplines of innovation , 2004 .

[49]  Michelene T. H. Chi,et al.  Laboratory Methods for Assessing Experts' and Novices' Knowledge , 2006 .

[50]  Beth A. Bechky,et al.  When Collections of Creatives Become Creative Collectives: A Field Study of Problem Solving at Work , 2006, Organ. Sci..

[51]  Herbert A. Simon,et al.  THE MIND'S EYE IN CHESS , 1988 .

[52]  N. Cross.  Designerly ways of knowing , 2006 .

[53]  M. Smyth,et al.  Memory for movement in professional ballet dancers. , 1994 .

[54]  K. Anders Ericsson,et al.  The Psychology of Abilities, Competencies, and Expertise: The Search for General Abilities and Basic Capacities: Theoretical Implications from the Modifiability and Complexity of Mechanisms Mediating Expert Performance , 2003 .

[55]  Nigel Cross,et al.  Creative thinking by expert designers , 2004 .

[56]  Janet L. Starkes,et al.  Motor Versus Verbal Recall of Ballet Sequences by Young Expert Dancers , 1987 .

[57]  Joseph Defazio.  The identification of design experts , 2008 .

[58]  Sandra Ohly,et al.  Taking personal initiative and communicating about ideas: What is important for the creative process and for idea creativity? , 2007 .

[59]  Nigel Cross,et al.  Expertise in engineering design , 1998 .

[60]  R. Glaser,et al.  Expertise in a complex skill: Diagnosing x-ray pictures. , 1988 .

[61]  Michael J. Prietula,et al.  Expertise and Error in Diagnostic Reasoning , 1981, Cogn. Sci..

[62]  Vinod Goel,et al.  The Structure of Design Problem Spaces , 1992, Cogn. Sci..

[63]  Caroline E. Zsambok,et al.  Characteristics of Skilled Option Generation in Chess , 1995 .

[64]  Michael J. Prietula,et al.  Studies of Expertise from Psychological Perspectives , 2006 .

[65]  Sara L. Beckman,et al.  Framing Innovation: Negotiating Shared Frames During Early Design Phases , 2007 .

[66]  V. Patel,et al.  Domain Knowledge and Hypothesis Genenation in Diagnostic Reasoning , 1990, Medical decision making : an international journal of the Society for Medical Decision Making.

[67]  Joyce J. Elam,et al.  Inside a software design team: knowledge acquisition, sharing, and integration , 1993, CACM.

[68]  Amaresh Chakrabarti,et al.  Identification and application of requirements and their impact on the design process: a protocol study , 2004 .

[69]  Cynthia J. Atman,et al.  A comparison of freshman and senior engineering design processes , 1999 .

[70]  M. Chi.  Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[71]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[72]  A. Elo.  The rating of chessplayers, past and present , 1978 .

[73]  R. Siegler.  Three aspects of cognitive development , 1976, Cognitive Psychology.

[74]  Nancy J. Cooke,et al.  Varieties of knowledge elicitation techniques , 1994, Int. J. Hum. Comput. Stud..

[75]  M. Frese,et al.  Innovation is not enough: climates for initiative and psychological safety, process innovations, and firm performance , 2003 .

[76]  Herbert A. Simon,et al.  The Structure of Ill Structured Problems , 1973, Artif. Intell..

[77]  Maria L. Kraimer,et al.  WHAT DO PROACTIVE PEOPLE DO? A LONGITUDINAL MODEL LINKING PROACTIVE PERSONALITY AND CAREER SUCCESS , 2001 .

[78]  Vimla L. Patel,et al.  Emerging paradigms of cognition in medical decision-making , 2002, J. Biomed. Informatics.

[79]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[80]  K. A. Ericsson,et al.  Protocol Analysis and Expert Thought: Concurrent Verbalizations of Thinking during Experts' Performance on Representative Tasks , 2006 .

[81]  Chun-Heng Ho,et al.  Some phenomena of problem decomposition strategy for design thinking: differences between novices and experts , 2001 .

[82]  Mike Chiasson,et al.  A model of design decision making based on empirical results of interviews with software designers , 2007, Inf. Softw. Technol..

[83]  Mica R. Endsley,et al.  Expertise and Situation Awareness , 2006 .

[84]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[85]  Gary Klein,et al.  Developing Expertise in Decision Making , 1997 .

[86]  Karol G. Ross,et al.  The Recognition-Primed Decision Model , 2004 .

[87]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[88]  P. Saariluoma,et al.  Chess players' intake of task-relevant cues , 1985, Memory & cognition.

[89]  Bryan Lawson,et al.  Cognitive Strategies in Architectural Design , 1979 .

[90]  John S. Gero,et al.  Design Prototypes: A Knowledge Representation Schema for Design , 1990, AI Mag..

[91]  J. Reitman,et al.  Knowledge organization and skill differences in computer programmers , 1981, Cognitive Psychology.

[92]  Nigel Cross,et al.  Expertise in Design: an overview , 2004 .

[93]  F. McKenna,et al.  Skilled anticipation in real-world tasks: measurement of attentional demands in the domain of tennis. , 2001, Journal of experimental psychology. Applied.

[94]  Maria L. Kraimer,et al.  Proactive personality and career success. , 1999, The Journal of applied psychology.

[95]  Ömer Akin,et al.  Necessary conditions for design expertise and creativity , 1990 .

[96]  Ac Rianne Valkenburg,et al.  The reflective practice of design teams , 1998 .

[97]  Stephen K. Reed,et al.  Differences in expert and novice situation awareness in naturalistic decision making , 1996, Int. J. Hum. Comput. Stud..

[98]  Barry J. Zimmerman,et al.  Self-Regulation Differences during Athletic Practice by Experts, Non-Experts, and Novices , 2001 .

[99]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[100]  John S. Gero,et al.  The structure of concurrent cognitive actions: a case study on novice and expert designers , 2002 .

[101]  J. W. Getzels.  Problem‐Finding and the Inventiveness of Solutions , 1975 .

[102]  William G. Abel,et al.  Surgical Intuition: What It Is and How to Get It , 1995 .

[103]  N. Shadbolt,et al.  Eliciting Knowledge from Experts: A Methodological Analysis , 1995 .

[104]  S. Sonnentag,et al.  Routinization, work characteristics and their relationships with creative and proactive behaviors , 2006 .

[105]  Richard Buchanan,et al.  Wicked Problems in Design Thinking , 1992 .

[106]  Christiane Drews,et al.  Unleashing the Full Potential of Design Thinking as a Business Method , 2009 .

[107]  Anneli Eteläpelto.  Contextual and strategic knowledge in the acquisition of design expertise , 2000 .

[108]  M. Chi,et al.  The Nature of Expertise , 1988 .

[109]  Fernand Gobet,et al.  Perception and memory in chess: Heuristics of the professional eye , 1996 .

[110]  Gary Klein.  Sources of Power , 1998 .

[111]  J. W. Getzels.  Problem Finding: a Theoretical Note , 1979, Cogn. Sci..

[112]  Janet L. Kolodner,et al.  Powers of observation in creative design , 1996 .

[113]  N. Cross.  The Expertise of Exceptional Designers , 2003 .

[114]  Rajkumar Roy,et al.  An introduction to capturing and understanding the cognitive behaviour of design engineers , 2007 .

[115]  Michael Frese,et al.  Business owners' action planning and its relationship to business success in three African countries. , 2007, The Journal of applied psychology.

[116]  B. Bläsing,et al.  The cognitive structure of movements in classical dance , 2009 .