Feedback in concept development: Comparing design disciplines

Design feedback is an essential pedagogical tool to promote student design progress, yet little research has focused on what instructor feedback looks like, especially across design disciplines. In this paper, we analyzed feedback provided in dance choreography, industrial design, and mechanical engineering to explore variation in feedback type across disciplines as well as how feedback type encouraged students to take convergent or divergent paths in their design processes. Many common feedback types were observed across the three disciplines, regardless of variance in context and expectations, as well as some notable distinctions. With regards to feedback directing convergent and divergent thinking, feedback suggesting convergent pathways was more prominent across all three disciplines.

[1]  A. Chakrabarti,et al.  Investigating novelty–outcome relationships in engineering design , 2010, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[2]  J. Wang.  (International Journal of Production Research, 35(4):995-1010)A Fuzzy Outranking Method for Conceptual Design Evaluation , 1997 .

[3]  Shanna R. Daly,et al.  First-year engineering student perceptions of creative opportunities in design , 2013 .

[4]  Clive L. Dym,et al.  Engineering Design: A Synthesis of Views , 1994 .

[5]  Spencer P. Magleby,et al.  Training faculty to coach capstone design teams , 2001 .

[6]  Shanna R. Daly,et al.  Directing Convergent and Divergent Activity through Design Feedback. , 2015 .

[7]  Madara Ogot,et al.  Engineering Design: A Project-Based Introduction , 2004 .

[8]  Antonette T. Cummings,et al.  A Tale of Two Design Contexts: Quantitative and Qualitative Explorations of Student-Instructor Interactions Amidst Ambiguity , 2014 .

[9]  Paul Rodgers,et al.  The design thinking approaches of three different groups of designers based on self-reports , 2013 .

[10]  Ann F. McKenna,et al.  Educating Engineers: Designing for the Future of the Field , 2010 .

[11]  Thomas Lee Rodgers,et al.  Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation , 2006, J. Assoc. Inf. Syst..

[12]  R. Weisberg.  Creativity and knowledge: A challenge to theories. , 1998 .

[13]  Jef R. Peeters,et al.  Refined Metrics for Measuring Novelty in Ideation , 2010 .

[14]  Jane Darke,et al.  The primary Generator and the Design Process , 1979 .

[15]  John T. Willse,et al.  Assessing Creativity With Divergent Thinking Tasks: Exploring the Reliability and Validity of New Subjective Scoring Methods , 2008 .

[16]  A. Cropley.  In Praise of Convergent Thinking , 2006 .

[17]  Robin S. Adams,et al.  Understanding Design Iteration: Representations from an Empirical Study , 2002 .

[18]  Monica E. Cardella,et al.  Analyzing design review conversations: Connecting design knowing, being and coaching , 2016 .

[19]  Cynthia J. Atman,et al.  Comparing freshman and senior engineering design processes: an in-depth follow-up study , 2005 .

[20]  Bela H. Banathy,et al.  Designing social systems in a changing world , 1996 .

[21]  Erik Stolterman,et al.  The Design Way: Intentional Change in an Unpredictable World , 2002 .

[22]  Nigel Cross,et al.  Creativity in the design process: co-evolution of problem–solution , 2001 .

[23]  Deanna P. Dannels,et al.  Critiquing Critiques , 2008 .

[24]  Shanna R. Daly.  Design across disciplines , 2008 .

[25]  Peter Lloyd,et al.  Discovering the design problem , 1994 .

[26]  Dennis R. Brophy.  Comparing the Attributes, Activities, and Performance of Divergent, Convergent, and Combination Thinkers , 2001 .

[27]  J. Guilford,et al.  The nature of human intelligence. , 1968 .

[28]  Petra Badke-Schaub,et al.  Question asking in design reviews: how does inquiry facilitate the learning interaction? , 2014 .

[29]  Bonnie Nichols,et al.  Valuing the art of Industrial Design: A Profile of the Sector and its Importance to Manufacturing, Technology, and Innovation , 2013 .

[30]  Cynthia J. Atman,et al.  Engineering Design Processes: A Comparison of Students and Expert Practitioners , 2007 .

[31]  Ralph R. Behnke,et al.  Public speaking performance improvement as a function of information processing in immediate and delayed feedback interventions , 2000 .

[32]  Oscar D. Crisalle,et al.  The Coach's Guide: Best Practices For Faculty Mentored Multidisciplinary Product Design Teams , 2010 .

[33]  Christopher A. Mattson,et al.  Pitfalls of the Typical Construction of Decision Matrices for Concept Selection , 2003 .

[34]  Min Basadur,et al.  Measuring Divergent Thinking Attitudes Related to Creative Problem Solving and Innovation Management , 1996 .

[35]  Amaresh Chakrabarti,et al.  Towards an ‘ideal’ approach for concept generation , 2003 .

[36]  Amy L. Housley Gaffney,et al.  Beyond Content, Deeper than Delivery: What Critique Feedback Reveals about Communication Expectations in Design Education , 2008 .

[37]  Cassandra L. Book,et al.  Providing feedback: The research on effective oral and written feedback strategies , 1985 .

[38]  Min Basadur,et al.  Measuring Preference for Ideation in Creative Problem-Solving Training , 1983 .

[39]  Seda Yilmaz,et al.  A Comparison of Cognitive Heuristics Use between Engineers and Industrial Designers , 2010, DCC.

[40]  Jonathan Cagan,et al.  A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty , 2010 .

[41]  M. Doherty,et al.  Effects of cognitive feedback on performance. , 1989 .

[42]  A. M. King,et al.  Development of a Methodology for Concept Selection in Flexible Design Strategies , 1999 .

[43]  Sheri Sheppard,et al.  Thoughts on freshman engineering design experiences , 1996, Technology-Based Re-Engineering Engineering Education Proceedings of Frontiers in Education FIE'96 26th Annual Conference.

[44]  Seda Yilmaz,et al.  How do designers generate new ideas? Design heuristics across two disciplines , 2015, Design Science.

[45]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[46]  Ömer Akin,et al.  Design protocol data and novel design decisions , 1995 .

[47]  Edward C. Warburton,et al.  CREATIVITY RESEARCH IN DANCE , 2007 .

[48]  James J. Pembridge,et al.  Mentoring in Engineering Capstone Design Courses: Beliefs and Practices across Disciplines , 2011 .

[49]  Robin Adams,et al.  What Does it Mean to Design? A Qualitative Investigation of Design Professionals' Experiences , 2012 .

[50]  Nigel Cross,et al.  Design cognition: results from protocol and other empirical studies of design activity , 2016 .

[51]  George B. Graen,et al.  Training Effects on Attitudes Toward Divergent Thinking Among Manufacturing Engineers , 1986 .

[52]  Belkis Uluoǧlu,et al.  Design knowledge communicated in studio critiques , 2000 .

[53]  Nigel Cross,et al.  Modelling the Design Process in Engineering and in Architecture , 1992 .

[54]  Cynthia J. Atman,et al.  A comparison of freshman and senior engineering design processes , 1999 .

[55]  Crispin Hales,et al.  Engineering design: a systematic approach , 1989 .

[56]  Kevin Otto,et al.  Measurement methods for product evaluation , 1995 .

[57]  Gabriela Goldschmidt,et al.  Three studio critiquing cultures: Fun follows function or function follows fun? , 2014 .

[58]  Seda Yilmaz,et al.  Influences of feedback interventions on student concept generation and development practices , 2014 .

[59]  David G. Ullman,et al.  The Mechanical Design Process , 1992 .

[60]  M. Runco.  Divergent Thinking, Creativity, and Giftedness , 1993 .

[61]  John S. Gero,et al.  Design and other types of fixation , 1996 .

[62]  Dan L. Shunk,et al.  An improved methodology for evaluating the producibility of partially specified part designs , 1998, Int. J. Comput. Integr. Manuf..

[63]  Craig Zimring,et al.  Defining Design between Domains: An Argument for Design Research á la Carte , 2001 .

[64]  Vinod Goel,et al.  The Structure of Design Problem Spaces , 1992, Cogn. Sci..

[65]  Paul Hyland,et al.  Driving Innovation in Logistics: Case Studies in Distribution Centres , 2004 .

[66]  Sheri Sheppard,et al.  Educating Engineers: Designing for the Future of the Field. Book Highlights. , 2008 .

[67]  M. Runco.  Creativity: Theories and Themes: Research, Development, and Practice , 2006 .

[68]  David W. Rosen,et al.  Refined metrics for measuring ideation effectiveness , 2009 .

[69]  Deidre L. Froelich,et al.  Effects of immediate instructor feedback on group discussion participants , 1984 .

[70]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[71]  Ralph R. Behnke,et al.  Technology-Based Instructional Feedback Intervention. , 1999 .

[72]  Mary Lou Maher,et al.  Formalising Design Exploration as Co-Evolution , 1996 .

[73]  Thecla Schiphorst,et al.  Tools for interaction with the creative process of composition , 1990, CHI '90.

[74]  Deanna Dannels.  Performing Tribal Rituals: A Genre Analysis of “Crits” in Design Studios , 2005 .

[75]  Deborah L Thurston,et al.  Fuzzy Ratings and Utility Analysis in Preliminary Design Evaluation of Multiple Attributes , 1992 .

[76]  Halime Demirkan,et al.  A Framework for the Design Studio in Web‐Based Education , 2001 .

[77]  Jami J. Shah,et al.  Evaluation of idea generation methods for conceptual design: Effectiveness metrics and design of experiments , 2000 .

[78]  Julie S. Linsey,et al.  Design-by-analogy and representation in innovative engineering concept generation , 2007 .

[79]  Nigel Cross,et al.  Engineering Design Methods: Strategies for Product Design , 1994 .

[80]  Ellen Yi-Luen Do,et al.  A theoretical framework of design critiquing in architecture studios , 2013 .

[81]  Shanna R. Daly,et al.  Design Heuristics in Engineering Concept Generation , 2012 .

[82]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[83]  John A. Marin,et al.  Elements of an Optimal Capstone Design Experience , 1999 .

[84]  Micah Lande,et al.  Disciplinary Discourse in Design Reviews: Industrial Design and Mechanical Engineering Courses , 2014 .

[85]  Clive L. Dym,et al.  Teaching Design to Freshmen: Style and Content , 1994 .