Prototyping for context: exploring stakeholder feedback based on prototype type, stakeholder group and question type

Engineering designers frequently use prototypes to gather input from stakeholders. Design guidelines recommend the use of quick and simple prototypes early and often in a design process. However, the type and quality of a prototype can influence how stakeholders perceive a new design concept and can, therefore, impact their responses. Additionally, different levels of experience, expertise, and preparedness for providing input to designers may lead stakeholders from different geographical or cultural settings to provide different responses, making the format of a prototype even more influential. Although design practitioners are known to intentionally align their prototyping approaches with the specific design question to be answered, it is unclear the extent to which prototyping approaches should vary based on the stakeholder, context, and setting of a design project. To investigate how the format and quality of prototypes influence stakeholders’ responses, we conducted a field study with various medical professionals in Ghana. We presented prototypes for a medical device in different formats to stakeholders and collected responses to the design through semi-structured interviews. Our findings indicate that professional expertise, prototype format, and question type influenced the types of responses that stakeholders provided. These findings suggest that designers seeking input from stakeholders on new concepts should consider context-specific prototyping strategies, especially when designing at distance and across cultures.

[1]  Kevin Otto,et al.  Product Design: Techniques in Reverse Engineering and New Product Development , 2000 .

[2]  Julie Linsey,et al.  Understanding the prototyping strategies of experienced designers , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[3]  L. Giddings Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 2d ed , 2005 .

[4]  Lea Fleischer,et al.  The Senses Considered As Perceptual Systems , 2016 .

[5]  P. Hekkert,et al.  'Most advanced, yet acceptable': typicality and novelty as joint predictors of aesthetic preference in industrial design. , 2003, British journal of psychology.

[6]  Karl T. Ulrich,et al.  Product Design and Development , 1995 .

[7]  M. Ishtiaq Book Review Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (4th ed.). Thousand Oaks, CA: Sage , 2019, English Language Teaching.

[8]  J. Blake Scott,et al.  The Practice of Usability: Teaching User Engagement Through Service-Learning , 2008 .

[9]  Gerald C. Cupchik,et al.  The evaluation of high art and popular art by naive and experienced viewers. , 1992 .

[10]  R. Giere How Models Are Used to Represent Reality , 2004, Philosophy of Science.

[11]  N. Tractinsky,et al.  What is beautiful is usable , 2000, Interact. Comput..

[12]  Martin Steinert,et al.  Eliciting unknown unknowns with prototypes: Introducing prototrials and prototrial-driven cultures , 2017 .

[13]  Kenneth R. Stern,et al.  Low vs. high-fidelity prototyping debate , 1996, INTR.

[14]  Michael J Free,et al.  Achieving appropriate design and widespread use of health care technologies in the developing world , 2004, International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics.

[15]  Juergen Sauer,et al.  Designing interactive consumer products: utility of paper prototypes and effectiveness of enhanced control labelling. , 2008, Applied ergonomics.

[16]  Tua Björklund,et al.  Initial mental representations of design problems: Differences between experts and novices , 2013 .

[17]  Michael Smyth,et al.  Designing at a distance via real-time designer-to-designer interaction , 1993 .

[18]  Kathleen H Sienko,et al.  Obstetrics‐based clinical immersion of a multinational team of biomedical engineering students in Ghana , 2014, International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics.

[19]  Teresa M. Amabile,et al.  Assessing the Work Environment for Creativity , 1996 .

[20]  Shanna R. Daly,et al.  Student use of design ethnography techniques during front-end phases of design , 2014 .

[21]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[22]  T. M. Amabile The social psychology of creativity: A componential conceptualization. , 1983 .

[23]  T. Love,et al.  Path-dependent Foundation of Global Design-driven Outdoor Trade in the Northwest of England , 2007 .

[24]  Shanna R. Daly,et al.  Requirements Development: Approaches and Behaviors of Novice Designers , 2015 .

[25]  Gregory L Herr Biodesign: the process of innovating medical technologies. , 2010, Biomedical instrumentation & technology.

[26]  Shanna R. Daly,et al.  Model Use Choices of Secondary Teachers in Nanoscale Science and Engineering Education , 2010 .

[27]  Kwadwo Mensah,et al.  Task shifting in health care in resource-poor countries , 2008, The Lancet.

[28]  Andreas Sonderegger,et al.  The influence of prototype fidelity and aesthetics of design in usability tests: effects on user behaviour, subjective evaluation and emotion. , 2009, Applied ergonomics.

[29]  Nigel Cross,et al.  Creativity in the design process: co-evolution of problem–solution , 2001 .

[30]  Maria C. Yang,et al.  A study of prototypes, design activity, and design outcome , 2005 .

[31]  G. Booysen,et al.  Client-centred design evolution via functional prototyping , 2009 .

[32]  P. Clarkson,et al.  Seeing things: consumer response to the visual domain in product design , 2004 .

[33]  M. Lorentzon Doing Qualitative Research , 1993 .

[34]  Julie S. Linsey,et al.  Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost , 2011 .

[35]  Klaus R. Scherer,et al.  Introduction: Cognitive components of emotion. , 2003 .

[36]  Nico H. Frijda Aesthetic emotions and reality. , 1989 .

[37]  T. Lancet,et al.  Technologies for global health , 2012, The Lancet.

[38]  John Baer,et al.  A Comparison of Expert and Nonexpert Raters Using the Consensual Assessment Technique , 2008 .

[39]  Sean E. Carolan,et al.  Minimum Viable Product and the Importance of Experimentation in Technology Startups , 2012 .

[40]  ศิวะพร ภู่พันธ์,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2018 .

[41]  S. Marks,et al.  Divided Sisterhood: Race, Class and Gender in the South African Nursing Profession , 1994 .

[42]  H. Leder,et al.  A model of aesthetic appreciation and aesthetic judgments. , 2004, British journal of psychology.

[43]  G. J. Rose How We Understand Art: A Cognitive Developmental Account of Aesthetic Experience , 1988 .

[44]  A. L. Edwards The social desirability variable in personality assessment and research , 1958 .

[45]  David R. Wallace,et al.  The influence of sketch quality on perception of product-idea creativity , 2012, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[46]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[47]  R. I. Campbell,et al.  Design evolution through customer interaction with functional prototypes , 2007 .

[48]  Michael Schrage,et al.  Serious Play: How the World's Best Companies Simulate to Innovate , 1999 .

[49]  D. Mishell,et al.  Safety and efficacy of Implanon, a single-rod implantable contraceptive containing etonogestrel. , 2005, Contraception.

[50]  Julie S. Linsey,et al.  METHODS FOR PROTOTYPING STRATEGIES IN CONCEPTUAL PHASES OF DESIGN: FRAMEWORK AND EXPERIMENTAL ASSESSMENT , 2013 .

[51]  Joshua D. Summers,et al.  A user study of interpretability of engineering design representations , 2012 .

[52]  Robin Adams,et al.  The Informed Design Teaching and Learning Matrix , 2012 .

[53]  Thomas J. Howard,et al.  Describing the creative design process by the integration of engineering design and cognitive psychology literature , 2008 .

[54]  Joshua Evan Blumenstock,et al.  Size matters: word count as a measure of quality on wikipedia , 2008, WWW.

[55]  Maria C. Yang,et al.  Connections Between the Design Tool, Design Attributes, and User Preferences in Early Stage Design , 2015 .

[56]  Margaret Morrison,et al.  Models as Mediators: Perspectives on Natural and Social Science , 1999 .

[57]  Youn-Kyung Lim,et al.  Comparative analysis of high- and low-fidelity prototypes for more valid usability evaluations of mobile devices , 2006, NordiCHI '06.

[58]  R. Weiss Learning from strangers : the art and method of qualitative interview studies , 1995 .

[59]  Tom Kelley,et al.  Prototyping is the shorthand of innovation , 2010 .

[60]  Jan Carel Diehl,et al.  Design considerations for base of the pyramid(BoP) projects , 2012 .

[61]  M. Patton Qualitative Research & Evaluation Methods: Integrating Theory and Practice , 2014 .

[62]  P. Desmet,et al.  Framework of product experience , 2007 .

[63]  Claus-Christian Carbon,et al.  Dimensions in appreciation of car interior design , 2005 .

[64]  Gareth Loudon,et al.  The Effect of Physicality on Low Fidelity Interactive Prototyping for Design Practice , 2013, INTERACT.

[65]  H. Arkes,et al.  The Psychology of Sunk Cost , 1985 .

[66]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[67]  K. Danso,et al.  Ghana postgraduate obstetrics/gynecology collaborative residency training program: success story and model for Africa. , 2003, American journal of obstetrics and gynecology.

[68]  Carlye Lauff,et al.  What is a Prototype?: Emergent Roles of Prototypes From Empirical Work in Three Diverse Companies , 2017 .

[69]  Marianella Chamorro-Koc,et al.  Human experience and product usability: principles to assist the design of user-product interactions. , 2008, Applied ergonomics.

[70]  Charles Hill,et al.  What do Prototypes Prototype , 1997 .

[71]  James C. Kaufman,et al.  Assessing Creativity Using the Consensual Assessment Technique , 2009 .

[72]  Ed Seidewitz,et al.  What Models Mean , 2003, IEEE Softw..

[73]  Michael Deininger,et al.  Novice designers' use of prototypes in engineering design. , 2017, Design studies.

[74]  Rosemary R. Seva,et al.  The influence of cellular phone attributes on users' affective experiences: a cultural comparison. , 2009 .

[75]  Thomas Kelley,et al.  The ten faces of innovation : IDEO's strategies for beating the devil's advocate & driving creativity throughout your organization , 2005 .

[76]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[77]  Herbert A. Simon,et al.  The Structure of Ill Structured Problems , 1973, Artif. Intell..

[78]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[79]  Jan Savage,et al.  Nursing Intimacy: An Ethnographic Approach to Nurse-patient Interaction , 1995 .

[80]  Jessica Menold,et al.  Prototype for X (PFX): A holistic framework for structuring prototyping methods to support engineering design , 2017 .

[81]  Elizabeth M. Gerber,et al.  Prototyping: Facing Uncertainty through Small Wins , 2009 .

[82]  John Baer,et al.  Extension of the Consensual Assessment Technique to Nonparallel Creative Products , 2004 .

[83]  Eva Brandt,et al.  How Tangible Mock-Ups Support Design Collaboration , 2005, Nordes 2005: In the Making.

[84]  Kristin L. Wood,et al.  AC 2012-3698: PROTOTYPING STRATEGIES: LITERATURE REVIEW AND IDENTIFICATION OF CRITICAL VARIABLES , 2012 .

[85]  Randall Tagg,et al.  Biodesign: The process of innovating medical technologies , 2010 .

[86]  Preston G. Smith The art of innovation: lessons in creativity from IDEO, America’s leading design firm: Tom Kelley with Jonathan Littman; New York: Doubleday, 2001, 308 + xii pages, $26.00 , 2002 .

[87]  D. Morgan,et al.  Qualitative Content Analysis: A Guide to Paths not Taken , 1993, Qualitative health research.

[88]  Cynthia J. Atman,et al.  Engineering Design Processes: A Comparison of Students and Expert Practitioners , 2007 .

[89]  James A. Landay,et al.  High-Fidelity or Low-Fidelity, Paper or Computer? Choosing Attributes when Testing Web Prototypes , 2002 .

[90]  R. Weber Measurement models for content analysis , 1983 .

[91]  Kristin L. Wood,et al.  Prototype Partitioning Based on Requirement Flexibility , 2004 .

[92]  Anuj K. Shah,et al.  Making Design Thinking a Part of Medical Education , 2016 .

[93]  Corrine Glesne,et al.  Becoming Qualitative Researchers: An Introduction , 1991 .

[94]  Dennis E. Egan,et al.  Handbook of Human Computer Interaction , 1988 .

[95]  Thomas R Fisher,et al.  A design thinking framework for healthcare management and innovation. , 2016, Healthcare.

[96]  M. J. Parsons How We Understand Art : A Cognitive Development Account of Aesthetic Experience , 1989 .

[97]  Shanna R. Daly,et al.  APPLYING DESIGN ETHNOGRAPHY TO PRODUCT EVALUATION: A CASE EXAMPLE OF A MEDICAL DEVICE IN A LOW-RESOURCE SETTING , 2015 .