Eliciting unknown unknowns with prototypes: Introducing prototrials and prototrial-driven cultures

This paper maps and describes how prototypes are used to elicit requirements of unknown unknowns in industry. Eight engineering design companies serve as a dataset for a multi-case investigation. By semi-quantitatively analysing 19 prototypes in terms of functionality, timing, stakeholder involvement and requirement elicitation, we present a wide spectrum of prototype utilizations. However, this broad span leads to misunderstandings of what the term ‘prototype’ encompasses, hindering exploitation of its full potential. Hence, we introduce the term ‘prototrial’ that covers functional prototypes utilized in the early stages of the design process, prototypes that effectively elicit unknown unknowns. With this contribution, we encourage introducing mind-sets and behaviours that aim at exploration and learning rather than lean implementation – a prototrial-driven culture.

[1]  Martin Steinert,et al.  Using prototypes to leverage knowledge in product development: Examples from the automotive industry , 2016, 2016 Annual IEEE Systems Conference (SysCon).

[2]  Manfred Tscheligi,et al.  Paper prototyping - what is it good for?: a comparison of paper- and computer-based low-fidelity prototyping , 2003, CHI Extended Abstracts.

[3]  Eva Brandt,et al.  How Tangible Mock-Ups Support Design Collaboration , 2005, Nordes 2005: In the Making.

[4]  Erik Stolterman,et al.  The Anatomy of Prototypes , 2010 .

[5]  Xiaohui Liu,et al.  An Integrated Approach for Modeling Learning Patterns of Students in Web-Based Instruction: A Cognitive Style Perspective , 2008, TCHI.

[6]  Mehran Ebrahimi,et al.  Viewing Boundary “Objects” as Boundary Constructions , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[7]  Stefan Holmlid,et al.  Existing Prototyping Perspectives: Considerations for service design , 2011, Nordes 2011: Making Design Matter.

[8]  Michael Schrage Cultures of prototyping , 1996 .

[9]  Maria C. Yang,et al.  A study of prototypes, design activity, and design outcome , 2005 .

[10]  Leon Williams,et al.  Cut the crap; design brief to pre-production in eight weeks: Rapid development of an urban emergency low-tech toilet for Oxfam , 2015 .

[11]  Gabriela Goldschmidt,et al.  Three studio critiquing cultures: Fun follows function or function follows fun? , 2014 .

[12]  Martin Steinert,et al.  Dancing with ambiguity: Causality behavior, design thinking, and triple-loop-learning , 2011, Inf. Knowl. Syst. Manag..

[13]  Torgeir Welo,et al.  The Role of Early Prototypes in Concept Development: Insights from the Automotive Industry , 2014 .

[14]  Daniel L. Schwartz,et al.  Parallel prototyping leads to better design results, more divergence, and increased self-efficacy , 2010, TCHI.

[15]  Wilmot Li,et al.  Creating works-like prototypes of mechanical objects , 2014, ACM Trans. Graph..

[16]  Jinhong Xie,et al.  The Impact of Cross‐Functional Joint Involvement Across Product Development Stages: An Exploratory Study , 1998 .

[17]  Marian Petre,et al.  How expert engineering teams use disciplines of innovation , 2004 .

[18]  Per-Anders Hillgren,et al.  Participatory design and "democratizing innovation" , 2010, PDC '10.

[19]  Alistair Sutcliffe,et al.  Requirements elicitation: Towards the unknown unknowns , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[20]  Xiaohui Liu,et al.  Editorial: Data mining for understanding user needs , 2010, TCHI.

[21]  Youn-Kyung Lim,et al.  Comparative analysis of high- and low-fidelity prototypes for more valid usability evaluations of mobile devices , 2006, NordiCHI '06.

[22]  Jacqueline C. Vischer,et al.  Towards an Environmental Psychology of Workspace: How People are Affected by Environments for Work , 2008 .

[23]  Alethea L. Blackler,et al.  Applications of high and low fidelity prototypes in researching intuitive interaction , 2015 .

[24]  Gareth Loudon,et al.  The Effect of Physicality on Low Fidelity Interactive Prototyping for Design Practice , 2013, INTERACT.

[25]  Lawrence Michael Enright Cut the Crap , 2009 .

[26]  Ronald Mascitelli From Experience: Harnessing Tacit Knowledge to Achieve Breakthrough Innovation , 2000 .

[27]  D. Snowden,et al.  A leader's framework for decision making , 2007 .

[28]  Christoph H. Loch,et al.  Collaborative Prototyping and the Pricing of Custom - Designed Products , 2004, Manag. Sci..

[29]  Pieter Jan Stappers,et al.  Co-creation and the new landscapes of design , 2008 .

[30]  Stephen Culley,et al.  Analysing creative behaviour in the later stage design process , 2013 .

[31]  Pekka Abrahamsson,et al.  Bridging Tangible and Virtual Interaction: Rapid Prototyping of a Gaming Idea , 2015, ICEC.

[32]  Larry Leifer,et al.  Stanford’s ME310 Course as an Evolution of Engineering Design , 2009 .

[33]  Martin Steinert,et al.  Investigation of the priming affect of material, challenge formulation and warm-up phases in soft prototyping sessions , 2016 .

[34]  Bashar Nuseibeh,et al.  Requirements engineering: a roadmap , 2000, ICSE '00.

[35]  Tyson R. Browning,et al.  A conceptual framework for tackling knowable unknown unknowns in project management , 2014 .

[36]  Charles Hill,et al.  What do Prototypes Prototype , 1997 .

[37]  Timothy W. Simpson,et al.  New product development practice application to an early-stage firm: the case of the PaperPro® StackMaster™ , 2009 .

[38]  Marcel Bogers,et al.  Collaborative Prototyping: Cross-Fertilization of Knowledge in Prototype-Driven Problem Solving , 2014 .

[39]  Pekka Abrahamsson,et al.  A Simultaneous, Multidisciplinary Development and Design Journey - Reflections on Prototyping , 2015, ICEC.

[40]  Robin Adams,et al.  Characterizing the work of coaching during design reviews , 2016 .

[41]  Monica W. Tracey,et al.  Uncertainty, Reflection, and Designer Identity Development , 2016 .

[42]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[43]  K. Eisenhardt Building theories from case study research , 1989, STUDI ORGANIZZATIVI.