Use and impact of performance measurement results in R&D and NPD: an exploratory study

Performance measurement of R&D and new product development (NPD) activities is gaining increased importance, because the effectiveness and efficiency of these activities not only determine a firm's competitive advantage, but its very survival. The literature is rich on descriptions of measurement techniques and methods, but pays less attention to the actual use of the performance results in operations and decision-making. In this paper, reporting results from interviews conducted in three large companies in the electronics industry, we validate and further specify key areas of use and impact of R&D and NPD performance measurement results including ensuring better coherence and relevance of product portfolios, reorienting projects before failure, deciding on corrective actions, supporting the launching decision, enhancing staff motivation, and facilitating well-balanced decision-making. We identify implications for practice and research and propose a framework for future empirical work focusing on the interplay between the operation of the performance measurement system, the use and the impacts of measurement results.

[1]  E. Geisler,et al.  An integrated cost-performance model of research and development evaluation , 1995 .

[2]  Klas Eric Soderquist,et al.  Information Systems in Fast Cycle Development: Identifying User Needs in Integrated Automotive Component Development , 2000 .

[3]  James M. Utterback,et al.  Mastering the Dynamics of Innovation , 1996 .

[4]  Jan Bilderbeek,et al.  R&D Performance Measurement: More than Choosing a Set of Metrics , 1997 .

[5]  Abbie Griffin,et al.  Launch decisions and new product success: an empirical comparison of consumer and industrial products , 2000 .

[6]  E. Roberts.  What We've Learned: Managing Invention and Innovation , 1988 .

[7]  Klas Eric Soderquist,et al.  Performance measurement in R&D and new product development: setting the scene , 2004 .

[8]  Barry M. Staw,et al.  Knee-deep in the Big Muddy: A study of escalating commitment to a chosen course of action. , 1976 .

[9]  Michael E. McGrath,et al.  The R&D Effectiveness Index , 1994 .

[10]  Donald S. Remer,et al.  Measuring R&D Productivity , 1985 .

[11]  Melissa A. Schilling,et al.  Managing the new product development process: Strategic imperatives , 1998 .

[12]  Rene Cordero,et al.  The measurement of innovation performance in the firm: An overview , 1990 .

[13]  Petra C. de Weerd-Nederhof,et al.  The use of performance measurement tools for balancing short- and long-term NPD performances , 1999 .

[14]  Gary E. Roberts.  Perspectives on Enduring and Emerging Issues in Performance Appraisal , 1998 .

[15]  Gary S. Lynn,et al.  New Product Team Learning: Developing and Profiting from Your Knowledge Capital , 1998 .

[16]  Jeremy Busby,et al.  The appropriate use of performance measurement in non‐production activity: The case of engineering design , 2000 .

[17]  Michael A. Cusumano,et al.  Thinking Beyond Lean: How Multi Project Management is Transforming Product Development at Toyota and Other Companies , 1998 .

[18]  Robert G. Cooper,et al.  Stage-gate systems: A new tool for managing new products , 1990 .

[19]  William E. Souder,et al.  Measuring R&D Performance-State of the Art , 1997 .

[20]  K. Ulrich,et al.  Planning for Product Platforms , 1998 .

[21]  Nikolaos Tzokas,et al.  An analysis of product deletion scenarios , 2000 .

[22]  Abbie Griffin,et al.  Industrial New Product Launch Strategies and Product Development Performance , 1997 .

[23]  Alan W. Pearson,et al.  Performance measurement in industrial R&D , 2000 .

[24]  Andrew Cooke,et al.  Design principles for the development of measurement systems for research and development processes , 1997 .

[25]  O.A.M. Fisscher,et al.  Describing the issues of knowledge management in R&D: Towards a communication and analysis tool , 1996 .

[26]  Marc H. Meyer,et al.  Metrics for Managing Research and Development in the Context of the Product Family , 1997 .

[27]  Michael E. McGrath,et al.  The R&D effectiveness index: A metric for product development performance , 1994 .

[28]  John R. Hauser,et al.  Metrics to evaluate R,D&E , 1997 .

[29]  Dov Dori,et al.  System modeling of the R&D domain through the object–process methodology: a practical tool to help R&D satisfy its customers' needs , 1997 .

[30]  Durward K. Sobek,et al.  The Second Toyota Paradox: How Delaying Decisions Can Make Better Cars Faster , 1995 .

[31]  Raynold A. Svenson,et al.  Measuring R&D Productivity , 1988 .

[32]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[33]  Marco Iansiti,et al.  Technology integration: turning great research into great products , 1997 .

[34]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[35]  Didier P. Hostettler,et al.  The Balanced Scorecard: a Necessary Good or an Unnecessary Evil , 1999 .

[36]  Nandini Rajagopalan,et al.  TOWARD A THEORY OF STRATEGIC CHANGE: A MULTI-LENS PERSPECTIVE AND INTEGRATIVE FRAMEWORK , 1997 .

[37]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[38]  A. H. Schainblatt,et al.  How Companies Measure the Productivity of Engineers and Scientists , 1982 .

[39]  Brenda L. Rinholm,et al.  New Product Management Practices of Small High Technology Firms , 1989 .

[40]  Steven C. Wheelwright,et al.  Revolutionizing New Product Development: Quantum Leaps in Speed, Efficiency, and Quality (Революция в разработке продуктов: количественный скачок в скорости, эффективности и качестве) , 1992 .

[41]  Christoph H. Loch,et al.  Measuring development performance in the electronics industry , 1996 .

[42]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1992 .

[43]  Michael F. Wolff,et al.  Managers at Work: When Conflict Erupts , 1982 .

[44]  V. Srinivasan,et al.  The Predictive Power of Internet‐Based Product Concept Testing Using Visual Depiction and Animation , 2000 .

[45]  Richard Staelin,et al.  Pulling the Plug to Stop the New Product Drain , 1997 .

[46]  M. Moser.  Measuring Performance in R&D Settings , 1985 .

[47]  A. Griffin,et al.  An Interim Report on Measuring Product Development Success and Failure , 1993 .

[48]  K. Eisenhardt,et al.  The Art of Continuous Change : Linking Complexity Theory and Time-Paced Evolution in Relentlessly Shifting Organizations , 1997 .

[49]  D. Freidel,et al.  An interim report , 1986 .

[50]  M. Menke.  Managing R&D for Competitive Advantage , 1997 .

[51]  William E. Souder,et al.  Measuring R&D Performance—U.S. and German Practices , 1997 .

[52]  Christopher W. Miller,et al.  Perspective—riding the wind: managing new product development in an age of change , 2000 .

[53]  Christoph H. Loch,et al.  Implementing a strategy-driven performance measurement system for an applied research group , 2002 .