Performance measurement in R&D and new product development: setting the scene

In parallel to the focus on what is a high performance R&D and new product development (NPD) organisation, the question of measuring the performance of R&D and NPD is gaining increasing interest. Internally, many projects never result in a commercial product, and if they do, still many new products fail to generate economic return in the marketplace. Numerous different methods have been developed in order to evaluate R&D and NPD outputs (expected and realised), inputs (resources allocated, enabling structures/factors etc.), and the processes involved (project management, learning dynamics etc.). The paper presents a comprehensive literature review of the rationales, metrics and methods of performance measurement in R&D and NPD. It introduces seven performance measurement perspectives: financial, customer satisfaction, strategic management, process management, technology management, innovation, and knowledge management. This overview gives managers a framework for developing their measurement strategy and provides a platform for further academic research into R&D performance measurement.

[1]  James M. Utterback,et al.  Mastering the Dynamics of Innovation , 1996 .

[2]  Daniel T. Jones,et al.  The machine that changed the world : based on the Massachusetts Institute of Technology 5-million dollar 5-year study on the future of the automobile , 1990 .

[3]  M. Bensaou Portfolios of Buyer-Supplier Relationships , 1999 .

[4]  R. Cooper,et al.  Benchmarking the Firm's Critical Success Factors in New Product Development , 1995 .

[5]  Melissa A. Schilling,et al.  Managing the new product development process: Strategic imperatives , 1998 .

[6]  Robert Szakonyi,et al.  Measuring R&D Effectiveness—I , 1994 .

[7]  J. Tipping Doing a Lot More with a Lot Less , 1993 .

[8]  Klas Eric Soderquist,et al.  Information Systems in Fast Cycle Development: Identifying User Needs in Integrated Automotive Component Development , 2000 .

[9]  David Wilemon,et al.  Excelling in R&D , 2000 .

[10]  Jan Bilderbeek,et al.  R&D Performance Measurement: More than Choosing a Set of Metrics , 1997 .

[11]  M. Moser Measuring Performance in R&D Settings , 1985 .

[12]  K. Cameron Effectiveness as Paradox: Consensus and Conflict in Conceptions of Organizational Effectiveness , 1986 .

[13]  A. Griffin,et al.  An Interim Report on Measuring Product Development Success and Failure , 1993 .

[14]  Marco Iansiti,et al.  Technology integration: turning great research into great products , 1997 .

[15]  J. D. Sherman,et al.  Environmental Uncertainty, Organizational Integration, and New Product Development Effectiveness: A Test of Contingency Theory , 1998 .

[16]  Dov Dori,et al.  System modeling of the R&D domain through the object–process methodology: a practical tool to help R&D satisfy its customers' needs , 1997 .

[17]  Durward K. Sobek,et al.  The Second Toyota Paradox: How Delaying Decisions Can Make Better Cars Faster , 1995 .

[18]  Raynold A. Svenson,et al.  Measuring R&D Productivity , 1988 .

[19]  James Richardson Beyond Partnership: Strategies for Innovation and Lean Supply , 1994 .

[20]  O.A.M. Fisscher,et al.  Describing the issues of knowledge management in R&D: Towards a communication and analysis tool , 1996 .

[21]  Marc H. Meyer,et al.  Metrics for Managing Research and Development in the Context of the Product Family , 1997 .

[22]  A. D. Henriksen,et al.  A practical R&D project-selection scoring tool , 1999 .

[23]  J. Schumpeter The Theory of Economic Development: An Inquiry into Profits, Capital, Credit, Interest, and the Business Cycle , 1934 .

[24]  Robert G. Cooper,et al.  Stage-gate systems: A new tool for managing new products , 1990 .

[25]  William E. Souder,et al.  Measuring R&D Performance-State of the Art , 1997 .

[26]  E. Geisler,et al.  An integrated cost-performance model of research and development evaluation , 1995 .

[27]  A. Griffin Metrics for Measuring Product Development Cycle Time , 1993 .

[28]  Pär Åhlström,et al.  The difficult path to lean product development , 1996 .

[29]  Didier P. Hostettler,et al.  The Balanced Scorecard: a Necessary Good or an Unnecessary Evil , 1999 .

[30]  A. Fusfeld,et al.  Assessing the Value of Your Technology , 1995 .

[31]  W. Souder,et al.  An information transfer model for integrating marketing and R&D Personnel in new product development projects , 1990 .

[32]  Thomas W. Scott,et al.  Performance measurement and managerial teams , 1999 .

[33]  Robert M. Ranftl Seven Keys To High Productivity , 1986 .

[34]  William E. Souder,et al.  Measuring R&D Performance—U.S. and German Practices , 1997 .

[35]  Christer Karlsson,et al.  The Superweight Project Team and Manager , 1998 .

[36]  A. H. Schainblatt,et al.  How Companies Measure the Productivity of Engineers and Scientists , 1982 .

[37]  Andrew Cooke,et al.  Design principles for the development of measurement systems for research and development processes , 1997 .

[38]  Michael A. Cusumano,et al.  Thinking Beyond Lean: How Multi Project Management is Transforming Product Development at Toyota and Other Companies , 1998 .

[39]  Klas Eric Soderquist,et al.  Strategic outsourcing through specifications , 2000 .

[40]  K. Ulrich,et al.  Planning for Product Platforms , 1998 .

[41]  R. Kaplan,et al.  The Balanced Scorecard: Translating Strategy into Action , 1996 .

[42]  Steven C. Wheelwright,et al.  Revolutionizing New Product Development: Quantum Leaps in Speed, Efficiency, and Quality (Революция в разработке продуктов: количественный скачок в скорости, эффективности и качестве) , 1992 .

[43]  Christoph H. Loch,et al.  Measuring development performance in the electronics industry , 1996 .

[44]  Brenda L. Rinholm,et al.  New Product Management Practices of Small High Technology Firms , 1989 .

[45]  Rajan R. Kamath,et al.  A Second Look at Japanese Product Development , 1995 .

[46]  Steven C. Wheelwright,et al.  The Perpetual Enterprise Machine: Seven Keys to Corporate Renewal through Successful Product and Process Development , 1994 .

[47]  T. M. Foster,et al.  Making R&D More Effective at Westinghouse , 1996 .

[48]  Michael E. McGrath,et al.  The R&D Effectiveness Index , 1994 .

[49]  John R. Hauser,et al.  Metrics to evaluate R,D&E , 1997 .

[50]  K. Eisenhardt,et al.  PRODUCT DEVELOPMENT: PAST RESEARCH, PRESENT FINDINGS, AND FUTURE DIRECTIONS , 1995 .

[51]  Abbie Griffin,et al.  Industrial New Product Launch Strategies and Product Development Performance , 1997 .

[52]  Lawrence H. Linden,et al.  Improving the Return on R&D—II , 1985 .

[53]  Donald S. Remer,et al.  Measuring R&D Productivity , 1985 .

[54]  Daniel H. Kim The Link between individual and organizational learning , 1997 .