A model for R&D performance measurement

R&D activities are increasingly costly and risky and, as a consequence, measuring their performance and contribution to value becomes critical. This paper illustrates a formal model for measuring R&D performance, based upon a balanced and synthetic evaluation of quantitative indicators from five different perspectives of performance: financial, customer, innovation and learning, internal business, alliances, and networks. The model is built in coherence with the suggestions coming from the theory of measurement in soft systems, which gives relevant guidelines for ensuring validity, objectivity and inter-subjectivity of the model. Then, an application in a real R&D setting is described, which helps to understand the model and to enlighten its main advantages and limits.

[1]  Christoph H. Loch,et al.  Implementing a strategy-driven performance measurement system for an applied research group , 2002 .

[2]  Jakki J. Mohr,et al.  Marketing of High-Technology Products and Innovations , 2001 .

[3]  Vijay Mahajan,et al.  Issues and Opportunities in New Product Development: An Introduction to the Special Issue , 1997 .

[4]  Michael D. Michalisin.  Validity of annual report assertions about innovativeness: an empirical investigation , 2001 .

[5]  Kenneth B. Kahn.  An exploratory Investigation of new product forecasting practices , 2002 .

[6]  Garrett van Ryzin,et al.  An Analysis of Product Lifetimes in a Technologically Dynamic Industry , 1998 .

[7]  John Bessant,et al.  Managing Innovation: Integrating Technological, Market, and Organizational Change, 2nd Edition , 2001 .

[8]  Ehud Zuscovitch,et al.  The Economic Impact of Subsidized Industrial R&D in Israel , 2002 .

[9]  Andy Neely,et al.  Business performance measurement: Performance measurement – practical applications , 2002 .

[10]  Donald S. Remer,et al.  Measuring R&D Productivity , 1985 .

[11]  Michel Lebas,et al.  A conceptual and operational delineation of performance , 2002 .

[12]  Jennifer Kunz,et al.  Performance Evaluation in Multistep Processes—A Comparison of Evaluation Types With Special Emphasis on R&D , 2010, IEEE Transactions on Engineering Management.

[13]  Noah P. Barsky,et al.  Utilizing the balanced scorecard for R&D performance measurement , 2004 .

[14]  Mike Gregory,et al.  Integrated performance measurement - a review of current practice and emerging trends , 1993 .

[15]  L. Finkelstein,et al.  Problems of measurement in soft systems , 2005 .

[16]  John R. Hauser,et al.  Research, development, and engineering metrics , 1998 .

[17]  P. Coughlan,et al.  Development of a technical innovation audit , 1996 .

[18]  Jaana Sandström,et al.  The problem of managing product development engineers: Can the balanced scorecard be an answer? , 2002 .

[19]  Kulwant S. Pawar,et al.  Performance measurement for product design and development in a manufacturing environment , 1999 .

[20]  R. Kaplan,et al.  Alignment: Using the Balanced Scorecard to Create Corporate Synergies , 2006 .

[21]  Vittorio Chiesa,et al.  Performance Measurement in R&D: Exploring the Interplay between Measurement Objectives, Dimensions of Performance and Contextual Factors , 2009 .

[22]  W. Eichhorn,et al.  Measurement in Economics , 1988 .

[23]  Raffaella Manzini,et al.  Measuring performance in R&NPD: The case of Whitehead Alenia Sistemi Subacquei – a Finmeccanica company , 2010 .

[24]  U. W. Thonemann,et al.  Supply Chain Flexibility, Uncertainty and Firm Performance: An Empirical Analysis of German Manufacturing Firms , 2010 .

[25]  Ana Isabel Jiménez-Zarco,et al.  Performance Measurement System (PMS) Integration into New Product Innovation: A Literature Review and Conceptual Framework , 2006 .

[26]  Luca Mari,et al.  Epistemology of measurement , 2003 .

[27]  L. Finkelstein.  Widely, strongly and weakly defined measurement , 2003 .

[28]  Paul Germeraad.  The Changing Role of R&D , 2001 .

[29]  Klas Eric Soderquist,et al.  Use and impact of performance measurement results in R&D and NPD: an exploratory study , 2004 .

[30]  Rod Coombs,et al.  A literature-based innovation output indicator , 1996 .

[31]  Ashraf M. Ahmed,et al.  Virtual integrated performance measurement , 2002 .

[32]  John Howells,et al.  A socio-cognitive approach to innovation , 1995 .

[33]  Chia Ling Lee,et al.  Performance measurement systems for knowledge management in high technology industries: a balanced scorecard framework , 2007, Int. J. Technol. Manag..

[34]  Fiorenzo Franceschini,et al.  Measurements, evaluations and preferences: A scheme of classification according to the representational theory , 2006 .

[35]  Elias G. Carayannis,et al.  Measuring firm innovativeness: towards a composite innovation index built on firm innovative posture, propensity and performance attributes , 2008 .

[36]  V. Mahajan,et al.  Editorial: Issues and Opportunities in New Product Development: An Introduction to the Special Issue , 1997 .

[37]  J. Hagedoorn,et al.  Measuring innovative performance: is there an advantage in using multiple indicators? , 2003 .

[38]  Andrew Cooke,et al.  Design principles for the development of measurement systems for research and development processes , 1997 .

[39]  G Zanda,et al.  LA VALUTAZIONE DELLE AZIENDE , 1997 .

[40]  Vittorio Chiesa,et al.  Designing a performance measurement system for the research activities: A reference framework and an empirical study , 2008 .

[41]  Raynold A. Svenson,et al.  Measuring R&D Productivity , 1988 .

[42]  Jerzy Baruk,et al.  Innovativeness of Polish enterprises in the initial period of system transformation , 1997 .

[43]  Esra Karasakal,et al.  R&D Project Performance Evaluation With Multiple and Interdependent Criteria , 2010, IEEE Transactions on Engineering Management.

[44]  Francisco J. Molina-Castillo,et al.  New product performance indicators: Time horizon and importance attributed by managers ☆ , 2009 .

[45]  Ville Ojanen,et al.  Coping with the multiple dimensions of R&D performance analysis , 2006, Int. J. Technol. Manag..

[46]  T. M. Nevens,et al.  Commercializing technology: What the best companies do , 1990 .

[47]  Jan Bilderbeek,et al.  R&D Performance Measurement: More than Choosing a Set of Metrics , 1997 .

[48]  K. Srinivasa Rao,et al.  Performance monitoring in R&D projects , 1996 .

[49]  Pankaj Kohli,et al.  Idea Generation: Who Has The Most Profitable Ideas , 1998 .

[50]  Luca Mari,et al.  Measurement in soft systems: Epistemological framework and a case study , 2009 .

[51]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[52]  R. Parthasarthy,et al.  Product innovation input and outcome: moderating effects of the innovation process , 2002 .

[53]  William E. Souder,et al.  Measuring R&D Performance-State of the Art , 1997 .

[54]  Virpi Leivo,et al.  Assessment of quality and maturity level of R&D , 2002 .

[55]  Lowell W. Steele.  Evaluating the Technical Operation , 1988 .