Toward a better comprehension of Lean metrics for research and product development management

This paper presents a compilation and empirical survey‐based evaluation of the metrics most commonly used by program managers during product development management. This work is part of a bigger project of Massachusetts Institute of Technology (MIT), Project Management Institute (PMI) and International Council on Systems Engineering (INCOSE). Three methodological procedures were applied: systematic literature review, focus‐group discussions, and survey. The survey results indicate the metrics considered to be the most and least useful for managing lean engineering programs, and reveals a shift of interest towards qualitative metrics, especially the ones that address the achievement of stakeholder values, and the absence of useful metrics regarding the lean principles People and Pull.

[1]  Vittorio Chiesa,et al.  Performance measurement of research and development activities , 2009 .

[2]  Christoph H. Loch,et al.  Implementing a strategy-driven performance measurement system for an applied research group , 2002 .

[3]  Kulwant S. Pawar,et al.  Performance evaluation of new product development from a company perspective , 2001 .

[4]  Noah P. Barsky,et al.  Utilizing the balanced scorecard for R&D performance measurement , 2004 .

[5]  Floyd J. Fowler,et al.  Survey Research Methods , 1984 .

[6]  Donna H. Rhodes,et al.  SYSTEMS ENGINEERING LEADING INDICATORS GUIDE , 2007 .

[7]  Jeffrey K. Liker,et al.  The Toyota Product Development System: Integrating People, Process And Technology , 2006 .

[8]  Vittorio Chiesa,et al.  Performance Measurement in R&D: Exploring the Interplay between Measurement Objectives, Dimensions of Performance and Contextual Factors , 2009 .

[9]  Henrique Rozenfeld,et al.  Medição de desempenho para a gestão do ciclo de vida de produtos: uma revisão sistemática da literatura , 2012 .

[10]  J. Liker,et al.  The Toyota Way in Services: The Case of Lean Product Development , 2006 .

[11]  Kenneth B. Kahn,et al.  PERSPECTIVE: Trends and Drivers of Success in NPD Practices: Results of the 2003 PDMA Best Practices Study* , 2009 .

[12]  William E. Souder,et al.  Measuring R&D Performance-State of the Art , 1997 .

[13]  Sanjay Bhasin,et al.  Lean and performance measurement , 2008 .

[14]  Warren B. Brown,et al.  Observations on the measurement of R&D productivity: a case study , 1992 .

[15]  Alan W. Pearson,et al.  Performance measurement in industrial R&D , 2000 .

[16]  Michael R. Duffey,et al.  A model for effective implementation of Earned Value Management methodology , 2003 .

[17]  Andrew Cooke,et al.  Design principles for the development of measurement systems for research and development processes , 1997 .

[18]  Tim Baines,et al.  State-of-the-art in lean design engineering: A literature review on white collar lean , 2006 .

[19]  Anders Wall,et al.  Evaluation of performance in a product development context , 2010 .

[20]  D. Morgan.  The Focus Group Guidebook , 1997 .

[21]  Gerard P. H. Olthuis,et al.  Creating and Justifying Research and Development Value: Scope, Scale, Skill and Social Networking of R&D , 2002 .

[22]  Bohdan W. Oppenheim,et al.  The Guide to Lean Enablers for Managing Engineering Programs , 2012 .

[23]  Kulwant S. Pawar,et al.  Measuring international NPD projects: an evaluation process , 2005 .

[24]  Marjorie B. Platt,et al.  Performance Measures and Management Control in New Product Development , 2000 .

[25]  Hilda C. Martínez León,et al.  Lean Product Development Research: Current State and Future Directions , 2011 .

[26]  A. Griffin,et al.  An Interim Report on Measuring Product Development Success and Failure , 1993 .

[27]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[28]  Kulwant S. Pawar,et al.  Performance measurement for product design and development in a manufacturing environment , 1999 .

[29]  Bohdan W. Oppenheim,et al.  Lean for Systems Engineering with Lean Enablers for Systems Engineering: Oppenheim/Lean Systems , 2011 .

[30]  Fernando Elias Alves da Fonseca.  Proposta de um quadro referencial para o desenvolvimento de um sistema de medição de desempenho para a gestão do ciclo de vida de produtos , 2010 .

[31]  Klas Eric Soderquist,et al.  Use and impact of performance measurement results in R&D and NPD: an exploratory study , 2004 .

[32]  Sanjay Bhasin,et al.  Performance of organisations treating lean as an ideology , 2011, Bus. Process. Manag. J..

[33]  Francisco J. Molina-Castillo,et al.  New product performance indicators: Time horizon and importance attributed by managers ☆ , 2009 .

[34]  Inge C. Kerssens-van Drongelen,et al.  Design of a Research Performance Measurement System: The Case of NIAB , 2001 .

[35]  A. Fusfeld,et al.  Assessing the Value of Your Technology , 1995 .