Performance measurement of R&D projects in a multi-project, concurrent engineering environment

Abstract An R&D Project can be characterized by its life cycle with three phases of evolution, viz., Project Selection Phase (Screening, Evaluation, Selection), Project Execution Phase (Technology Development, Product Development, Performance Demonstration) and Implementation Phase (Production, Marketing, Sales). The traditional approach of performance measurement deals with each of these phases in isolation. As a result, the evaluation models and performance measurement criteria are separate for each phase. Once a project is selected, all attention is focused on its completion within the stipulated time and cost, without much consideration to either the assumptions made at the time of project selection or the requirements of the implementation phase. As a result, performance measurement system for project execution phase is totally independent of other phases. In an R&D environment with high uncertainty and complexity, coupled with multiple projects competing for limited common resources, use of different models of evaluation at different phases may lead to incorrect assessment and poor overall performance. This paper addresses this important issue and suggests a framework for an Integrated Performance Index encompassing the entire lifecycle of R&D projects. The framework identifies the key factors in each phase of the project lifecycle and integrates them through a formula to derive an Integrated Performance Index that can be used to measure the overall performance of a project at any point of time during its life cycle.

[1]  Rene Cordero,et al.  The measurement of innovation performance in the firm: An overview , 1990 .

[2]  J Berny,et al.  Macrosimulation of project risks-a practical way forward , 1993 .

[3]  L. C. Krogh,et al.  How 3M Evaluates Its R&D Programs , 1988 .

[4]  J. R. Turner,et al.  Programme management and its information systems requirements , 1992 .

[5]  Marc H. Meyer,et al.  Metrics for Managing Research and Development in the Context of the Product Family , 1997 .

[6]  J. Rodney Turner Project management: future developments for the short and medium term , 1994 .

[7]  Gerard H. Gaynor Monitoring Projects—It's More than Reading Reports , 1996 .

[8]  K. Srinivasa Rao,et al.  Performance monitoring in R&D projects , 1996 .

[9]  A del Caño,et al.  Continuous project feasibility study and continuous project risk assessment , 1992 .

[10]  A Platje,et al.  Breakthrough in multiproject management: how to escape the vicious circle of planning and control , 1993 .

[11]  J. R. Turner,et al.  Goals-and-methods matrix: coping with projects with ill defined goals and/or methods of achieving them , 1993 .

[12]  John G. Porter Post Audits — An Aid to Research Planning , 1978 .

[13]  James R. Freeland,et al.  Recent progress in modeling R&D project-selection processes , 1992 .

[14]  Matthew J. Liberatore R&D project selection , 1986 .

[15]  Ja Jimme Keizer,et al.  Diagnosing risks in product-innovation projects , 1994 .

[16]  Robert G. Batson,et al.  Characteristics of R&D management which influence information needs , 1987, IEEE Transactions on Engineering Management.

[17]  Morten Fangel The broadening of project management , 1993 .

[18]  John H Payne,et al.  Management of multiple simultaneous projects: a state-of-the-art review , 1995 .

[19]  Lawrence H. Linden,et al.  Improving the Return on R&D—II , 1985 .