Applying a Method for Measuring the Performance of University-Industry R&D Collaborations: Case Study Analysis

Abstract Collaborations between university and industry are possibly the most important strategic instrument used to increase the efficiency and effectiveness of industrial investments in Research and Development (R&D), and have been increasing, which assigns even more importance to the need for measuring their performance. Therefore, a method to measure university-industry R&D collaborations, named MPUIC, developed based on Design Science Research methodology (DSRM), was applied and validated through a case study. This paper firstly describes some improvements made to the previously developed MPUIC method before its application to a large program between the University of Minho and Bosch Car Multimedia (Portugal). The MPUIC method adopted a weighted scoring approach, and is composed by 31 performance indicators, distributed through the program management life cycle. Secondly, the performance measurement of the case study program is conducted, resulting in a score of 4.4 in a scale of 1 to 5, where 5 indicates “very high” performance. Finally, a questionnaire was administered to evaluate the developed method and, from the 31 performance indicators that compose the method, 29 were evaluated as having a level of relevance above 3 in a scale of 1 to 5 and, from these, 19 were evaluated as having a level of relevance equal to or above 4.

[1]  Cristina Rossi-Lamastra,et al.  Systems of indicators to evaluate the performance of university-industry alliances: a review of the literature and directions for future research , 2013 .

[2]  M. Perkmann,et al.  University Industry Relationships and Open Innovation: Towards a Research Agenda , 2007 .

[3]  Carlos F. Gomes,et al.  Performance measurement in airport settings: a systematic literature review , 2016 .

[4]  M. Perkmann,et al.  Why do academics engage with industry? The entrepreneurial university and individual motivations , 2009 .

[5]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[6]  Nick von Tunzelmann,et al.  Assessing Collaborative, Pre-Competitive R&D Projects: The Case of the UK Link Scheme , 2002 .

[7]  H. Chesbrough,et al.  Open Innovation: A New Paradigm for Understanding Industrial Innovation , 2006 .

[8]  Marge Seppo,et al.  Indicators Measuring University-Industry Cooperation , 2012 .

[9]  Ricardo J. Machado,et al.  A Program and Project Management Approach for Collaborative University-industry R&D Funded Contracts , 2015, CENTERIS/ProjMAN/HCist.

[10]  Jr. Henry C. Lucas,et al.  A Multiple-Criterion Scoring Approach To Information System Project Selection , 1976 .

[11]  William R. Bitman,et al.  A Conceptual Framework for Ranking R&D Projects , 2008, IEEE Transactions on Engineering Management.

[12]  Ricardo J. Machado,et al.  A Method for Measuring the Success of Collaborative University-Industry R&D Funded Contracts , 2017, CENTERIS/ProjMAN/HCist.

[13]  A. López,et al.  Determinants of R&D cooperation: Evidence from Spanish manufacturing firms , 2008 .

[14]  Mike Wright,et al.  Mid-range universities' linkages with industry: Knowledge types and the role of intermediaries , 2008 .

[15]  A. Sivathanu Pillai,et al.  Performance measurement of R&D projects in a multi-project, concurrent engineering environment , 2002 .

[16]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[17]  Terry Cooke-Davies,et al.  The “real” success factors on projects , 2002 .

[18]  Jeffery K. Cochran,et al.  Fuzzy multi-criteria selection of object-oriented simulation software for production system analysis , 2005, Comput. Oper. Res..

[19]  Noah P. Barsky,et al.  Utilizing the balanced scorecard for R&D performance measurement , 2004 .

[20]  L. Leydesdorff,et al.  The dynamics of innovation: from National Systems and , 2000 .

[21]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[22]  Andy Neely,et al.  How Should Firms Evaluate Success in University-Industry Alliances? A Performance Measurement System , 2010 .

[23]  Andy Neely,et al.  Performance measurement system design , 1995 .

[24]  Bruce B. Frey,et al.  Measuring Collaboration Among Grant Partners , 2006 .

[25]  John R. Moore,et al.  An analytical approach to scoring model design — Application to research and development project selection , 1969 .

[26]  Tutu Wegelius-Lehtonen,et al.  Performance measurement in construction logistics , 2001 .

[27]  H. Etzkowitz The norms of entrepreneurial science: cognitive effects of the new university-industry linkages , 1998 .

[28]  Simon P. Philbin Measuring the performance of research collaborations , 2008 .

[29]  John Kirkland Towards an integrated approach: university research management in an institutional context , 2005 .