A decision support framework for robust R&D budget allocation using machine learning and optimization

Abstract Considering that government funding agencies make decisions on research and development (R&D) budget allocation to support an increasing number of research proposals, effective decision support systems are necessarily required. Motivated by the efforts of the Korean government, we propose a new decision support framework for allocating an R&D budget such that it maximizes the total expected R&D output. The proposed framework incorporates an R&D output prediction model with an optimization technique. We first employ a machine learning algorithm to accurately estimate future R&D output. Then, we apply a robust optimization technique to hedge against uncertainty in the predicted R&D output values. If not properly accounted for, this uncertainty may yield an inefficient budget allocation plan, thus hindering the operation of the R&D budgeting system. We demonstrate the effectiveness of the proposed model by applying it to a national R&D program conducted by the Korean government. Specifically, using the same budget, our budget allocation plan can achieve an output 13.6% greater than the actual R&D output. Thus, our model helps to attain allocation efficiency by systematically allocating budgets. We also observe the price of robustness when our model conservatively allocates budgets in order to hedge against uncertainty in the R&D predictions. Our findings offer insights for both policymakers and researchers related to designing better budget allocation systems for national R&D programs.

[1]  Giulio Di Gravio,et al.  Project selection in project portfolio management: An artificial neural network model based on critical success factors , 2015 .

[2]  Avraham Shtub,et al.  R&D project evaluation: An integrated DEA and balanced scorecard approach ☆ , 2008 .

[3]  Andrés L. Medaglia,et al.  A multiobjective model for the selection and timing of public enterprise projects , 2008 .

[4]  Chun-Chu Liu,et al.  A study for allocating resources to research and development programs by integrated fuzzy DEA and fuzzy AHP , 2011 .

[5]  Mir-Bahador Aryanezhad,et al.  A fuzzy random multi-objective approach for portfolio selection , 2011 .

[6]  Rafael Caballero,et al.  Solving a comprehensive model for multiobjective project portfolio selection , 2010, Comput. Oper. Res..

[7]  Karim R. Lakhani,et al.  Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science , 2016, Manag. Sci..

[8]  Allen L. Soyster,et al.  Technical Note - Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming , 1973, Oper. Res..

[9]  Constantin Zopounidis,et al.  Multicriteria Portfolio Management , 2012 .

[10]  Steven A. Gabriel,et al.  A multiobjective optimization model for project selection with probabilistic considerations , 2006 .

[11]  Kannan Govindan,et al.  Supply chain network design under uncertainty: A comprehensive review and future research directions , 2017, Eur. J. Oper. Res..

[12]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[13]  Walter J. Gutjahr,et al.  Competence-driven project portfolio selection, scheduling and staff assignment , 2008, Central Eur. J. Oper. Res..

[14]  Louise A. Heslop,et al.  Development of a Technology Readiness Assessment Measure: The Cloverleaf Model of Technology Transfer , 2001 .

[15]  Laura Cruz Reyes,et al.  Static R&D project portfolio selection in public organizations , 2016, Decis. Support Syst..

[16]  Arkadi Nemirovski,et al.  Robust solutions of Linear Programming problems contaminated with uncertain data , 2000, Math. Program..

[17]  Stelios D. Bekiros,et al.  Multivariate Dependence Risk and Portfolio Optimization: An Application to Mining Stock Portfolios , 2015 .

[18]  Yu-Ren Wang,et al.  Predicting construction cost and schedule success using artificial neural networks ensemble and support vector machines classification models , 2012 .

[19]  F. Fabozzi Robust Portfolio Optimization and Management , 2007 .

[20]  Richard H. Bernhard Mathematical Programming Models for Capital Budgeting—A Survey, Generalization, and Critique , 1969 .

[21]  Christian Stummer,et al.  Research and development project selection and resource allocation: a review of quantitative modelling approaches , 1999 .

[22]  Jaeho Lee,et al.  Development of a new technology product evaluation model for assessing commercialization opportunities using Delphi method and fuzzy AHP approach , 2013, Expert Syst. Appl..

[23]  John H. Friar,et al.  Factors for success in R&D projects and new product innovation: a contextual framework , 1997 .

[24]  Craig S. Galbraith,et al.  Can experts really assess future technology success? A neural network and Bayesian analysis of early stage technology proposals , 2007 .

[25]  L. J. Savage,et al.  Three Problems in Rationing Capital , 1955 .

[26]  Morton B. Brown,et al.  Robust Tests for the Equality of Variances , 1974 .

[27]  Norman P. Archer,et al.  Project portfolio selection through decision support , 2000, Decis. Support Syst..

[28]  Masood A. Badri,et al.  A comprehensive 0-1 goal programming model for project selection , 2001 .

[29]  P. Guo,et al.  R&D project portfolio selection model analysis within project interdependencies context , 2008, 2008 IEEE International Conference on Industrial Engineering and Engineering Management.

[30]  Dov Dvir,et al.  Critical managerial factors affecting defense projects success: A comparison between neural network and regression analysis , 2006, Eng. Appl. Artif. Intell..

[31]  Byung-Cheol Kim,et al.  Project Selection in NIH: A Natural Experiment from ARRA , 2015 .

[32]  Uk Jung,et al.  An ANP approach for R&D project evaluation based on interdependencies between research objectives and evaluation criteria , 2010, Decis. Support Syst..

[33]  Eduardo Fernández,et al.  Large-Scale Public R&D Portfolio Selection by Maximizing a Biobjective Impact Measure , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[34]  Michael A. Talias,et al.  Optimal decision indices for R&D project evaluation in the pharmaceutical industry: Pearson index versus Gittins index , 2007, Eur. J. Oper. Res..

[35]  Paul C. Ivey,et al.  An R&D options selection model for investment decisions , 2005 .

[36]  Jian Wang,et al.  Bias Against Novelty in Science: A Cautionary Tale for Users of Bibliometric Indicators , 2015 .

[37]  Christoph Grimpe,et al.  Extramural research grants and scientists’ funding strategies: Beggars cannot be choosers? , 2012 .

[38]  Richard F. Hartl,et al.  Pareto Ant Colony Optimization: A Metaheuristic Approach to Multiobjective Portfolio Selection , 2004, Ann. Oper. Res..

[39]  Samarjit Kar,et al.  Fuzzy mean-variance-skewness portfolio selection models by interval analysis , 2011, Comput. Math. Appl..

[40]  Edward G. Anderson,et al.  Evaluating system dynamics models of risky projects using decision trees: alternative energy projects as an illustrative example , 2010 .

[41]  A. Çagri Tolga,et al.  Fuzzy multicriteria R&D project selection with a real options valuation model , 2008, J. Intell. Fuzzy Syst..

[42]  Yu-Ren Wang,et al.  A study of preproject planning and project success using ANNs and regression models , 2008 .

[43]  Ahti Salo,et al.  Selecting infrastructure maintenance projects with Robust Portfolio Modeling , 2015, Decis. Support Syst..

[44]  Minghe Sun,et al.  Robust optimization for interactive multiobjective programming with imprecise information applied to R&D project portfolio selection , 2014, Eur. J. Oper. Res..

[45]  Guomin Zhang,et al.  Modelling optimal risk allocation in PPP projects using artificial neural networks , 2011 .

[46]  Dessislava A. Pachamanova,et al.  A robust optimization approach to asset-liability management under time-varying investment opportunities , 2013 .

[47]  Francisco Saldanha-da-Gama,et al.  Facility location and supply chain management - A review , 2009, Eur. J. Oper. Res..

[48]  Ahti Salo,et al.  Fostering breakthrough technologies — How do optimal funding decisions depend on evaluation accuracy? , 2015, Technological Forecasting and Social Change.

[49]  J. Fedderke,et al.  Does massive funding support of researchers work?: Evaluating the impact of the South African research chair funding initiative , 2015 .

[50]  Jian-Bo Yang,et al.  Evaluation, ranking and selection of R&D projects by multiple experts: an evidential reasoning rule based approach , 2017, Scientometrics.

[51]  Junying Liu,et al.  Interrelationships among Critical Success Factors of Construction Projects Based on the Structural Equation Model , 2012 .

[52]  Fouad Ben Abdelaziz,et al.  A Discrete Stochastic Goal Program for Portfolio Selection: The Case of United Arab Emirates Equity Market , 2009, INFOR Inf. Syst. Oper. Res..

[53]  Lieh-Ming Luo Optimal diversification for R&D project portfolios , 2011, Scientometrics.