A fuzzy group data envelopment analysis model for high-technology project selection: A case study at NASA

The assessment and selection of high-technology projects is a difficult decision making process at the National Aeronautic and Space Administration (NASA). This difficulty is due to the multiple and often conflicting objectives in addition to the inherent technical complexities and valuation uncertainties involved in the assessment process. As such, a systematic and transparent decision making process is needed to guide the assessment process, shape the decision outcomes and enable confident choices to be made. Various methods have been proposed to assess and select high-technology projects. However, applying these methods has become increasingly difficult in the space industry because there are many emerging risks implying that decisions are subject to significant uncertainty. The source of uncertainty can be vagueness or ambiguity. While vague data are uncertain because they lack detail or precision, ambiguous data are uncertain because they are subject to multiple interpretations. We propose a data envelopment analysis (DEA) model with ambiguity and vagueness. The vagueness of the objective functions is modeled by means of multi-objective fuzzy linear programming. The ambiguity of the input and output data is modeled with fuzzy sets and a new @a-cut based method. The proposed models are linear, independent of @a-cut variables, and capable of maximizing the satisfaction level of the fuzzy objectives and efficiency scores, simultaneously. Moreover, these models are capable of generating a common set of multipliers for all projects in a single run. A case study involving high-technology project selection at NASA is used to demonstrate the applicability of the proposed models and the efficacy of the procedures and algorithms.

[1]  Peijun Guo,et al.  Fuzzy DEA: a perceptual evaluation method , 2001, Fuzzy Sets Syst..

[2]  M. Khodabakhshi,et al.  An additive model approach for estimating returns to scale in imprecise data envelopment analysis , 2010 .

[3]  D. Dubois,et al.  Systems of linear fuzzy constraints , 1980 .

[4]  John-Paul Clarke,et al.  Optimization of R&D project portfolios under endogenous uncertainty , 2010, Eur. J. Oper. Res..

[5]  Adel Hatami-Marbini,et al.  An ideal-seeking fuzzy data envelopment analysis framework , 2010, Appl. Soft Comput..

[6]  Paul C. Ivey,et al.  An R&D options selection model for investment decisions , 2005 .

[7]  H.-J. Zimmermann,et al.  Fuzzy set theory—and its applications (3rd ed.) , 1996 .

[8]  G. Klir Where do we stand on measures of uncertainty, ambiguity, fuzziness, and the like? , 1987 .

[9]  Chiang Kao,et al.  Fuzzy efficiency measures in data envelopment analysis , 2000, Fuzzy Sets Syst..

[10]  A. Charnes,et al.  Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis , 1984 .

[11]  Tomoe Entani,et al.  Dual models of interval DEA and its extension to interval data , 2002, Eur. J. Oper. Res..

[12]  Madjid Tavana,et al.  CROSS: A Multicriteria Group-Decision-Making Model for Evaluating and Prioritizing Advanced-Technology Projects at NASA , 2003, Interfaces.

[13]  Gintaras V. Reklaitis,et al.  Valuation of project portfolios: An endogenously discounted method , 2010, Eur. J. Oper. Res..

[14]  Mohamed Dia A model of fuzzy data envelopment analysis , 2004 .

[15]  Shu-Cherng Fang,et al.  Fuzzy BCC Model for Data Envelopment Analysis , 2003, Fuzzy Optim. Decis. Mak..

[16]  Ying Luo,et al.  Fuzzy data envelopment analysis based upon fuzzy arithmetic with an application to performance assessment of manufacturing enterprises , 2009, Expert Syst. Appl..

[17]  M. Soleimani-damaneh Fuzzy upper bounds and their applications , 2008 .

[18]  Masahiro Inuiguchi,et al.  Possibilistic linear programming: a brief review of fuzzy mathematical programming and a comparison with stochastic programming in portfolio selection problem , 2000, Fuzzy Sets Syst..

[19]  Shu-Hsien Liao,et al.  A fuzzy real option approach for investment project valuation , 2011, Expert Syst. Appl..

[20]  J. Sengupta A fuzzy systems approach in data envelopment analysis , 1992 .

[21]  Gq Huang,et al.  Computers & Industrial Engineering , 2015 .

[22]  Kaveh Khalili Damghani,et al.  A hybrid fuzzy multiple criteria group decision making approach for sustainable project selection , 2013, Appl. Soft Comput..

[23]  Ioannis Stamelos,et al.  Managing uncertainty in project portfolio cost estimation , 2001, Inf. Softw. Technol..

[24]  J. Linton,et al.  Analysis, ranking and selection of R&D projects in a portfolio , 2002 .

[25]  Beyza Ahlatçioglu Ozkok,et al.  Fuzzy portfolio selection using fuzzy analytic hierarchy process , 2009, Inf. Sci..

[26]  Didier Dubois,et al.  A class of fuzzy measures based on triangular norms , 1982 .

[27]  Avraham Shtub,et al.  R&D project evaluation: An integrated DEA and balanced scorecard approach ☆ , 2008 .

[28]  Cengiz Kahraman,et al.  Data envelopment analysis using fuzzy concept , 1998, Proceedings. 1998 28th IEEE International Symposium on Multiple- Valued Logic (Cat. No.98CB36138).

[29]  Peijun Guo,et al.  Fuzzy data envelopment analysis and its application to location problems , 2009, Inf. Sci..

[30]  M. Soleimani-damaneh Establishing the existence of a distance-based upper bound for a fuzzy DEA model using duality , 2009 .

[31]  A. D. Henriksen,et al.  A practical R&D project-selection scoring tool , 1999 .

[32]  Soroosh Nalchigar,et al.  Information technology project evaluation: An integrated data envelopment analysis and balanced scorecard approach , 2010, Expert Syst. Appl..

[33]  C. Kao,et al.  A mathematical programming approach to fuzzy efficiency ranking , 2003 .

[34]  Mir-Bahador Aryanezhad,et al.  A modular Decision Support System for optimum investment selection in presence of uncertainty: Combination of fuzzy mathematical programming and fuzzy rule based system , 2011, Expert Syst. Appl..

[35]  Wade D. Cook,et al.  Project prioritization: a resource-constrained data envelopment analysis approach , 2000 .

[36]  Robert Phaal,et al.  From theory to practice: challenges in operationalising a technology selection framework , 2006 .

[37]  Lawrence M. Seiford,et al.  Data envelopment analysis (DEA) - Thirty years on , 2009, Eur. J. Oper. Res..

[38]  Gad Vitner,et al.  Using data envelope analysis to compare project efficiency in a multi-project environment , 2006 .

[39]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[40]  Stephen C. Graves,et al.  Technology portfolio management: optimizing interdependent projects over multiple time periods , 2001, IEEE Trans. Engineering Management.

[41]  Iain MacGill,et al.  A Monte Carlo based decision-support tool for assessing generation portfolios in future carbon constrained electricity industries , 2012 .

[42]  Majid Soleimani-Damaneh,et al.  Computational and theoretical pitfalls in some current performance measurement techniques; and a new approach , 2006, Appl. Math. Comput..

[43]  A. Kandel,et al.  Fuzzy linear regression and its applications to forecasting in uncertain environment , 1985 .

[44]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[45]  Pin-Yu Chu,et al.  A fuzzy AHP application in government-sponsored R&D project selection☆ , 2008 .

[46]  E. Hultink,et al.  Portfolio decision-making genres: A case study , 2009 .

[47]  Richard Bellman,et al.  Decision-making in fuzzy environment , 2012 .

[48]  R. Hämäläinen,et al.  An Experiment on the Numerical Modelling of Verbal Ratio Statements , 1997 .

[49]  William W. Cooper,et al.  Introduction to Data Envelopment Analysis and Its Uses: With Dea-Solver Software and References , 2005 .

[50]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[51]  Shiang-Tai Liu,et al.  Fuzzy efficiency measures in fuzzy DEA/AR with application to university libraries , 2009, Expert Syst. Appl..

[52]  Teresa León,et al.  A fuzzy mathematical programming approach to the assessment of efficiency with DEA models , 2003, Fuzzy Sets Syst..

[53]  Shu-Cherng Fang,et al.  Fuzzy data envelopment analysis (DEA): a possibility approach , 2003, Fuzzy Sets Syst..

[54]  Joseph C. Paradi,et al.  Information systems project prioritization using data envelopment analysis , 2005, Math. Comput. Model..

[55]  Adolfo López-Paredes,et al.  Simulating the dynamic scheduling of project portfolios , 2010, Simul. Model. Pract. Theory.

[56]  Soung Hie Kim,et al.  Interactive group decision making procedure under incomplete information , 1999, Eur. J. Oper. Res..

[57]  B. Werners Interactive multiple objective programming subject to flexible constraints , 1987 .

[58]  J. Buckley,et al.  Fuzzy hierarchical analysis , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[59]  Adel Hatami-Marbini,et al.  Fuzzy stochastic data envelopment analysis with application to base realignment and closure (BRAC) , 2012, Expert Syst. Appl..

[60]  Ping-Teng Chang,et al.  A fuzzy DEA and knapsack formulation integrated model for project selection , 2012, Comput. Oper. Res..

[61]  Abraham Charnes,et al.  Measuring the efficiency of decision making units , 1978 .

[62]  Avraham Shtub,et al.  Constructing and evaluating balanced portfolios of R&D projects with interactions: A DEA based methodology , 2006, Eur. J. Oper. Res..

[63]  Adel Hatami-Marbini,et al.  A taxonomy and review of the fuzzy data envelopment analysis literature: Two decades in the making , 2011, Eur. J. Oper. Res..

[64]  Aïda Valls,et al.  Using classification as an aggregation tool in MCDM , 2000, Fuzzy Sets Syst..

[65]  Masahiro Inuiguchi,et al.  The usefulness of possibilistic programming in production planning problems , 1994 .

[66]  Sungjoo Lee,et al.  Managing uncertainty to improve decision-making in NPD portfolio management with a fuzzy expert system , 2012, Expert Syst. Appl..

[67]  Shiang-Tai Liu,et al.  A fuzzy DEA/AR approach to the selection of flexible manufacturing systems , 2008, Comput. Ind. Eng..

[68]  Hongyi Sun,et al.  A packing-multiple-boxes model for R&D project selection and scheduling , 2005 .

[69]  Samuel P. Marin,et al.  Balancing and optimizing a portfolio of R&D projects , 2001 .

[70]  Mohammad Ali Abido,et al.  Multiobjective evolutionary finance-based scheduling: Individual projects within a portfolio , 2011 .