A novel hybrid MCDM model for performance evaluation of research and technology organizations based on BSC approach.

Balanced Scorecard (BSC) is a strategic evaluation tool using both financial and non-financial indicators to determine the business performance of organizations or companies. In this paper, a new integrated approach based on the Balanced Scorecard (BSC) and multi-criteria decision making (MCDM) methods are proposed to evaluate the performance of research centers of research and technology organization (RTO) in Iran. Decision-Making Trial and Evaluation Laboratory (DEMATEL) are employed to reflect the interdependencies among BSC perspectives. Then, Analytic Network Process (ANP) is utilized to weight the indices influencing the considered problem. In the next step, we apply four MCDM methods including Additive Ratio Assessment (ARAS), Complex Proportional Assessment (COPRAS), Multi-Objective Optimization by Ratio Analysis (MOORA), and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) for ranking of alternatives. Finally, the utility interval technique is applied to combine the ranking results of MCDM methods. Weighted utility intervals are computed by constructing a correlation matrix between the ranking methods. A real case is presented to show the efficacy of the proposed approach.

[1]  Hamed Taherdoost,et al.  Propose a Methodology to Implement Balanced Scorecard for Operational Appraisal of Industrial Groups , 2012 .

[2]  Meysam Shaverdi,et al.  Combining Fuzzy MCDM with BSC Approach in Performance Evaluation of Iranian Private Banking Sector , 2011, Adv. Fuzzy Syst..

[3]  Sarfaraz Hashemkhani Zolfani,et al.  Application of MCDM methods in short-term planning for private universities based on balanced scorecard: a case study from Iran , 2012 .

[4]  Edmundas Kazimieras Zavadskas,et al.  A new additive ratio assessment (ARAS) method in multicriteria decision‐making , 2010 .

[5]  Adnan Khaliq Bhatti,et al.  EXPLORING THE EFFECTS OF CELEBRITY ENDORSEMENT IN ELECTRONIC MEDIA ADVERTISEMENTS ON PURCHASING BEHAVIOR OF CITIZENS OF SARGODHA CITY , 2016 .

[6]  Jay Daniel,et al.  A Decision Model for Selecting of Strategic Plans in Balanced Scorecard Model: A Case Study for a Manufacturing Firm , 2012 .

[7]  Hisham Alidrisi,et al.  A Hybrid Model for Performance Evaluation and Improvement Using Balanced Scorecards and Analytic Hierarchy Process: The case of Saudi Electricity Company , 2013 .

[8]  Jian-Bo Yang,et al.  A preference aggregation method through the estimation of utility intervals , 2005, Comput. Oper. Res..

[9]  Gwo-Hshiung Tzeng,et al.  A balanced scorecard approach to establish a performance evaluation and relationship model for hot spring hotels based on a hybrid MCDM model combining DEMATEL and ANP , 2011 .

[10]  W. Duncan A GUIDE TO THE PROJECT MANAGEMENT BODY OF KNOWLEDGE , 1996 .

[11]  Milad Aghaee,et al.  An Integrated MCDM Method in Ranking BSC Perspectives and key Performance Indicators (KPIs) , 2012 .

[12]  Vahid Majazi Dalfard,et al.  A combination model using strategic alignment model and balanced scorecard and strategies’ prioritisation based on TOPSIS technique , 2013 .

[13]  Luis E. Quezada,et al.  A method for designing a strategy map using AHP and linear programming , 2014 .

[14]  G. G. Cameron,et al.  Split-and-merge segmentation of magnetic resonance medical images: performance evaluation and extension to three dimensions. , 1998, Computers and biomedical research, an international journal.

[15]  Pavel V. Sevastjanov,et al.  A direct interval extension of TOPSIS method , 2013, Expert Syst. Appl..

[16]  Tahere Yaghoobi,et al.  Key indicators for organizational performance measurement , 2014 .

[17]  Ming Lim,et al.  Sustainable Supply Chain Management , 2013 .

[18]  Edmundas Kazimieras Zavadskas,et al.  Multi‐objective decision‐making for road design , 2008 .

[19]  Farzad Sattari Ardabili,et al.  New Framework for Modeling Performance Evaluation for Bank Staff Departments , 2011 .

[20]  Mohammad Hossein Zarei,et al.  Moving Towards Organizational Agility: Are We Improving in the Right Direction? , 2013 .

[21]  Farhad Hosseinzadeh Lotfi,et al.  Supply chain performance evaluation with data envelopment analysis and balanced scorecard approach , 2014 .

[22]  Mohammad Reza Shojaee,et al.  A hybrid TOPSIS-BSC method for strategic planning , 2012 .

[23]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[24]  C. Hwang,et al.  Group Decision Making Under Multiple Criteria: Methods and Applications , 1986 .

[25]  Vadlamani Ravi,et al.  Quantification of Balanced Scorecard Using Crisp and Fuzzy Multi Attribute Decision Making: Application to Banking , 2013, 2013 6th International Conference on Emerging Trends in Engineering and Technology.

[26]  A. Shanian,et al.  A methodological concept for material selection of highly sensitive components based on multiple criteria decision analysis , 2009, Expert Syst. Appl..

[27]  Gholam Ali Montazer,et al.  Airline Alliances Partner Selection in Uncertain Environment: A Fuzzy Hybrid Evaluation Model Based on BSC , 2011 .

[28]  Ali Morovati Sharifabadi,et al.  COMPREHENSIVE PERFORMANCE EVALUATION USING FAHP-FVIKOR APPROACH BASED ON BALANCED SCORECARD (BSC): A CASE OF YAZD'S CERAMIC AND TILE INDUSTRY , 2013 .

[29]  S. N. Musa,et al.  Fuzzy-based sustainability evaluation method for manufacturing SMEs using balanced scorecard framework , 2018, J. Intell. Manuf..

[30]  E. Zavadskas,et al.  Multiple criteria decision making (MCDM) methods in economics: an overview , 2011 .

[31]  Javad Mohammadi,et al.  A Fuzzy MCDM Approach for Evaluating Listed Private Banks in Tehran Stock Exchange Based on Balanced Scorecard , 2011 .

[32]  Hung-Yi Wu,et al.  Constructing a strategy map for banking institutions with key performance indicators of the balanced scorecard. , 2012, Evaluation and program planning.

[33]  E. Keshavarz,et al.  Performance evaluation of banks using balanced scorecard , 2014 .

[34]  Bahareh Alidade,et al.  Ranking the Branches of Bank Sepah of Sistan Baluchistan Using Balanced Score Card and Fuzzy Multi-Attribute Decision Making Methods , 2015 .

[35]  Manoj Kumar Tiwari,et al.  Green supply chain performance measurement using fuzzy ANP-based balanced scorecard: a collaborative decision-making approach , 2014 .

[36]  J. J. Boj,et al.  An ANP-multi-criteria-based methodology to link intangible assets and organizational performance in a Balanced Scorecard context , 2014, Decis. Support Syst..

[37]  Hamidreza Maghsoudlou,et al.  FQSPM-SWOT for strategic alliance planning and partner selection:case study in a holding car manufacturer company , 2015 .

[38]  Chih-Cheng Chen,et al.  Balanced scorecard performance evaluation in a closed-loop hierarchical model under uncertainty , 2014, Appl. Soft Comput..

[39]  Javad Sofiyabadi,et al.  A dynamic balanced scorecard for identification internal process factor , 2012 .

[40]  Fabio De Felice,et al.  Critical Success Factors for e-Healthcare: Integrated Set of Performance Indicators System (ISPIS) , 2014, IWAAL.

[41]  Naser Ali,et al.  IDENTIFYING AND PRIORITIZING THE MOST IMPORTANT COMPETITIVE FACTORS IN HOTELS BASED ON BALANCED SCORECARD AND ANP METHOD , 2014 .

[42]  Vinod Yadav,et al.  Multi-criteria decision making for supplier selection using fuzzy AHP approach , 2015 .

[43]  Yuhong Cao,et al.  A novel balanced scorecard design based on fuzzy analytic network process and its application , 2014 .

[44]  Wen-Hsien Tsai,et al.  An integrated approach for selecting corporate social responsibility programs and costs evaluation in the international tourist hotel , 2010 .

[45]  Jitesh Thakkar,et al.  Development of Balanced Scorecard for healthcare using Interpretive Structural Modeling and Analytic Network Process , 2014 .

[46]  Yusof Ismail,et al.  An aggregation technique for optimal decision-making in materials selection , 2011 .

[47]  Kuei-Lun Chang,et al.  A Hybrid Program Projects Selection Model for Nonprofit TV Stations , 2015 .

[48]  R. Kaplan,et al.  The Balanced Scorecard: Translating Strategy into Action , 1996 .

[49]  Walid Abdul-Kader,et al.  Comprehensive performance measurement and causal-effect decision making model for reverse logistics enterprise , 2014, Comput. Ind. Eng..

[50]  Michael J. Shaw,et al.  A MCDM approach for sourcing strategy mix decision in IT projects , 2010, Expert Syst. Appl..

[51]  Mohammad Naser Musa Hamdan Improving the performance of accounting information systems of commercial banks in Jordan by using the balanced scorecard approach , 2013 .

[52]  Milind Bansia,et al.  Development of a Reverse Logistics Performance Measurement System for a Battery Manufacturer , 2014 .

[53]  Shahryar Sorooshian,et al.  Study on Unbalanceness of the Balanced Scorecard , 2014 .

[54]  Kuei‐Lun Chang,et al.  Combined MCDM approaches for century‐old Taiwanese food firm new product development project selection , 2013 .

[55]  Mohammad Hassan Kamfiroozi,et al.  An ERP Selection Combination Model under Uncertainty: A Grey-BSCAHP-Entropy Model , 2014 .

[56]  Mohammad Reza Fathi,et al.  Performance Evaluating of IT Department using a Modified Fuzzy TOPSIS and BSC methodology (Case study: Tehran Province Gas Company) , 2011 .

[57]  Abbas Keramati,et al.  Multidimensional appraisal of customer relationship management: integrating balanced scorecard and multi criteria decision making approaches , 2016, Inf. Syst. E Bus. Manag..

[58]  Pria Md Nippak,et al.  Designing and evaluating a balanced scorecard for a health information management department in a Canadian urban non-teaching hospital , 2016, Health Informatics J..

[59]  Benjamin F. Hobbs,et al.  Does choice of multicriteria method matter? An experiment in water resources planning , 1992 .

[60]  M. Sharma,et al.  An integrated BSC‐AHP approach for supply chain management evaluation , 2007 .

[61]  Luis G. Vargas,et al.  Firm-level outsourcing decision making: A balanced scorecard-based analytic network process model , 2014 .

[62]  E. Zavadskas,et al.  A new fuzzy additive ratio assessment method (ARAS‐F). Case study: The analysis of fuzzy multiple criteria in order to select the logistic centers location , 2010 .

[63]  Maria Cristina N. Gramani,et al.  Inter-Regional Performance of the Public Health System in a High-Inequality Country , 2014, PloS one.

[64]  Ali Sorayaei,et al.  An integrated approach to analyze strategy map using BSC – FUZZY AHP: A case study of Dairy companies , 2014 .

[65]  Yi-Hsuan Chen,et al.  A fuzzy MCDM approach for evaluating banking performance based on Balanced Scorecard , 2009, Expert Syst. Appl..

[66]  Cengiz Kahraman,et al.  Application of fuzzy multi-criteria decision making methods for financial performance evaluation of Turkish manufacturing industries , 2012, Expert Syst. Appl..

[67]  Adel Azar,et al.  A BSC method for supplier selection strategy using TOPSIS and VIKOR: A case study of part maker industry , 2011 .

[68]  Behrooz Noori Prioritizing strategic business units in the face of innovation performance: Combining fuzzy AHP and BSC , 2014 .

[69]  Reza Safdari,et al.  Development of Balanced Key Performance Indicators for Emergency Departments Strategic Dashboards Following Analytic Hierarchical Process , 2014, The health care manager.

[70]  Mojtaba Javidnia,et al.  A new approach to analyze strategy map using an integrated BSC and FUZZY DEMATEL , 2012 .

[71]  Violeta Domanovic,et al.  Balanced Scorecard And Analytic Network Process In Performance Measurement And Strategy Evaluation: A Case Study , 2014 .

[72]  R. Singh,et al.  Selecting competitive supply chain using fuzzy AHP and extent analysis , 2014 .

[73]  Robert S. Kaplan,et al.  Wells Fargo Online Financial Services (A) , 1998 .

[74]  Chia-Li Lin,et al.  DEMATEL-based model to improve the performance in a matrix organization , 2012, Expert Syst. Appl..

[75]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[76]  Ahmad Fakharian,et al.  Evaluation of Hadid Firm's Performance Using the Balanced Scorecard ( BSC ) Model , 2014 .

[77]  David L. Olson,et al.  Consistency and Accuracy in Decision Aids: Experiments with Four Multiattribute Systems* , 1995 .

[78]  W. Hsu,et al.  The sustainability balanced scorecard as a framework for selecting socially responsible investment: an effective MCDM model , 2009, J. Oper. Res. Soc..

[79]  Hamidreza Karkehabadi,et al.  A development in balanced scorecard by designing a fuzzy and nonlinear Algorithm (case study: Islamic Azad university of Semnan) , 2012 .

[80]  Edmundas Kazimieras Zavadskas,et al.  The MOORA method and its application to privatization in a transition economy , 2006 .

[81]  Stefan Hajkowicz,et al.  A Review of Multiple Criteria Analysis for Water Resource Planning and Management , 2007 .

[82]  Thomas L. Saaty,et al.  Decision making with dependence and feedback : the analytic network process : the organization and prioritization of complexity , 1996 .

[83]  Sanja Penić,et al.  Selection of Priority Cause and Effect Chains on the Strategy Map of Goals Using AHP Multiple Criteria Analysis , 2014 .

[84]  Dominique Lepelley,et al.  Borda rule, Copeland method and strategic manipulation , 2002 .

[85]  Muhammad Junaid Iqbal Balancing Multi & Cross Perspective Strategic Objectives in a Balanced Scorecard - A Fuzzy MCDM approach. , 2014 .

[86]  Ming-Lang Tseng,et al.  Implementation and performance evaluation using the fuzzy network balanced scorecard , 2010, Comput. Educ..

[87]  Milind Kumar Sharma,et al.  Application of Alternative Multi-criteria Decision Making Approaches to Supplier Selection Process , 2015, Intelligent Techniques in Engineering Management.

[88]  Edmundas Kazimieras Zavadskas,et al.  Proposing a new integrated model based on sustainability balanced scorecard (SBSC) and MCDM approaches by using linguistic variables for the performance evaluation of oil producing companies , 2014, Expert Syst. Appl..

[89]  Yi-Kuei Lin,et al.  Performance evaluation of extension education centers in universities based on the balanced scorecard. , 2011, Evaluation and program planning.

[90]  Shankar Chakraborty,et al.  Applications of the MOORA method for decision making in manufacturing environment , 2011 .

[91]  Hristos Karahalios,et al.  Assessment of the maritime labour convention compliance using balanced scorecard and analytic hierarchy process approach , 2015 .

[92]  Gwo-Hshiung Tzeng,et al.  Fuzzy multiple attribute decision making theory with the balanced scorecard application in mobile industry , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[93]  Shu-Chen Kao,et al.  Online Knowledge Community Evaluation Model: A Balanced Scorecard Based Approach , 2014 .

[94]  Meisam Jafari-Eskandari,et al.  Banks' Performance Evaluation Model Based on The Balanced Score Card Approach, Fuzzy DEMATEL and Analytic Network Process , 2013 .

[95]  Thomas L. Saaty,et al.  Decision-making with the AHP: Why is the principal eigenvector necessary , 2003, Eur. J. Oper. Res..

[96]  Madjid Tavana,et al.  A hybrid fuzzy MCDM method for measuring the performance of publicly held pharmaceutical companies , 2014, Annals of Operations Research.

[97]  L. C. Leung,et al.  Implementing the balanced scorecard using the analytic hierarchy process & the analytic network process , 2006, J. Oper. Res. Soc..

[98]  Rajat Bhagwat,et al.  Performance measurement of supply chain management: A balanced scorecard approach , 2007, Comput. Ind. Eng..

[99]  Behrooz Noori,et al.  Strategic business unit ranking based on innovation performance: a case study of a steel manufacturing company , 2015, Int. J. Syst. Assur. Eng. Manag..

[100]  Frank Medel-González,et al.  Measuring and Evaluating Business Sustainability: Development and Application of Corporate Index of Sustainability Performance , 2013 .

[101]  Emad Roghanian,et al.  Customer relationship management performance measurement using balanced scorecard and fuzzy analytic network process: The case of MAPNA group , 2014, J. Intell. Fuzzy Syst..

[102]  Thomas L. Saaty,et al.  The Analytic Network Process: Decision Making With Dependence and Feedback , 2001 .

[103]  Javad Sofiyabadi,et al.  Strategic orientation in evaluation of supply chain activities , 2012 .