Evaluation of university scientific research ability based on the output of sci-tech papers: A D-AHP approach

University scientific research ability is an important indicator to express the strength of universities. In this paper, the evaluation of university scientific research ability is investigated based on the output of sci-tech papers. Four university alliances from North America, UK, Australia, and China, are selected as the case study of the university scientific research evaluation. Data coming from Thomson Reuters InCites are collected to support the evaluation. The work has contributed new framework to the issue of university scientific research ability evaluation. At first, we have established a hierarchical structure to show the factors that impact the evaluation of university scientific research ability. Then, a new MCDM method called D-AHP model is used to implement the evaluation and ranking of different university alliances, in which a data-driven approach is proposed to automatically generate the D numbers preference relations. Next, a sensitivity analysis has been given to show the impact of weights of factors and sub-factors on the evaluation result. At last, the results obtained by using different methods are compared and discussed to verify the effectiveness and reasonability of this study, and some suggestions are given to promote China’s scientific research ability.

[1]  Francisco Herrera,et al.  Some issues on consistency of fuzzy preference relations , 2004, Eur. J. Oper. Res..

[2]  Henk F. Moed,et al.  Measuring China"s research performance using the Science Citation Index , 2002, Scientometrics.

[3]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[4]  Zeshui Xu,et al.  A survey of preference relations , 2007, Int. J. Gen. Syst..

[5]  Pavel V. Sevastjanov,et al.  Direct Interval Extension of TOPSIS Method , 2011, PPAM.

[6]  Naif Alajlan,et al.  Dempster-Shafer belief structures for decision making under uncertainty , 2015, Knowl. Based Syst..

[7]  Cengiz Kahraman,et al.  Fuzzy Multi-Criteria Decision Making: Theory and Applications with Recent Developments , 2008 .

[8]  Diana Hicks,et al.  Evolving regimes of multi-university research evaluation , 2009 .

[9]  Ronald R. Yager.  Combining various types of belief structures , 2015, Inf. Sci..

[10]  Sankaran Mahadevan,et al.  Environmental impact assessment based on D numbers , 2014, Expert Syst. Appl..

[11]  Evangelos Triantaphyllou,et al.  Multi-criteria Decision Making Methods: A Comparative Study , 2000 .

[12]  Xinyang Deng,et al.  Evidence Combination From an Evolutionary Game Theory Perspective , 2015, IEEE Transactions on Cybernetics.

[13]  William W. Cooper,et al.  Handbook on data envelopment analysis , 2011 .

[14]  Alessio Ishizaka,et al.  Multi-criteria Decision Analysis: Methods and Software , 2013 .

[15]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[16]  Ronald Rousseau,et al.  Evaluation of Research Performance and Scientometric Indicators in China , 2004 .

[17]  T. Saaty.  Decision making — the Analytic Hierarchy and Network Processes (AHP/ANP) , 2004 .

[18]  B. Martin,et al.  University Research Evaluation and Funding: An International Comparison , 2003 .

[19]  Y. J. Fenga,et al.  An AHP / DEA method for measurement of the efficiency of R & D management activities in universities , 2004 .

[20]  C. Hwang.  Multiple Objective Decision Making - Methods and Applications: A State-of-the-Art Survey , 1979 .

[21]  King-Jang Yang,et al.  Establishment and application of performance measure indicators for universities , 2009 .

[22]  P. Yu.  A Class of Solutions for Group Decision Problems , 1973 .

[23]  Hu-Chen Liu,et al.  Failure mode and effects analysis using D numbers and grey relational projection method , 2014, Expert Syst. Appl..

[24]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[25]  Liming Liang,et al.  Selection of databases, indicators and models for evaluating research performance of Chinese universities , 2001 .

[26]  Wang Qi.  A Discussion on the 985 Project from a Comparative Perspective , 2011 .

[27]  Martin Kenney,et al.  Universities/Research Institutes and Regional Innovation Systems: The Cases of Beijing and Shenzhen , 2007 .

[28]  Sheena Choi,et al.  Globalization, China’s drive for world-class universities (211 Project) and the challenges of ethnic minority higher education: the case of Yanbian university , 2010 .

[29]  A. Jaffe.  Real Effects of Academic Research , 1989 .

[30]  Yong Deng.  D Numbers: Theory and Applications ? , 2012 .

[31]  Pan Yue,et al.  A hybrid fuzzy evaluation method for curtain grouting efficiency assessment based on an AHP method extended by D numbers , 2016, Expert Syst. Appl..

[32]  Nian Cai Liu,et al.  The Story of Academic Ranking of World Universities , 2015 .

[33]  Feng Li,et al.  Performance evaluation of research universities in Mainland China, Hong Kong and Taiwan: based on a two-dimensional approach , 2011, Scientometrics.

[34]  P. Bahr,et al.  Sampling: Theory and Applications , 2020, Applied and Numerical Harmonic Analysis.

[35]  T. Tanino.  Fuzzy preference orderings in group decision making , 1984 .

[36]  M. Kenney,et al.  Building global-class universities: Assessing the impact of the 985 Project , 2013 .

[37]  Jean Pierre Brans,et al.  HOW TO SELECT AND HOW TO RANK PROJECTS: THE PROMETHEE METHOD , 1986 .

[38]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[39]  Li Lixu,et al.  China’s higher education reform 1998–2003: A summary , 2004 .

[40]  Xinyang Deng,et al.  Supplier selection using AHP methodology extended by D numbers , 2014, Expert Syst. Appl..

[41]  James Bruce Lee,et al.  Theory and Application , 2019, Wearable Sensors in Sport.

[42]  Yong Deng,et al.  D-CFPR: D numbers extended consistent fuzzy preference relations , 2014, Knowl. Based Syst..

[43]  Joe Zhu,et al.  Data Envelopment Analysis , 2007 .

[44]  Yong Hu,et al.  A novel distance function of D numbers and its application in product engineering , 2016, Eng. Appl. Artif. Intell..

[45]  Nian Cai Liu,et al.  The Academic Ranking of World Universities. , 2005 .

[46]  Thomas L. Saaty,et al.  Decision-making with the AHP: Why is the principal eigenvector necessary , 2003, Eur. J. Oper. Res..

[47]  Philippe Smets,et al.  The Transferable Belief Model , 1991, Artif. Intell..