A social network-empowered research analytics framework for project selection

Traditional approaches for research project selection by government funding agencies mainly focus on the matching of research relevance by keywords or disciplines. Other research relevant information such as social connections (e.g., collaboration and co-authorship) and productivity (e.g., quality, quantity, and citations of published journal articles) of researchers is largely ignored. To overcome these limitations, this paper proposes a social network-empowered research analytics framework (RAF) for research project selections. Scholarmate.com, a professional research social network with easy access to research relevant information, serves as a platform to build researcher profiles from three dimensions, i.e., relevance, productivity and connectivity. Building upon profiles of both proposals and researchers, we develop a unique matching algorithm to assist decision makers (e.g. panel chairs or division managers) in optimizing the assignment of reviewers to research project proposals. The proposed framework is implemented and tested by the largest government funding agency in China to aid the grant proposal evaluation process. The new system generated significant economic benefits including great cost savings and quality improvement in the proposal evaluation process.

[1]  Edoardo M. Airoldi,et al.  Network sampling and classification: An investigation of network model representations , 2011, Decis. Support Syst..

[2]  Ichiro Sakata,et al.  Measuring relatedness between communities in a citation network , 2011, J. Assoc. Inf. Sci. Technol..

[3]  Tomek Strzalkowski,et al.  Robust Text Processing in Automated Information Retrieval , 1994, ANLP.

[4]  Raghu Garud,et al.  Research Note - Mapping the Field of Virtual Work: A Cocitation Analysis , 2010, Inf. Syst. Res..

[5]  Jun Wang,et al.  A Group Decision Support Approach to Evaluate Experts for R&D Project Selection , 2008, IEEE Transactions on Engineering Management.

[6]  Arun Sundararajan,et al.  Recommendation Networks and the Long Tail of Electronic Commerce , 2010, MIS Q..

[7]  M. Newman Coauthorship networks and patterns of scientific collaboration , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Zhangxi Lin,et al.  A framework for exploring organizational structure in dynamic social networks , 2011, Decis. Support Syst..

[9]  Jian Ma,et al.  A group decision support approach to evaluating journals , 2004, Inf. Manag..

[10]  Jano Moreira de Souza,et al.  i-ProSE: Inferring User Profiles in a Scientific Context , 2009, Comput. J..

[11]  Chun Hu,et al.  Analytic hierarchy process with fuzzy scoring in evaluating multidisciplinary R&D projects in China , 2005, IEEE Transactions on Engineering Management.

[12]  Hongyuan Zha,et al.  A regression framework for learning ranking functions using relative relevance judgments , 2007, SIGIR.

[13]  A. D. Henriksen,et al.  A practical R&D project-selection scoring tool , 1999 .

[14]  Ronald N. Kostoff,et al.  Citation mining: Integrating text mining and bibliometrics for research user profiling , 2001, J. Assoc. Inf. Sci. Technol..

[15]  Javed Mostafa,et al.  Automatic classification using supervised learning in a medical document filtering application , 2000, Inf. Process. Manag..

[16]  Raymond Y. K. Lau,et al.  A two-stage decision model for information filtering , 2012, Decis. Support Syst..

[17]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Ron Chi-Wai Kwok,et al.  An organizational decision support system for effective R&D project selection , 2005, Decis. Support Syst..

[20]  Paul Jen-Hwa Hu,et al.  Knowledge mapping for rapidly evolving domains: A design science approach , 2011, Decis. Support Syst..

[21]  Jian Ma,et al.  A hybrid knowledge and model approach for reviewer assignment , 2008, Expert Syst. Appl..

[22]  Robert Russell,et al.  AWSM: Allocation of workflows utilizing social network metrics , 2010, Decis. Support Syst..

[23]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[24]  Chengqi Zhang,et al.  An information filtering model on the Web and its application in JobAgent , 2000, Knowl. Based Syst..

[25]  Enrique Herrera-Viedma,et al.  Using Incomplete Fuzzy Linguistic Preference Relations to Characterize User Profiles in Recommender Systems , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[26]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Shusaku Tsumoto,et al.  Analysis of Research Keys as Tempral Patterns of Technical Term Usages in Bibliographical Data , 2010, AMT.

[28]  Yonggui Dong,et al.  A cosine similarity-based negative selection algorithm for time series novelty detection , 2006 .

[29]  Jinho Choi,et al.  Analysis of keyword networks in MIS research and implications for predicting knowledge evolution , 2011, Inf. Manag..

[30]  Thorsten Joachims,et al.  A Statistical Learning Model of Text Classification for Support Vector Machines. , 2001, SIGIR 2002.

[31]  M. A. H. Farquad,et al.  Preprocessing unbalanced data using support vector machine , 2012, Decis. Support Syst..

[32]  Ronald N. Kostoff,et al.  Fullerene Data Mining Using Bibliometrics and Database Tomography , 2000, J. Chem. Inf. Comput. Sci..

[33]  John Scott Social Network Analysis , 1988 .

[34]  Weiguo Fan,et al.  Effective profiling of consumer information retrieval needs: a unified framework and empirical comparison , 2005, Decis. Support Syst..

[35]  Stephen E. Robertson,et al.  The TREC 2002 Filtering Track Report , 2002, TREC.

[36]  Ramayya Krishnan,et al.  A method for managing access to web pages: Filtering by Statistical Classification (FSC) applied to text , 2006, Decis. Support Syst..

[37]  A. Barabasi,et al.  Evolution of the social network of scientific collaborations , 2001, cond-mat/0104162.

[38]  Pin-Yu Chu,et al.  A fuzzy AHP application in government-sponsored R&D project selection☆ , 2008 .

[39]  Thorsten Joachims,et al.  A statistical learning learning model of text classification for support vector machines , 2001, SIGIR '01.