Gatekeeper: Quantifying the Impacts of Service to the Scientific Community

Academic scholars have several duties, including teaching, research, and service to the community and society. While a scholar’s research impacts can be reasonably measured and tracked via citation analysis in existing digital libraries, to our best knowledge, there has been no system that systematically collects and quantifies a scholar’s impacts of service to the scientific community. In particular, we are interested in measuring scholars’ impacts as “gatekeepers,” who play a key role in the spread of research findings and new knowledge via the accept/reject decisions of research articles. In this work, toward this goal, we present a prototype digital library, Gatekeeper, that crawls, extracts, and quantifies the impacts of service based on one’s roles in the technical program committees of Computer Science conferences.

[1]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[2]  E. Garfield The history and meaning of the journal impact factor. , 2006, JAMA.

[3]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[4]  E. Garfield,et al.  Citation indexes for science. , 1956, Science.

[5]  Sergey Brin,et al.  Reprint of: The anatomy of a large-scale hypertextual web search engine , 2012, Comput. Networks.

[6]  Samet Atdag,et al.  A comparison of named entity recognition tools applied to biographical texts , 2013, 2nd International Conference on Systems and Computer Science.

[7]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[8]  Jie Tang,et al.  The impact of conference ranking systems in computer science: a comparative regression analysis , 2018, Scientometrics.

[9]  Yannis Manolopoulos,et al.  A new perspective to automatically rank scientific conferences using digital libraries , 2005, Inf. Process. Manag..

[10]  ChengXiang Zhai,et al.  Probabilistic Models for Expert Finding , 2007, ECIR.

[11]  Dongwon Lee,et al.  Measuring conference quality by mining program committee characteristics , 2007, JCDL '07.

[12]  Sergei Maslov,et al.  Finding scientific gems with Google's PageRank algorithm , 2006, J. Informetrics.

[13]  E. Garfield Citation indexes for science. A new dimension in documentation through association of ideas. 1955. , 1955, International journal of epidemiology.

[14]  Dongwon Lee,et al.  Toward alternative measures for ranking venues: a case of database research community , 2007, JCDL '07.