PRIMA-Towards an Automatic Review/Paper Matching Score Calculation

Programme chairs of scientific conferences face a tremendous time pressure. One of the most time-consuming steps during the conference workflow is assigning members of the international programme committee (IPC) to the received submissions. Finding the best-suited persons for reviewing strongly depends on how the paper matches the expertise of each IPC member. While various approaches like ”bidding” or ”topic matching” exist in order to make the knowledge of these expertises explicit, these approaches allocate a considerable amount of resources on the IPC member side. This paper introduces the Paper Rating and IPC Matching Tool (PRIMA), which reduces the workload for both IPC members and chairs to support and improve the assignment process. Keywords-Conferences, International Program Committee, Submissions, Paper, Assignment, Matching, TF-IDF, Information Retrieval.

[1]  Anna-Lan Huang,et al.  Similarity Measures for Text Document Clustering , 2008 .

[2]  William W. Cohen,et al.  Recommending Papers by Mining the Web , 1999 .

[3]  J. I. Reppun.  Peer Review , 2014, MTZ worldwide.

[4]  Dieter W. Fellner,et al.  COMFy - A Conference Management Framework , 2013, Inf. Serv. Use.

[5]  R. Blank.  The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review , 1991 .

[6]  Jakob Nielsen,et al.  Automating the assignment of submitted manuscripts to reviewers , 1992, SIGIR '92.

[7]  Johan Bollen,et al.  Mapping the Bid Behavior of Conference Referees , 2006, J. Informetrics.

[8]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .

[9]  Erhard Rahm,et al.  Data Cleaning: Problems and Current Approaches , 2000, IEEE Data Eng. Bull..

[10]  Juan Enrique Ramos,et al.  Using TF-IDF to Determine Word Relevance in Document Queries , 2003 .

[11]  Bernardete Ribeiro,et al.  The importance of stop word removal on recall values in text categorization , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[12]  Richard S. Zemel,et al.  The Toronto Paper Matching System: An automated paper-reviewer assignment system , 2013 .

[13]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[14]  Richard K. Johnson.  Open Access , 2005 .

[15]  Michael J. Pazzani,et al.  Mining for proposal reviewers: lessons learned at the national science foundation , 2006, KDD '06.