K-Loop Free Assignment in Conference Review Systems

Peer review is a common process for evaluating paper submissions and selecting high-quality papers at academic conferences. A significant task is assigning submissions to appropriate reviewers. Considering the constraints of reviewers, papers, and conflicts of interest, retrieval-based methods and assignment-based methods were proposed in previous works. However, an author could also be a reviewer in the conference. The loops between authors and reviewers may cause cooperative cheating. In this paper, two algorithms are proposed for a k-loop free assignment, which ensures the loop length is no less than k. Inspired by the existing works, the first algorithm assigns reviewers to maximize the summation of suitability scores, temporarily ignoring the k-loop free constraint. Afterward, the loops are detected and adjusted based on mergers. The second algorithm generates k-loop free assignments within the nodes that are both reviewers and authors. The other assignments are generated using linear programming. Extensive experiments show the effectiveness of the proposed methods.

[1]  Yiwei Thomas Hou,et al.  The new automated IEEE INFOCOM review assignment system , 2016, IEEE Network.

[2]  A. B. Kahn,et al.  Topological sorting of large networks , 1962, CACM.

[3]  Andrew McCallum,et al.  Expertise modeling for matching papers with reviewers , 2007, KDD '07.

[4]  Johan Bollen,et al.  An algorithm to determine peer-reviewers , 2006, CIKM '08.

[5]  Luo Si,et al.  Discriminative models of integrating document evidence and document-candidate associations for expert search , 2010, SIGIR '10.

[6]  Andrea Vattani k-means Requires Exponentially Many Iterations Even in the Plane , 2011, Discret. Comput. Geom..

[7]  Cheng Long,et al.  On Good and Fair Paper-Reviewer Assignment , 2013, 2013 IEEE 13th International Conference on Data Mining.

[8]  Stefano Ferilli,et al.  GRAPE: An Expert Review Assignment Component for Scientific Conference Management Systems , 2005, IEA/AIE.

[9]  Michael J. Pazzani,et al.  Mining for proposal reviewers: lessons learned at the national science foundation , 2006, KDD '06.

[10]  Jie Tang,et al.  Expertise Matching via Constraint-Based Optimization , 2010, Web Intelligence.

[11]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[12]  Richard S. Zemel,et al.  The Toronto Paper Matching System: An automated paper-reviewer assignment system , 2013 .

[13]  Qian Zhao,et al.  Integrating the Trend of Research Interest for Reviewer Assignment , 2017, WWW.

[14]  ChengXiang Zhai,et al.  Constrained multi-aspect expertise matching for committee review assignment , 2009, CIKM.

[15]  Nikos Mamoulis,et al.  Weighted Coverage based Reviewer Assignment , 2015, SIGMOD Conference.