Role-Based Clustering for Collaborative Recommendations in Crowdsourcing System

Crowdsourcing as a distributed problem-solving and business production model has attracted much attention in recent years. In crowdsourcing systems, task recommendation can help workers to select suitable tasks on crowdsourcing platforms as well as help requesters to receive good outputs. However, as one of the most successful recommendation approaches, current clustering-based models in crowdsourcing are challenged by multi-preference and cold-start problems. This paper proposes a role-based clustering model, which transforms a large-sparse worker-task rating matrix into a set of role-based clusters that are small, independent and rating intensive worker-task rating matrices, leading to better quality and performance in task recommendation. Specifically, we first cluster a worker-task rating matrix into a set of clusters in terms of the role identification and distribution operations. The clusters are further extended to include all their external worker (task) roles. Then, the task recommendation results with respect to a worker are generated by operating over the clusters involving the worker’s activities, which captures the worker’s preferences in multiple areas. Moreover, the model discovers the structure information from the clustering results and crowdsourcing datasets, by which tasks can be recommended to new workers interactively without their interest profiles. We evaluated our method over the benchmark dataset from NAACL 2010 workshop. The results show the high superiority of our proposed recommendation method over crowdsourcing platforms.

[1]  Yanchun Zhang,et al.  Enhancing online video recommendation using social user interactions , 2017, The VLDB Journal.

[2]  Kwong-Sak Leung,et al.  TaskRec: A Task Recommendation Framework in Crowdsourcing Systems , 2015, Neural Processing Letters.

[3]  Michael J. Pazzani,et al.  Workshop on recommender systems: algorithms and evaluation , 1999, SIGF.

[4]  Alexandros Nanopoulos,et al.  Recommender systems in e-learning environments: a survey of the state-of-the-art and possible extensions , 2015, Artificial Intelligence Review.

[5]  Francesco Ricci,et al.  A survey of active learning in collaborative filtering recommender systems , 2016, Comput. Sci. Rev..

[6]  Francesco Ricci,et al.  Active Learning in Collaborative Filtering Recommender Systems , 2014, EC-Web.

[7]  Jiangang Zhu,et al.  A Learning to Rank Framework for Developer Recommendation in Software Crowdsourcing , 2015, 2015 Asia-Pacific Software Engineering Conference (APSEC).

[8]  Gerhard Friedrich,et al.  Recommender Systems - An Introduction , 2010 .

[9]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[10]  Irwin King,et al.  A Survey of Human Computation Systems , 2009, 2009 International Conference on Computational Science and Engineering.

[11]  Yanchun Zhang,et al.  Online Video Recommendation in Sharing Community , 2015, SIGMOD Conference.

[12]  Guangyan Huang,et al.  Dynamic Connection-Based Social Group Recommendation , 2020, IEEE Transactions on Knowledge and Data Engineering.

[13]  Chun Chen,et al.  An exploration of improving collaborative recommender systems via user-item subgroups , 2012, WWW.

[14]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[15]  Dean P. Foster,et al.  Clustering Methods for Collaborative Filtering , 1998, AAAI 1998.

[16]  Craig A. Knoblock,et al.  A Survey of Digital Map Processing Techniques , 2014, ACM Comput. Surv..

[17]  J. Konstan,et al.  Distributed Recommender Systems: New Opportunities in Internet Commerce , 2001 .

[18]  Kwong-Sak Leung,et al.  A Survey of Crowdsourcing Systems , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[19]  Joshua Zhexue Huang,et al.  A cross cluster-based collaborative filtering method for recommendation , 2013, 2013 IEEE International Conference on Information and Automation (ICIA).

[20]  Kwong-Sak Leung,et al.  TaskRec: Probabilistic Matrix Factorization in Task Recommendation in Crowdsourcing Systems , 2012, ICONIP.

[21]  Brendan J. Frey,et al.  Multi-way clustering of microarray data using probabilistic sparse matrix factorization , 2005, ISMB.

[22]  Athman Bouguettaya,et al.  Efficient subsequence matching over large video databases , 2011, The VLDB Journal.

[23]  Beijun Shen,et al.  Task Recommendation with Developer Social Network in Software Crowdsourcing , 2016, 2016 23rd Asia-Pacific Software Engineering Conference (APSEC).

[24]  Kwong-Sak Leung,et al.  Task recommendation in crowdsourcing systems , 2012, CrowdKDD '12.