Development of an Intelligent Job Recommender System for Freelancers using Client's Feedback Classification and Association Rule Mining Techniques

Most of the freelancer's time is killed in finding suitable jobs due to the huge number of freelance marketplaces. Freelancing sites send email notifications or show in newsfeed about posted jobs but most of them are irrelevant. Recommending relevant jobs to freelancers to minimize job finding time has drawn the attraction of researchers. Here, in this paper, we propose a recommender system to find out appropriate jobs for freelancers using client’s feedback classification and Association rule mining techniques. After collecting the previous work history of freelancers, we analyze the sentiment of client's feedback using Logistic Regression and Linear Support Vector Machine model to classify the completed jobs into two categories: positive and negative. We apply the Association rule mining technique to find out freelancer's frequent skillsets used in both categories of completed jobs. Then, we find out the jobs matched with the positive frequent skillsets using set operations. We also discard jobs that contain negative frequent skillsets. Finally, a collaborative filtering algorithm is applied considering the client's overall rating, the minimum budget/ hourly rate, deadline, re-hire, etc. to generate a more accurate recommendation. After extensive experiments on the real dataset collected from different online marketplaces, we are able to prove that our proposed method correctly recommends the appropriate jobs with 83.40% (Logistic Regression) and 84.03% (Linear SVM) accuracy.

[1]  Kwong-Sak Leung,et al.  TaskRec: A Task Recommendation Framework in Crowdsourcing Systems , 2015, Neural Processing Letters.

[2]  Liang Zhang,et al.  LiJAR: A System for Job Application Redistribution towards Efficient Career Marketplace , 2017, KDD.

[3]  Kwong-Sak Leung,et al.  Task recommendation in crowdsourcing systems , 2012, CrowdKDD '12.

[4]  Luiz Fernando Capretz,et al.  Making Sense of Software Development and Personality Types , 2010, IT Professional.

[5]  Lydia B. Chilton,et al.  Task search in a human computation market , 2010, HCOMP '10.

[6]  Kwong-Sak Leung,et al.  A Survey of Crowdsourcing Systems , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[7]  Gianluca Demartini,et al.  Pick-a-crowd: tell me what you like, and i'll tell you what to do , 2013, CIDR.

[8]  Mohammad Shamsul Arefin,et al.  An Intelligent System to Generate Possible Job List for Freelancers , 2020 .

[9]  Luiz Fernando Capretz,et al.  Influence of personality types in software tasks choices , 2015, Comput. Hum. Behav..

[10]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[11]  Kwong-Sak Leung,et al.  Task Matching in Crowdsourcing , 2011, 2011 International Conference on Internet of Things and 4th International Conference on Cyber, Physical and Social Computing.

[12]  Tomasz Imielinski,et al.  Database Mining: A Performance Perspective , 1993, IEEE Trans. Knowl. Data Eng..

[13]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[14]  Vili Lehdonvirta,et al.  Online Labour Index: Measuring the Online Gig Economy for Policy and Research , 2018, Technological Forecasting and Social Change.

[15]  Phuoc Tran-Gia,et al.  Demands on task recommendation in crowdsourcing platforms-the worker`s perspective , 2015 .

[16]  T. Zuva,et al.  A Survey of Recommender Systems Techniques, Challenges and Evaluation Metrics , 2012 .

[17]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[18]  Panagiotis G. Ipeirotis,et al.  Hiring Behavior Models for Online Labor Markets , 2015, WSDM.

[19]  Ye Yang,et al.  Who Should Take This Task?: Dynamic Decision Support for Crowd Workers , 2016, ESEM.

[20]  Christoph Rensing,et al.  Perceived Task Similarities for Task Recommendation in Crowdsourcing Systems , 2016, WWW.

[21]  Dunren Che,et al.  Real-time recommendation algorithms for crowdsourcing systems , 2017 .

[22]  Sarvapali D. Ramchurn,et al.  BudgetFix: budget limited crowdsourcing for interdependent task allocation with quality guarantees , 2014, AAMAS.

[23]  Gabriella Kazai,et al.  Worker types and personality traits in crowdsourcing relevance labels , 2011, CIKM '11.

[24]  Alpana Dubey,et al.  CrowdAdvisor: A Framework for Freelancer Assessment in Online Marketplace , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP).

[25]  Mohanarajesh Kommineni,et al.  Risk Analysis for Exploring the Opportunities in Cloud Outsourcing , 2016 .

[26]  Pan Liu,et al.  Performance Evaluation of Recommender Systems , 2017 .

[27]  Haiyong Luo,et al.  Impact of Personality on Task Selection in Crowdsourcing Software Development: A Sorting Approach , 2017, IEEE Access.

[28]  F. McNeill,et al.  Grid search: an innovative method for the estimation of the rates of lead exchange between body compartments. , 2005, Journal of environmental monitoring : JEM.

[29]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[30]  Jaime G. Carbonell,et al.  Towards Task Recommendation in Micro-Task Markets , 2011, Human Computation.

[31]  Zhanpeng He,et al.  Truthful Team Formation for Crowdsourcing in Social Networks: (Extended Abstract) , 2016, AAMAS.

[32]  Nurulhuda Firdaus Mohd Azmi,et al.  SMS spam classification using vector space model and artificial neural network , 2018 .

[33]  Haiyong Luo,et al.  Task Assignment Model for Crowdsourcing Software Development: TAM , 2018, J. Inf. Process. Syst..

[34]  P. Pavlou,et al.  Matching in Two-Sided Platforms for IT Services: Evidence from Online Labor Markets , 2016 .