A note on explicit versus implicit information for job recommendation

Recommender systems have proven to be a valuable tool in many online applications. However, the multitude of user related data types and recommender system algorithms makes it difficult for decision makers to choose the best combination for their specific business goals. Through a case study on job recommender systems in collaboration with the Flemish public employment services (VDAB), we evaluate what data types are most indicative of job seekers' vacancy interests, and how this impacts the appropriateness of the different types of recommender systems for job recommendation. We show that implicit feedback data covers a broader spectrum of job seekers' job interests than explicitly stated interests. Based on this insight we present a user-user collaborative filtering system solely based on this implicit feedback data. Our experiments show that this system outperforms the extensive knowledge-based recommender system currently employed by VDAB in both offline and expert evaluation. Furthermore, this study contributes to the existing recommender system literature by showing that, even in high risk recommendation contexts such as job recommendation, organizations should not only hang on to explicit feedback recommender systems but should embrace the value and abundance of available implicit feedback data. Users' interests can be captured using both explicit and implicit data.Our experiments on job search data show that implicit data contains a broader spectrum of user interest.Job recommenders using implicit feedback data provide more predictive and diverse recommendations.

[1]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[2]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[3]  Tim Weitzel,et al.  Decision support for team staffing: An automated relational recommendation approach , 2008, Decis. Support Syst..

[4]  Pasquale Lops,et al.  Content-based Recommender Systems: State of the Art and Trends , 2011, Recommender Systems Handbook.

[5]  Lior Rokach,et al.  Recommender Systems Handbook , 2010 .

[6]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[7]  John Riedl,et al.  An Algorithmic Framework for Performing Collaborative Filtering , 1999, SIGIR Forum.

[8]  Tao Li,et al.  MEET: a generalized framework for reciprocal recommender systems , 2012, CIKM.

[9]  Shaha T. Al-Otaibi,et al.  A survey of job recommender systems , 2012 .

[10]  Robin Burke,et al.  Integrating Knowledge-based and Collaborative-filtering Recommender Systems , 2000 .

[11]  Martin Szomszor,et al.  Comparison of implicit and explicit feedback from an online music recommendation service , 2010, HetRec '10.

[12]  Huan Wang,et al.  A Job Recommender System Based on User Clustering , 2013, J. Comput..

[13]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[14]  Arvind K. Tripathi,et al.  Design of a shopbot and recommender system for bundle purchases , 2006, Decis. Support Syst..

[15]  Tim Weitzel,et al.  Matching People and Jobs: A Bilateral Recommendation Approach , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[16]  Barry Smyth,et al.  Passive Profiling from Server Logs in an Online Recruitment Environment , 2001, IJCAI 2001.

[17]  Jaime Teevan,et al.  Implicit feedback for inferring user preference: a bibliography , 2003, SIGF.

[18]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[19]  Yang Fan,et al.  Job recommender systems: A survey , 2012, 2012 7th International Conference on Computer Science & Education (ICCSE).

[20]  Hao Wang,et al.  From clicking to consideration: A business intelligence approach to estimating consumers' consideration probabilities , 2013, Decis. Support Syst..

[21]  Douglas W. Oard,et al.  Implicit Feedback for Recommender Systems , 1998 .

[22]  Yoon-Joo Park,et al.  An Adaptive Match-Making System reflecting the explicit and implicit preferences of users , 2013, Expert Syst. Appl..

[23]  David M. Blei,et al.  Scalable Recommendation with Hierarchical Poisson Factorization , 2015, UAI.

[24]  D.H. Lee,et al.  Fighting Information Overflow with Personalized Comprehensive Information Access: A Proactive Job Recommender , 2007, Third International Conference on Autonomic and Autonomous Systems (ICAS'07).

[25]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[26]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[27]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[28]  Boi Faltings,et al.  Offline and online evaluation of news recommender systems at swissinfo.ch , 2014, RecSys '14.

[29]  Martha Larson,et al.  CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering , 2012, RecSys.

[30]  Hengchang Liu,et al.  Scalable audience targeted models for brand advertising on social networks , 2014, RecSys '14.

[31]  Qiang Wei,et al.  Measuring the coverage and redundancy of information search services on e-commerce platforms , 2012, Electron. Commer. Res. Appl..

[32]  Juan Manuel Cueva Lovelle,et al.  Implicit feedback techniques on recommender systems applied to electronic books , 2012, Comput. Hum. Behav..

[33]  Barry Smyth,et al.  Case-Based User Profiling for Content Personalisation , 2000, AH.

[34]  Fabio Stella,et al.  Contrasting Offline and Online Results when Evaluating Recommendation Algorithms , 2016, RecSys.

[35]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[36]  Yehuda Koren,et al.  Modeling relationships at multiple scales to improve accuracy of large recommender systems , 2007, KDD '07.

[37]  Yung-Ming Li,et al.  A social recommender mechanism for e-commerce: Combining similarity, trust, and relationship , 2013, Decis. Support Syst..

[38]  Joseph A. Konstan,et al.  Evaluating recommender behavior for new users , 2014, RecSys '14.

[39]  Tobias Keim,et al.  Extending the Applicability of Recommender Systems: A Multilayer Framework for Matching Human Resources , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[40]  Alexandros Nanopoulos,et al.  Recommender systems based on quantitative implicit customer feedback , 2014, Decis. Support Syst..