Exploring Large Language Model for Graph Data Understanding in Online Job Recommendations

Large Language Models (LLMs) have revolutionized natural language processing tasks, demonstrating their exceptional capabilities in various domains. However, their potential for behavior graph understanding in job recommendations remains largely unexplored. This paper focuses on unveiling the capability of large language models in understanding behavior graphs and leveraging this understanding to enhance recommendations in online recruitment, including the promotion of out-of-distribution (OOD) application. We present a novel framework that harnesses the rich contextual information and semantic representations provided by large language models to analyze behavior graphs and uncover underlying patterns and relationships. Specifically, we propose a meta-path prompt constructor that leverages LLM recommender to understand behavior graphs for the first time and design a corresponding path augmentation module to alleviate the prompt bias introduced by path-based sequence input. By leveraging this capability, our framework enables personalized and accurate job recommendations for individual users. We evaluate the effectiveness of our approach on a comprehensive dataset and demonstrate its ability to improve the relevance and quality of recommended quality. This research not only sheds light on the untapped potential of large language models but also provides valuable insights for developing advanced recommendation systems in the recruitment market. The findings contribute to the growing field of natural language processing and offer practical implications for enhancing job search experiences.

[1]  Hui Xiong,et al.  Generative Job Recommendations with Large Language Model , 2023, ArXiv.

[2]  Hui Xiong,et al.  A Survey on Large Language Models for Recommendation , 2023, ArXiv.

[3]  Wayne Xin Zhao,et al.  Large Language Models are Zero-Shot Rankers for Recommender Systems , 2023, ArXiv.

[4]  Wayne Xin Zhao,et al.  Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach , 2023, ArXiv.

[5]  Ed H. Chi,et al.  Do LLMs Understand User Preferences? Evaluating LLMs On User Rating Prediction , 2023, ArXiv.

[6]  Xiangnan He,et al.  TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation , 2023, ArXiv.

[7]  Bang-wei Wang,et al.  Prompt Learning for News Recommendation , 2023, SIGIR.

[8]  Wayne Xin Zhao,et al.  Modeling Two-Way Selection Preference for Person-Job Fit , 2022, RecSys.

[9]  Jingren Zhou,et al.  M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systems , 2022, ArXiv.

[10]  Tao Qi,et al.  UserBERT: Contrastive User Model Pre-training , 2021, ArXiv.

[11]  Yelong Shen,et al.  LoRA: Low-Rank Adaptation of Large Language Models , 2021, ICLR.

[12]  Zhaopeng Qiu,et al.  U-BERT: Pre-training User Representations for Improved Recommendation , 2021, AAAI.

[13]  Ji-Rong Wen,et al.  Learning to Match Jobs with Resumes from Sparse Interaction Data using Multi-View Co-Teaching Network , 2020, CIKM.

[14]  C. Hauff,et al.  What does BERT know about books, movies and music? Probing BERT for Conversational Recommendation , 2020, RecSys.

[15]  Yizhou Sun,et al.  Heterogeneous Graph Transformer , 2020, WWW.

[16]  Dongyan Zhao,et al.  Towards Effective and Interpretable Person-Job Fitting , 2019, CIKM.

[17]  Yong Luo,et al.  ResumeGAN: An Optimized Deep Representation Learning Framework for Talent-Job Fit via Adversarial Learning , 2019, CIKM.

[18]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[19]  Dongyan Zhao,et al.  Interview Choice Reveals Your Preference on the Market: To Improve Job-Resume Matching through Profiling Memories , 2019, KDD.

[20]  Bo Hu,et al.  Towards Deep and Representation Learning for Talent Search at LinkedIn , 2018, CIKM.

[21]  Hui Xiong,et al.  A Joint Learning Approach to Intelligent Job Interview Assessment , 2018, IJCAI.

[22]  Hui Xiong,et al.  Enhancing Person-Job Fit for Talent Recruitment: An Ability-aware Neural Network Approach , 2018, SIGIR.

[23]  Ganesh Venkataraman,et al.  Personalized Job Recommendation System at LinkedIn: Practical Challenges and Lessons Learned , 2017, RecSys.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Denis Gillet,et al.  A recommender system for job seeking and recruiting website , 2013, WWW.

[26]  Li Dong,et al.  Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers , 2023, ACL.

[27]  Yang Song,et al.  Beyond Matching: Modeling Two-Sided Multi-Behavioral Sequences for Dynamic Person-Job Fit , 2021, DASFAA.

[28]  ROBERTA: A ROBUSTLY OPTIMIZED BERT PRE- , 2019 .