Hierarchical Attentional Factorization Machines for Expert Recommendation in Community Question Answering

The most challenging task of Community Question Answering (CQA) is to provide high-quality answers to users’ questions. Currently, a variety of expert recommendation methods have been proposed and greatly improved the effective matching between questions and potential good answerers. However, the performance of existing methods can be adversely affected by many common factors such as data sparsity and noise problem, which cause less precise user modeling. Moreover, existing methods often model user-question interactions through simple ways, failing to capture the multiple scale interactions of question and answerers, which make it difficult to find answerers who are able to provide the best answers. In this paper, we propose an attention-based variant of Factorization Machines (FM) called Hierarchical Attentional Factorization Machines (HaFMRank) for answerer recommendation in CQA, which not only models the interactions between pairs of individual features but emphasizes the roles of crucial features and pairwise interactions. Specifically, we introduce the within-field attention layer to capture the inner structure of features belonging to the same field, while a feature-interaction attention layer is adopted to examine the importance of each pairwise interaction. A pre-training procedure is designed to generate latent FM feature embedding that encode question context and user history into the training process of HaFMRank. The performance of the proposed HaFMRank is evaluated by using real-world datasets of Stack Exchange and experimental results demonstrate that it outperforms several state-of-the-art methods in best answerer recommendation.

[1]  Guanjun Liu,et al.  A Hybrid Model on Learning Cross Features for Transaction Fraud Detection , 2019, ICDM.

[2]  Chih-Jen Lin,et al.  Field-aware Factorization Machines for CTR Prediction , 2016, RecSys.

[3]  Lina Yao,et al.  A Survey on Expert Recommendation in Community Question Answering , 2018, Journal of Computer Science and Technology.

[4]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[5]  Young-In Song,et al.  Competition-based user expertise score estimation , 2011, SIGIR.

[6]  Changhua Zhang,et al.  Users' brands preference based on SVD++ in recommender systems , 2014, 2014 IEEE Workshop on Advanced Research and Technology in Industry Applications (WARTIA).

[7]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[8]  Mohamed Bouguessa,et al.  Identifying Authorities in Online Communities , 2015, ACM Trans. Intell. Syst. Technol..

[9]  Suyu Ge,et al.  Neural News Recommendation with Multi-Head Self-Attention , 2019, EMNLP.

[10]  Tat-Seng Chua,et al.  Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks , 2017, IJCAI.

[11]  Wilfred Ng,et al.  Cold-Start Expert Finding in Community Question Answering via Graph Regularization , 2015, DASFAA.

[12]  Gang Wang,et al.  Wisdom in the social crowd: an analysis of quora , 2013, WWW.

[13]  Boualem Benatallah,et al.  Expert2Vec: Experts Representation in Community Question Answering for Question Routing , 2019, CAiSE.

[14]  Xiaofei Zhou,et al.  DAN: Deep Attention Neural Network for News Recommendation , 2019, AAAI.

[15]  Guanfeng Liu,et al.  DMRAN: A Hierarchical Fine-Grained Attention-Based Network for Recommendation , 2019, IJCAI.

[16]  Mark S. Ackerman,et al.  Competing to Share Expertise: The Taskcn Knowledge Sharing Community , 2021, ICWSM.

[17]  Li Shang,et al.  AdaError: An Adaptive Learning Rate Method for Matrix Approximation-based Collaborative Filtering , 2018, WWW.

[18]  Rui Yan,et al.  AIR: Attentional Intention-Aware Recommender Systems , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[19]  Tun Lu,et al.  Mixture Matrix Approximation for Collaborative Filtering , 2019 .

[20]  Mark S. Ackerman,et al.  Expertise networks in online communities: structure and algorithms , 2007, WWW '07.

[21]  Hui Xiong,et al.  Ranking user authority with relevant knowledge categories for expert finding , 2014, World Wide Web.

[22]  Guo Li,et al.  Predicting Collaborative Edits of Questions and Answers in Online Q&A Sites , 2016 .

[23]  Mária Bieliková,et al.  Exploiting Content Quality and Question Difficulty in CQA Reputation Systems , 2016, NetSci-X.

[24]  Alessandro Bozzon,et al.  Sparrows and Owls: Characterisation of Expert Behaviour in StackOverflow , 2014, UMAP.

[25]  Chang Zhou,et al.  ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation , 2017, AAAI.

[26]  Irwin King,et al.  Routing questions to appropriate answerers in community question answering services , 2010, CIKM.

[27]  Rada Mihalcea,et al.  TextRank: Bringing Order into Text , 2004, EMNLP.

[28]  Yizhou Sun,et al.  Personalized Question Routing via Heterogeneous Network Embedding , 2019, AAAI.

[29]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[30]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[31]  Srinivasan Parthasarathy,et al.  QDEE: Question Difficulty and Expertise Estimation in Community Question Answering Sites , 2018, ICWSM.

[32]  Xiang Cheng,et al.  A Multi-Objective Optimization Approach for Question Routing in Community Question Answering Services , 2017, IEEE Transactions on Knowledge and Data Engineering.

[33]  Sheizaf Rafaeli,et al.  Predictors of answer quality in online Q&A sites , 2008, CHI.

[34]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[35]  Le Wu,et al.  A Hierarchical Attention Model for Social Contextual Image Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[36]  Chunping Li,et al.  Topic-Level Expert Modeling in Community Question Answering , 2013, SDM.

[37]  Yueting Zhuang,et al.  Expert Finding for Community-Based Question Answering via Ranking Metric Network Learning , 2016, IJCAI.

[38]  Shengrui Wang,et al.  Identifying authoritative actors in question-answering forums: the case of Yahoo! answers , 2008, KDD.

[39]  Lars Schmidt-Thieme,et al.  Pairwise interaction tensor factorization for personalized tag recommendation , 2010, WSDM '10.

[40]  Shrish Verma,et al.  Multivariate Beta Mixture Model for Automatic Identification of Topical Authoritative Users in Community Question Answering Sites , 2016, IEEE Access.

[41]  Huiping Sun,et al.  CQArank: jointly model topics and expertise in community question answering , 2013, CIKM.

[42]  Kan Li,et al.  Knowledge Graph Based Question Routing for Community Question Answering , 2017, ICONIP.

[43]  Yu Han,et al.  Hierarchical Attention based Neural Network for Explainable Recommendation , 2019, ICMR.

[44]  Benjamin V. Hanrahan,et al.  Modeling problem difficulty and expertise in stackoverflow , 2012, CSCW.

[45]  Srinivasan Parthasarathy,et al.  ColdRoute: effective routing of cold questions in stack exchange sites , 2018, Data Mining and Knowledge Discovery.