Expert finding in community question answering: a review

The rapid development of Community Question Answering (CQA) satisfies users’ quest for professional and personal knowledge about anything. In CQA, one central issue is to find users with expertise and willingness to answer the given questions. Expert finding in CQA often exhibits very different challenges compared to traditional methods. The new features of CQA (such as huge volume, sparse data and crowdsourcing) violate fundamental assumptions of traditional recommendation systems. This paper focuses on reviewing and categorizing the current progress on expert finding in CQA. We classify the recent solutions into four different categories: matrix factorization based models (MF-based models), gradient boosting tree based models (GBT-based models), deep learning based models (DL-based models) and ranking based models (R-based models). We find that MF-based models outperform other categories of models in the crowdsourcing situation. Moreover, we use innovative diagrams to clarify several important concepts of ensemble learning, and find that ensemble models with several specific single models can further boost the performance. Further, we compare the performance of different models on different types of matching tasks, including text vs. text , graph vs. text , audio vs. text and video vs. text . The results will help the model selection of expert finding in practice. Finally, we explore some potential future issues in expert finding research in CQA.

[1]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[2]  Veselka Boeva,et al.  Data-driven Techniques for Expert Finding , 2017, ICAART.

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  Wilfred Ng,et al.  Expert Finding for Question Answering via Graph Regularized Matrix Completion , 2015, IEEE Transactions on Knowledge and Data Engineering.

[5]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[6]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[7]  Xiaolin Zheng,et al.  Deep Collaborative Autoencoder for Recommender Systems: A Unified Framework for Explicit and Implicit Feedback , 2017, ArXiv.

[8]  Yoram Singer,et al.  Local Low-Rank Matrix Approximation , 2013, ICML.

[9]  Ying Ding,et al.  Finding topic-level experts in scholarly networks , 2013, Scientometrics.

[10]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[11]  Hui Xiong,et al.  Ranking user authority with relevant knowledge categories for expert finding , 2014, World Wide Web.

[12]  Ahmad Kardan,et al.  Expert finding on social network with link analysis approach , 2011, 2011 19th Iranian Conference on Electrical Engineering.

[13]  Ronghuai Huang,et al.  Social Context Analysis for Topic-Specific Expert Finding in Online Learning Communities , 2015 .

[14]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[15]  Evangelos E. Milios,et al.  Finding expert users in community question answering , 2012, WWW.

[16]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .

[17]  Shengrui Wang,et al.  Identifying authoritative actors in question-answering forums: the case of Yahoo! answers , 2008, KDD.

[18]  Yueting Zhuang,et al.  Expert Finding for Community-Based Question Answering via Ranking Metric Network Learning , 2016, IJCAI.

[19]  Hongbo Deng,et al.  Formal Models for Expert Finding on DBLP Bibliography Data , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[20]  Le Song,et al.  Recurrent Coevolutionary Latent Feature Processes for Continuous-Time Recommendation , 2016, DLRS@RecSys.

[21]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[22]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[23]  Hamid Beigy,et al.  Expertise retrieval in bibliographic network: a topic dominance learning approach , 2013, CIKM.

[24]  Kai Chen,et al.  Collaborative filtering and deep learning based recommendation system for cold start items , 2017, Expert Syst. Appl..

[25]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[26]  Juan-Zi Li,et al.  Expert Finding in a Social Network , 2007, DASFAA.

[27]  Tao Li,et al.  A survey on expert finding techniques , 2017, Journal of Intelligent Information Systems.

[28]  Alfred Kobsa,et al.  Expert-Finding Systems for Organizations: Problem and Domain Analysis and the DEMOIR Approach , 2003, J. Organ. Comput. Electron. Commer..

[29]  Duen-Ren Liu,et al.  Integrating expert profile, reputation and link analysis for expert finding in question-answering websites , 2013, Inf. Process. Manag..

[30]  Lina Yao,et al.  AutoSVD++: An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders , 2017, SIGIR.

[31]  Le Song,et al.  Recurrent Coevolutionary Feature Embedding Processes for Recommendation , 2017, ArXiv.

[32]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[33]  Mahmood Neshati,et al.  Skill Translation Models in Expert Finding , 2017, SIGIR.

[34]  Xin Li,et al.  ZhihuRank: A Topic-Sensitive Expert Finding Algorithm in Community Question Answering Websites , 2015, ICWL.

[35]  Yiqun Liu,et al.  Detecting Promotion Campaigns in Community Question Answering , 2015, IJCAI.

[36]  W. Bruce Croft,et al.  Finding experts in community-based question-answering services , 2005, CIKM '05.

[37]  V. Valli Kumari,et al.  Expert Finding System using Latent Effort Ranking in Academic Social Networks , 2015 .

[38]  Shudong Li,et al.  A Hybrid Model for Experts Finding in Community Question Answering , 2015, 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[39]  Liang Chen,et al.  Collaborative Deep Ranking: A Hybrid Pair-Wise Recommendation Algorithm with Implicit Feedback , 2016, PAKDD.

[40]  Tingting He,et al.  An empirical study of topic-sensitive probabilistic model for expert finding in question answer communities , 2014, Knowl. Based Syst..

[41]  Udo Kruschwitz,et al.  Finding the Right Supervisor: Expert-Finding in a University Domain , 2012, NAACL.

[42]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[43]  Deng Cai,et al.  Distributed Representations of Expertise , 2016, SDM.

[44]  Jason Weston,et al.  Question Answering with Subgraph Embeddings , 2014, EMNLP.

[45]  Andrew McCallum,et al.  Expertise modeling for matching papers with reviewers , 2007, KDD '07.

[46]  Ahmad A. Kardan,et al.  A novel method for expert finding in online communities based on concept map and PageRank , 2015, Human-centric Computing and Information Sciences.

[47]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[48]  Weiguo Fan,et al.  ExpertRank: A topic-aware expert finding algorithm for online knowledge communities , 2013, Decis. Support Syst..

[49]  Juan-Zi Li,et al.  A Mixture Model for Expert Finding , 2008, PAKDD.

[50]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[51]  Geoff Holmes,et al.  New ensemble methods for evolving data streams , 2009, KDD.

[52]  James P. Callan,et al.  Constructing effective and efficient topic-specific authority networks for expert finding in social media , 2014, SoMeRA@SIGIR.

[53]  Xiang Cheng,et al.  Exploiting User Feedback for Expert Finding in Community Question Answering , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[54]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[55]  Hamid Beigy,et al.  On dynamicity of expert finding in community question answering , 2017, Inf. Process. Manag..

[56]  M. de Rijke,et al.  Formal language models for finding groups of experts , 2016, Inf. Process. Manag..

[57]  Felix Naumann,et al.  Topic modeling for expert finding using latent Dirichlet allocation , 2013, WIREs Data Mining Knowl. Discov..

[58]  Elmar Eisemann,et al.  Approximated and User Steerable tSNE for Progressive Visual Analytics , 2015, IEEE Transactions on Visualization and Computer Graphics.

[59]  Jun Zhao,et al.  Topic-sensitive probabilistic model for expert finding in question answer communities , 2012, CIKM.

[60]  Huiping Sun,et al.  CQArank: jointly model topics and expertise in community question answering , 2013, CIKM.

[61]  Djoerd Hiemstra,et al.  Entity Ranking on Graphs: Studies on Expert Finding , 2007 .

[62]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[63]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[64]  Xuanjing Huang,et al.  Convolutional Neural Tensor Network Architecture for Community-Based Question Answering , 2015, IJCAI.

[65]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[66]  Bin Shen,et al.  Collaborative Memory Network for Recommendation Systems , 2018, SIGIR.

[67]  Yujiu Yang,et al.  A Service Mode of Expert Finding in Social Network , 2013, 2013 International Conference on Service Sciences (ICSS).

[68]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[69]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[70]  Alessandro Bozzon,et al.  Choosing the right crowd: expert finding in social networks , 2013, EDBT '13.

[71]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[72]  Yong Yu,et al.  SVDFeature: a toolkit for feature-based collaborative filtering , 2012, J. Mach. Learn. Res..

[73]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[74]  Jie Tang,et al.  Weakly Learning to Match Experts in Online Community , 2016, IJCAI.

[75]  Ryen W. White,et al.  Enhancing Expert Finding Using Organizational Hierarchies , 2009, ECIR.

[76]  Xueqi Cheng,et al.  Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNN , 2016, IJCAI.

[77]  John R. Anderson,et al.  Beyond Globally Optimal: Focused Learning for Improved Recommendations , 2017, WWW.

[78]  Wilfred Ng,et al.  Cold-Start Expert Finding in Community Question Answering via Graph Regularization , 2015, DASFAA.

[79]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[80]  M. de Rijke,et al.  Expertise Retrieval , 2012, Found. Trends Inf. Retr..

[81]  Jia Li,et al.  Latent Cross: Making Use of Context in Recurrent Recommender Systems , 2018, WSDM.

[82]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[83]  Juan-Zi Li,et al.  Temporal expert finding through generalized time topic modeling , 2010, Knowl. Based Syst..

[84]  Dongdai Lin,et al.  Robust Face Clustering Via Tensor Decomposition , 2015, IEEE Transactions on Cybernetics.

[85]  Guy Shani,et al.  A Survey of Accuracy Evaluation Metrics of Recommendation Tasks , 2009, J. Mach. Learn. Res..

[86]  Evangelia Christakopoulou,et al.  Local Item-Item Models For Top-N Recommendation , 2016, RecSys.

[87]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[88]  Chunping Li,et al.  Topic-Level Expert Modeling in Community Question Answering , 2013, SDM.

[89]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[90]  Young-In Song,et al.  Competition-based user expertise score estimation , 2011, SIGIR.

[91]  Hanning Zhou,et al.  A Neural Autoregressive Approach to Collaborative Filtering , 2016, ICML.

[92]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[93]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[94]  Alexander J. Smola,et al.  Neural Survival Recommender , 2017, WSDM.