Estimating Domain-Specific User Expertise for Answer Retrieval in Community Question-Answering Platforms

Community Question-Answering (CQA) platforms leverage the inherent wisdom of the crowd - enabling users to retrieve quality information from domain experts through natural language. An important and challenging task is to identify reliable and trusted experts on large popular CQA platforms. State-of-the-art graph-based approaches to expertise estimation consider only user-user interactions without taking the relative contribution of individual answers into account, while pairwise-comparison approaches consider only pairs involving the best-answerer of each question. This research argues that there is a need to account for the user's relative contribution towards solving the question when estimating user expertise and proposes a content-agnostic measure of user contributions. This addition is incorporated into a competition-based approach for ranking users' question answering ability. The paper analyses how improvements in user expertise estimation impact on applications in expert search and answer quality prediction. Experiments using the Yahoo! Chiebukuro data show encouraging performance improvements and robustness over state-of-the-art approaches.

[1]  W. Bruce Croft,et al.  A framework to predict the quality of answers with non-textual features , 2006, SIGIR.

[2]  Çigdem Aslay,et al.  Competition-based networks for expert finding , 2013, SIGIR.

[3]  M. Glickman Parameter Estimation in Large Dynamic Paired Comparison Experiments , 1999 .

[4]  Christoph Meinel,et al.  Measuring Expertise in Online Communities , 2011, IEEE Intelligent Systems.

[5]  Shengrui Wang,et al.  Identifying authoritative actors in question-answering forums: the case of Yahoo! answers , 2008, KDD.

[6]  Mark E. Glickman,et al.  Dynamic paired comparison models with stochastic variances , 2001 .

[7]  Ee-Peng Lim,et al.  Quality-aware collaborative question answering: methods and evaluation , 2009, WSDM '09.

[8]  Weiguo Fan,et al.  ExpertRank: An Expert User Ranking Algorithm in Online Communities , 2009, 2009 International Conference on New Trends in Information and Service Science.

[9]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[10]  Marc Najork,et al.  Hits on the web: how does it compare? , 2007, SIGIR.

[11]  James P. Callan,et al.  Analyzing bias in CQA-based expert finding test sets , 2014, SIGIR.

[12]  Joseph A. Konstan,et al.  Expert identification in community question answering: exploring question selection bias , 2010, CIKM '10.

[13]  Yue Lu,et al.  Exploiting user profile information for answer ranking in cQA , 2012, WWW.

[14]  Paul P. Maglio,et al.  Expertise identification using email communications , 2003, CIKM '03.

[15]  Sharma Chakravarthy,et al.  Expertise Ranking of Users in QA Community , 2013, DASFAA.

[16]  Zhoujun Li,et al.  Question Retrieval with High Quality Answers in Community Question Answering , 2014, CIKM.

[17]  Young-In Song,et al.  Competition-based user expertise score estimation , 2011, SIGIR.

[18]  Christoph Meinel,et al.  Telling experts from spammers: expertise ranking in folksonomies , 2009, SIGIR.

[19]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[20]  Yi Zhang,et al.  Graph-based ranking algorithms for e-mail expertise analysis , 2003, DMKD '03.

[21]  Mark S. Ackerman,et al.  Expertise networks in online communities: structure and algorithms , 2007, WWW '07.

[22]  Jure Leskovec,et al.  Discovering value from community activity on focused question answering sites: a case study of stack overflow , 2012, KDD.

[23]  Eugene Agichtein,et al.  Predicting information seeker satisfaction in community question answering , 2008, SIGIR '08.

[24]  Irwin King,et al.  Routing questions to appropriate answerers in community question answering services , 2010, CIKM.

[25]  F. Maxwell Harper,et al.  Exploring Question Selection Bias to Identify Experts and Potential Experts in Community Question Answering , 2012, TOIS.

[26]  Jure Leskovec,et al.  From amateurs to connoisseurs: modeling the evolution of user expertise through online reviews , 2013, WWW.

[27]  Jun Zhao,et al.  Topic-sensitive probabilistic model for expert finding in question answer communities , 2012, CIKM.

[28]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[29]  Huiping Sun,et al.  CQArank: jointly model topics and expertise in community question answering , 2013, CIKM.

[30]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[31]  Eugene Agichtein,et al.  Learning to recognize reliable users and content in social media with coupled mutual reinforcement , 2009, WWW '09.

[32]  P. Kollock The Economies of Online Cooperation: Gifts and Public Goods in Cyberspace , 1999 .