Utilizing non-QA data to improve questions routing for users with low QA activity in CQA

Community Question Answering (CQA) systems, such as Yahoo! Answers and Stack Overflow, represent a well-known example of collective intelligence. The existing CQA systems, despite their overall successfulness and popularity, fail to answer a significant amount of questions in required time. One option for scaffolding collaboration in CQA systems is a recommendation of new questions to users who are suitable candidates for providing correct answers (so called question routing). Various methods have been proposed so far to find appropriate answerers, but almost all approaches heavily depend on previous users' activities in a particular CQA system (i.e. QA-data). In our work, we attempt to involve a whole community including users with no or minimal previous activity (e.g. newcomers or lurkers). We proposed a question routing method which analyses users' non-QA data from a CQA system itself as well as from external services and platforms, such as blogs, micro-blogs or social networking sites, in order to estimate users' interests and expertise early and more precisely. Consequently, we can recommend new questions to a wider part of a community as well as more accurately. Evaluation on a dataset from Stack Exchange platform showed that considering non-QA data leads not only to better recognition of users with low activity as suitable answerers, but also to higher overall precision of the recommendations. It implies that non-QA data can supplement QA data during expertise estimation in question routing and thus also improve a success rate of a questions answering process.

[1]  Alessandro Bozzon,et al.  Sparrows and Owls: Characterisation of Expert Behaviour in StackOverflow , 2014, UMAP.

[2]  Mária Bieliková,et al.  Why is Stack Overflow Failing? Preserving Sustainability in Community Question Answering , 2016, IEEE Software.

[3]  Wilfred Ng,et al.  Expert Finding for Question Answering via Graph Regularized Matrix Completion , 2015, IEEE Transactions on Knowledge and Data Engineering.

[4]  Qing Yang,et al.  Predicting Best Answerers for New Questions in Community Question Answering , 2010, WAIM.

[5]  Jun Zhao,et al.  Joint relevance and answer quality learning for question routing in community QA , 2012, CIKM.

[6]  Ivan Srba,et al.  Askalot: Community Question Answering as a Means for Knowledge Sharing in an Educational Organization , 2015, CSCW Companion.

[7]  Yong Yu,et al.  Tapping on the potential of q&a community by recommending answer providers , 2008, CIKM '08.

[8]  Qinying Liao,et al.  To answer or not: what non-qa social activities can tell , 2013, CSCW '13.

[9]  Ivan Srba,et al.  Why Stack Overflow Fails ? Preservation of Sustainability in Community Question Answering , 2015 .

[10]  Xiaoyan Zhu,et al.  Question routing in community based QA: incorporating answer quality and answer content , 2012, MDS '12.

[11]  Irwin King,et al.  Routing questions to appropriate answerers in community question answering services , 2010, CIKM.

[12]  Eugene Agichtein,et al.  When web search fails, searchers become askers: understanding the transition , 2012, SIGIR '12.

[13]  Alexander J. Smola,et al.  Scalable distributed inference of dynamic user interests for behavioral targeting , 2011, KDD.

[14]  Idan Szpektor,et al.  When relevance is not enough: promoting diversity and freshness in personalized question recommendation , 2013, WWW.

[15]  Bin Wang,et al.  Learning to rank for question routing in community question answering , 2013, CIKM.

[16]  Enhong Chen,et al.  Finding Experts in Tag Based Knowledge Sharing Communities , 2011, KSEM.

[17]  Fei Xu,et al.  Dual role model for question recommendation in community question answering , 2012, SIGIR '12.

[18]  David Lo,et al.  Predicting Best Answerers for New Questions: An Approach Leveraging Topic Modeling and Collaborative Voting , 2013, SocInfo Workshops.

[19]  Fei Wang,et al.  Who have got answers?: growing the pool of answerers in a smart enterprise social QA system , 2014, IUI.

[20]  Bernard J. Jansen,et al.  Predicting potential responders in social Q&A based on non-QA features , 2014, CHI Extended Abstracts.

[21]  Michael R. Lyu,et al.  A classification-based approach to question routing in community question answering , 2012, WWW.

[22]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[23]  Evangelos E. Milios,et al.  Finding expert users in community question answering , 2012, WWW.