Model for Voter Scoring and Best Answer Selection in Community Q&A Services

Community Question Answering (cQA) services, such as Yahoo! Answers and MSN QnA, facilitate knowledge sharing through question answering by an online community of users. These services include incentive mechanisms to entice participation and self-regulate the quality of the content contributed by the users. In order to encourage quality contributions, community members are asked to nominate the ‘best’ among the answers provided to a question. The service then awards extra points to the author who provided the winning answer and to the voters who cast their vote for that answer. The best answers are typically selected by plurality voting, a scheme that is simple, yet vulnerable to random voting and collusion. We propose a weighted voting method that incorporates information about the voters’ behavior. It assigns a score to each voter that captures the level of agreement with other voters. It uses the voter scores to aggregate the votes and determine the best answer. The mathematical formulation leads to the application of the Brouwer Fixed Point Theorem which guarantees the existence of a voter scoring function that satisfies the starting axiom. We demonstrate the robustness of our approach through simulations and analysis of real cQA service data.

[1]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[2]  Qi Su,et al.  Internet-scale collection of human-reviewed data , 2007, WWW '07.

[3]  Georgia Koutrika,et al.  Questioning Yahoo! Answers , 2007 .

[4]  Eugene Agichtein,et al.  A few bad votes too many?: towards robust ranking in social media , 2008, AIRWeb '08.

[5]  W. Bruce Croft,et al.  A framework to predict the quality of answers with non-textual features , 2006, SIGIR.

[6]  Sheizaf Rafaeli,et al.  Predictors of answer quality in online Q&A sites , 2008, CHI.

[7]  Eugene Agichtein,et al.  Discovering authorities in question answer communities by using link analysis , 2007, CIKM '07.

[8]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[9]  Chrysanthos Dellarocas,et al.  Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior , 2000, EC '00.

[10]  Robin S. Poston Using and fixing biased rating schemes , 2008, CACM.

[11]  Aleksandar Ignjatovic,et al.  An Analytic Approach to Reputation Ranking of Participants in Online Transactions , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[12]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[13]  Sandip Sen,et al.  Robustness of reputation-based trust: boolean case , 2002, AAMAS '02.

[14]  Eugene Agichtein,et al.  Finding the right facts in the crowd: factoid question answering over social media , 2008, WWW.

[15]  Loren G. Terveen,et al.  The dynamics of mass interaction , 1998, CSCW '98.