AUnet: An Unsupervised Method for Answer Reliability Evaluation in Community QA Systems

Recently, cQA websites such as Baidu Zhidao and StackExchange have exploded in popularity since everyone can post questions for other users to answer which fully realize the value of exchange. Nevertheless, the answers from different users for a same question may include errors, irrelevant messages or malicious advertisements due to the great different backgrounds of users. Hence, the automatic method for answer reliability evaluation is very important for improving users’ experience. However, the weakness of existing supervised methods is the high cost for they need a lot of annotated data. To alleviate such problems, we proposed a novel unsupervised answer evaluation method exploiting Answer-User association Network in this paper. Based on the constructed network, the reliability of answers and users can be obtained simultaneously by an iterative process. The experimental results on real word datasets show that our proposed method outperforms existing approaches.

[1]  Bo Zhao,et al.  A Confidence-Aware Approach for Truth Discovery on Long-Tail Data , 2014, Proc. VLDB Endow..

[2]  Feng Xu,et al.  Detecting high-quality posts in community question answering sites , 2015, Inf. Sci..

[3]  Yi Yang,et al.  Data-Driven Answer Selection in Community QA Systems , 2017, IEEE Transactions on Knowledge and Data Engineering.

[4]  Daniele Bonadiman,et al.  Learning to Rank Non-Factoid Answers: Comment Selection in Web Forums , 2016, CIKM.

[5]  Arjun Mukherjee,et al.  Detecting Campaign Promoters on Twitter Using Markov Random Fields , 2014, 2014 IEEE International Conference on Data Mining.

[6]  Luo Si,et al.  A probabilistic graphical model for joint answer ranking in question answering , 2007, SIGIR.

[7]  Hao Wu,et al.  Extracting Medical Knowledge from Crowdsourced Question Answering Website , 2020, IEEE Transactions on Big Data.

[8]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[9]  Mark S. Ackerman,et al.  Expertise networks in online communities: structure and algorithms , 2007, WWW '07.

[10]  Jeffrey Pomerantz,et al.  Evaluating and predicting answer quality in community QA , 2010, SIGIR.

[11]  W. Bruce Croft,et al.  A framework to predict the quality of answers with non-textual features , 2006, SIGIR.

[12]  Christos Faloutsos,et al.  Opinion Fraud Detection in Online Reviews by Network Effects , 2013, ICWSM.

[13]  Pável Calado,et al.  Exploiting user feedback to learn to rank answers in q&a forums: a case study with stack overflow , 2013, SIGIR.

[14]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[15]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Wei Hu,et al.  Exploiting Source-Object Networks to Resolve Object Conflicts in Linked Data , 2017, ESWC.

[17]  B. J. Fogg,et al.  The elements of computer credibility , 1999, CHI '99.

[18]  Enhong Chen,et al.  An Unsupervised Approach for Low-Quality Answer Detection in Community Question-Answering , 2017, DASFAA.

[19]  Eugene Agichtein,et al.  Discovering authorities in question answer communities by using link analysis , 2007, CIKM '07.

[20]  Josef Kittler,et al.  Combining classifiers , 1996, Proceedings of 13th International Conference on Pattern Recognition.