An experimental system for measuring the credibility of news content in Twitter

Purpose – Owing to the large amount of information available on Twitter (a micro blogging service) that is not necessarily true or believable, credibility of news published in such an electronic channel has become an important area for investigation in the field of web credibility. This paper aims to address this issue.Design/methodology/approach – A system was developed to measure the credibility of news content published in Twitter. The system uses two approaches to assign credibility levels (low, high and average) to each tweet. The first approach is based on the similarity between Twitter posts (tweets) and authentic (i.e. verified) news sources. The second approach is based on the similarity with verified news sources in addition to a set of proposed features.Findings – The evaluations of the two approaches showed that assigning credibility levels to Twitter tweets for the first approach has a higher precision and recall. Additional experiments showed that the linking feature has its impact on the se...

[1]  M. de Rijke,et al.  PodCred: a framework for analyzing podcast preference , 2008, WICOW '08.

[2]  Pankaj Kamthan.  A Framework for the Active Credibility Engineering of Web Applications , 2008, Int. J. Inf. Technol. Web Eng..

[3]  Siddharth Srivastava,et al.  Anonymizing Social Networks , 2007 .

[4]  Hanan Samet,et al.  TwitterStand: news in tweets , 2009, GIS.

[5]  Brent Auernheimer,et al.  Web site credibility: Why do people believe what they believe? , 2009 .

[6]  Soo Young Rieh,et al.  Developing a unifying framework of credibility assessment: Construct, heuristics, and interaction in context , 2008, Inf. Process. Manag..

[7]  Barry Smyth,et al.  Using twitter to recommend real-time topical news , 2009, RecSys '09.

[8]  Elizabeth D. Liddy,et al.  Assessing Credibility of Weblogs , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[9]  M. de Rijke,et al.  Credibility Improves Topical Blog Post Retrieval , 2008, ACL.

[10]  Noriko Kando,et al.  A method of rating the credibility of news documents on the web , 2006, SIGIR '06.

[11]  Jonathan Lazar,et al.  Understanding Web Credibility: A Synthesis of the Research Literature , 2007, Found. Trends Hum. Comput. Interact..

[12]  Soo Young Rieh,et al.  Credibility: A multidisciplinary framework , 2007 .

[13]  Yongtae Park,et al.  Multidimensional credibility model for neighbor selection in collaborative recommendation , 2009, Expert Syst. Appl..

[14]  Kenneth Baclawski,et al.  New Metrics for Newsblog Credibility , 2007, ICWSM.

[15]  Michael Granitzer,et al.  Blog credibility ranking by exploiting verified content , 2009, WICOW.

[16]  Timothy W. Finin,et al.  Why we twitter: understanding microblogging usage and communities , 2007, WebKDD/SNA-KDD '07.

[17]  Kentaro Inui,et al.  Using Appearance Information for Web Information Credibility Analysis , 2008, 2008 Second International Symposium on Universal Communication.

[18]  Luís Carriço,et al.  On the credibility of wikipedia: an accessibility perspective , 2008, WICOW '08.

[19]  Nayer M. Wanas,et al.  Automatic scoring of online discussion posts , 2008, WICOW '08.

[20]  Adam L. Kaczmarek.  Automatic Evaluation of Information Credibility in Semantic Web and Knowledge Grid , 2008, WEBIST.

[21]  Vitaly Shmatikov,et al.  De-anonymizing Social Networks , 2009, 2009 30th IEEE Symposium on Security and Privacy.

[22]  Satoshi Nakamura,et al.  Can social annotation support users in evaluating the trustworthiness of video clips? , 2008, WICOW '08.

[23]  Yutaka Kidawara.  Information credibility analysis of web content , 2008, WICOW '08.

[24]  Jack G. Conrad,et al.  Professional credibility: authority on the web , 2008, WICOW '08.

[25]  Leonid Novak,et al.  Sifting micro-blogging stream for events of user interest , 2009, SIGIR.

[26]  B. J. Fogg,et al.  Credibility and computing technology , 1999, CACM.

[27]  Susan C. Herring,et al.  Beyond Microblogging: Conversation and Collaboration via Twitter , 2009 .

[28]  Max Mühlhäuser,et al.  Automatically Assessing the Post Quality in Online Discussions on Software , 2007, ACL.

[29]  B. J. Fogg,et al.  What makes Web sites credible?: a report on a large quantitative study , 2001, CHI.

[30]  B. J. Fogg,et al.  Prominence-interpretation theory: explaining how people assess credibility online , 2003, CHI Extended Abstracts.