Augmenting web pages and search results to support credibility assessment

The presence (and, sometimes, prominence) of incorrect and misleading content on the Web can have serious consequences for people who increasingly rely on the internet as their information source for topics such as health, politics, and financial advice. In this paper, we identify and collect several page features (such as popularity among specialized user groups) that are currently difficult or impossible for end users to assess, yet provide valuable signals regarding credibility. We then present visualizations designed to augment search results and Web pages with the most promising of these features. Our lab evaluation finds that our augmented search results are particularly effective at increasing the accuracy of users'" credibility assessments, highlighting the potential of data aggregation and simple interventions to help people make more informed decisions as they search for information online.

[1]  Lindsay Fullerton,et al.  Trust Online: Young Adults' Evaluation of Web Content , 2010 .

[2]  Charles J. Kacmar,et al.  Factors and effects of information credibility , 2007, ICEC.

[3]  Marti A. Hearst,et al.  Statistical profiles of highly-rated web sites , 2002, CHI.

[4]  Ling Liu,et al.  Countering web spam with credibility-based link analysis , 2007, PODC '07.

[5]  Aniket Kittur,et al.  Can you ever trust a wiki?: impacting perceived trustworthiness in wikipedia , 2008, CSCW.

[6]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[7]  B. J. Fogg,et al.  Prominence-interpretation theory: explaining how people assess credibility online , 2003, CHI Extended Abstracts.

[8]  Oren Etzioni,et al.  Open Information Extraction from the Web , 2007, CACM.

[9]  Michael Gamon,et al.  BLEWS: Using Blogs to Provide Context for News Articles , 2008, ICWSM.

[10]  Edward Cutrell,et al.  What are you looking for?: an eye-tracking study of information usage in web search , 2007, CHI.

[11]  Jonathan Lazar,et al.  Understanding Web Credibility: A Synthesis of the Research Literature , 2007, Found. Trends Hum. Comput. Interact..

[12]  Ed H. Chi,et al.  Using information scent to model user information needs and actions and the Web , 2001, CHI.

[13]  Soo Young Rieh,et al.  Developing a unifying framework of credibility assessment: Construct, heuristics, and interaction in context , 2008, Inf. Process. Manag..

[14]  Dan Morris,et al.  Investigating the querying and browsing behavior of advanced search engine users , 2007, SIGIR.

[15]  Barbara Rosario,et al.  What is disputed on the web? , 2010, WICOW '10.

[16]  D. R. Danielson,et al.  How do users evaluate the credibility of Web sites?: a study with over 2,500 participants , 2003, DUX '03.

[17]  Henry Jenkins.  Confronting the Challenges of Participatory Culture: Media Education for the 21st Century , 2006 .

[18]  Thorsten Joachims,et al.  Accurately Interpreting Clickthrough Data as Implicit Feedback , 2017 .

[19]  Julie Coiro.  The New Literacies of Online Reading Comprehension: Future Directions , 2012 .

[20]  Hector Garcia-Molina,et al.  Combating Web Spam with TrustRank , 2004, VLDB.

[21]  Susan Ferebee,et al.  An Examination of the Influence of Involvement Level of Web Site Users on the Perceived Credibility of Web Sites , 2007, PERSUASIVE.

[22]  Ryen W. White,et al.  Characterizing the influence of domain expertise on web search behavior , 2009, WSDM '09.

[23]  Ben Shneiderman,et al.  Designing trust into online experiences , 2000, CACM.

[24]  Min Wu,et al.  Do security toolbars actually prevent phishing attacks? , 2006, CHI.

[25]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[26]  Miriam J. Metzger.  Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research , 2007, J. Assoc. Inf. Sci. Technol..

[27]  Suresh K. Bhavnani,et al.  Domain-specific search strategies for the effective retrieval of healthcare and shopping information , 2002, CHI Extended Abstracts.

[28]  B. J. Fogg,et al.  What makes Web sites credible?: a report on a large quantitative study , 2001, CHI.