Isolating the Effects of Web Page Visual Appearance on the Perceived Credibility of Online News among College Students

Online news sources have transformed civic discourse, and much has been made of their credibility. Although web page credibility has been investigated generally, most work has focused on the credibility of web page content. In this work, we study the isolated appearance of news-like web pages. Specifically, we report on a laboratory experiment involving 31 college students rating the perceived credibility of news-like web pages devoid of meaningful content. These pages contain only "lorem ipsum" text, indistinct videos and images, non-functional links, and various font settings. Our findings show that perceived credibility is indeed affected by some purely presentational factors. Specifically, video presence increased credibility, while large fonts and having no images reduced credibility. Having a few, but not too many, images increased credibility for short articles, especially in the presence of large fonts. We also conducted follow-up interviews, which revealed that participants noticed images, videos, and font sizes when making credibility judgments, corroborating our quantitative experimental results.

[1]  J. Tukey.  Comparing individual means in the analysis of variance. , 1949, Biometrics.

[2]  L. A. Marascuilo,et al.  Appropriate Post Hoc Comparisons for Interaction and Nested Hypotheses in Analysis of Variance Designs: The Elimination of Type IV Errors1 , 1970 .

[3]  P. Rosenthal.  Specificity, verifiability, and message credibility , 1971 .

[4]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[5]  K. C. Salter,et al.  A robust and powerful rank test of treatment effects in balanced incomplete block designs , 1985 .

[6]  Roderick J. Lawrence.  The log-normal as event-time distribution , 1988 .

[7]  K. Salter,et al.  A robust and powerful rank test of treatment effects in balanced incomplete block designs , 1985 .

[8]  M. Slater,et al.  How Message Evaluation and Source Attributes May Influence Credibility Assessment and Belief Change , 1996 .

[9]  Jinwoo Kim,et al.  Designing towards emotional usability in customer interfaces trustworthiness of cyber-banking system interfaces , 1998, Interact. Comput..

[10]  Nicholas C. Burbules,et al.  Rhetorics of the web: hyperreading and critical literacy" in page to screen: taking literacy into th , 2003 .

[11]  R C Littell,et al.  Statistical analysis of repeated measures data using SAS procedures. , 1998, Journal of animal science.

[12]  Brigitte N. Frederick.  Fixed-, Random-, and Mixed-Effects ANOVA Models: A User-Friendly Guide for Increasing the Generalizability of ANOVA Results. , 1999 .

[13]  B. J. Fogg,et al.  The elements of computer credibility , 1999, CHI '99.

[14]  Miriam J. Metzger,et al.  Perceptions of Internet Information Credibility , 2000 .

[15]  B. J. Fogg,et al.  What makes Web sites credible?: a report on a large quantitative study , 2001, CHI.

[16]  Larry Powell,et al.  Cable Television News Viewed as Most Credible , 2001 .

[17]  Jacquelyn A. Burkell,et al.  Believe it or not: Factors influencing credibility on the Web , 2002, J. Assoc. Inf. Sci. Technol..

[18]  D. R. Danielson,et al.  How do users evaluate the credibility of Web sites?: a study with over 2,500 participants , 2003, DUX '03.

[19]  Miriam J. Metzger,et al.  Credibility for the 21st Century: Integrating Perspectives on Source, Message, and Media Credibility in the Contemporary Media Environment , 2003 .

[20]  J. Amsbary,et al.  Factors Influencing Evaluations of Web Site Information , 2003, Psychological reports.

[21]  K. Freeman,et al.  An Examination of Factors That Affect the Credibility of Online Health Information , 2004 .

[22]  Marc Meola,et al.  Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-Site Evaluation , 2004 .

[23]  Ziming Liu,et al.  Perceptions of credibility of scholarly information on the web , 2004, Inf. Process. Manag..

[24]  Noam Tractinsky,et al.  Evaluating the consistency of immediate aesthetic perceptions of web pages , 2006, Int. J. Hum. Comput. Stud..

[25]  Max D. Morris,et al.  An Overview of Group Factor Screening , 2006 .

[26]  Miriam J. Metzger,et al.  behaviors on the perceived credibility of web-based information The role of site features, user attributes, and information verification , 2007 .

[27]  Thorsten Quandt,et al.  (NO) NEWS ON THE WORLD WIDE WEB? , 2008 .

[28]  David Robins,et al.  Aesthetics and credibility in web site design , 2008, Inf. Process. Manag..

[29]  Ardion Beldad,et al.  How shall I trust the faceless and the intangible? A literature review on the antecedents of online trust , 2010, Comput. Hum. Behav..

[30]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[31]  Alexandre N. Tuch,et al.  The role of visual complexity and prototypicality regarding first impression of websites: Working towards understanding aesthetic judgments , 2012, Int. J. Hum. Comput. Stud..

[32]  Miriam J. Metzger,et al.  Credibility and trust of information in online environments: The use of cognitive heuristics , 2013 .

[33]  Timothy C. Brock,et al.  Effects of Source Characteristics on Cognitive Responses and Persuasion , 2014 .

[34]  Michael C. Dorneich,et al.  A Process for Evaluating the Gender and Professionalism of Web Design Elements , 2016 .

[35]  Vincent P. Wade,et al.  Perception of bias: the impact of user characteristics, website design and technical features , 2017, WI.

[36]  M. Gentzkow,et al.  Social Media and Fake News in the 2016 Election , 2017 .