Evaluating Information Credibility of Digital Content using Hybrid Approach

Digital content is not always credible where credibility refers to the believability of the content. Since the Web has both lowered the cost and increased access to information, it has enabled users in acquiring more content from a number of useful sources. For Web users, verifying information without having any prior knowledge is difficult and the same is true for computers because the current structure of Web does not support semantics. The existing solution to measuring Web credibility is either by using computers or humans. However, credibility judgment by users often considered impractical because they are: (i) time consuming, (ii) user require training or (iii) involve cost if experts do the assessment. There is also no unified model when evaluating using computers. This research looks into evaluation done by humans and computers, and identifies factors in order to use them as variables for measuring credibility. The paper highlights the significance of these factors and maps them into categories including accuracy, authority, aesthetics, professionalism, popularity, currency, impartiality and quality. The effectiveness of a hybrid is also discussed that can produce reliable results by integrating important variables from both human and computer judgments. The outcome of this study would significantly change the way users acquire and use information. The effectiveness (relevancy and trustworthiness of information) and efficiency (time taken to obtain the required credible information) will increase and decrease respectively.

[1]  Miriam J. Metzger,et al.  College student Web use, perceptions of information credibility, and verification behavior , 2003, Comput. Educ..

[2]  Ruth E. Duerr,et al.  Data Citation and Peer Review , 2010 .

[3]  Yair Neuman,et al.  Pupils' evaluation and generation of evidence and explanation in argumentation. , 2005, The British journal of educational psychology.

[4]  Susan Pancho-Festin,et al.  Rating the raters: a reputation system for wiki-like domains , 2010, SIN.

[5]  B. J. Fogg,et al.  What makes Web sites credible?: a report on a large quantitative study , 2001, CHI.

[6]  Jacquelyn A. Burkell,et al.  Believe it or not: Factors influencing credibility on the Web , 2002, J. Assoc. Inf. Sci. Technol..

[7]  Meredith Ringel Morris,et al.  Augmenting web pages and search results to support credibility assessment , 2011, CHI.

[8]  K.S. Freeman,et al.  Effect of Contact Information on the Credibility of Online Health Information , 2009, IEEE Transactions on Professional Communication.

[9]  David Robins,et al.  Aesthetics and credibility in web site design , 2008, Inf. Process. Manag..

[10]  Susan R. Goldman,et al.  Teaching Students to Evaluate Source Reliability during Internet Research Tasks , 2006, ICLS.

[11]  Miriam J. Metzger Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research , 2007 .

[12]  Karl Aberer,et al.  Web Credibility: Features Exploration and Credibility Prediction , 2013, ECIR.

[13]  Marc Meola,et al.  Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-Site Evaluation , 2004 .

[14]  Soo Young Rieh Judgement of information quality and cognitive authority in the Web , 2002 .

[15]  David Wright,et al.  Developing a privacy seal scheme (that works) , 2013 .

[16]  Mark A. Dochterman,et al.  Part 1: The Determination of Web Credibility: A Thematic Analysis of Web User's Judgments , 2010 .

[17]  Shenghui Su,et al.  Digital Copyright Protection Scheme Based on JUNA Lightweight Digital Signatures , 2012, 2012 Eighth International Conference on Computational Intelligence and Security.

[18]  Jim Hendler Broad Data: Exploring the Emerging Web of Data , 2013, Big Data.

[19]  R. L. Cromwell,et al.  Delving deeper into evaluation: exploring cognitive authority on the Internet , 2002 .

[20]  Miriam J. Metzger,et al.  Social and Heuristic Approaches to Credibility Evaluation Online , 2010 .

[21]  Thomas J. Johnson,et al.  A Shift in Media Credibility , 2009 .

[22]  Mary Stansbury,et al.  Consumer health information on the Web: The relationship of visual design and perceptions of credibility , 2010 .

[23]  Kristy L. Halverson,et al.  Non-Science Majors’ Critical Evaluation of Websites in a Biotechnology Course , 2010 .

[24]  J. Osborne,et al.  Establishing the norms of scientific argumentation in classrooms , 2000 .

[25]  Miriam J. Metzger,et al.  Perceptions of Internet Information Credibility , 2000 .

[26]  Barbara K. Kaye,et al.  Using Is Believing: The Influence of Reliance on the Credibility of Online Political Information among Politically Interested Internet Users , 2000 .

[27]  Katsumi Tanaka,et al.  Enhancing credibility judgment of web search results , 2011, CHI.

[28]  Zhe Zhao,et al.  Questions about questions: an empirical analysis of information needs on Twitter , 2013, WWW.

[29]  Miriam J. Metzger,et al.  Digital Media and Youth: Unparalleled Opportunity and Unprecedented Responsibility , 2008 .

[30]  Tatsunori Mori,et al.  A Method for Automatically Generating a Mediatory Summary to Verify Credibility of Information on the Web , 2010, COLING.

[31]  Miriam J. Metzger,et al.  Credibility for the 21st Century: Integrating Perspectives on Source, Message, and Media Credibility in the Contemporary Media Environment , 2003 .

[32]  Jon Herlocker,et al.  Collaborative Filtering for Digital Libraries , 2012 .

[33]  Robert L. Cromwell,et al.  Evaluating Internet resources: Identity, affiliation, and cognitive authority in a networked world , 2001, J. Assoc. Inf. Sci. Technol..

[34]  D. R. Danielson,et al.  How do users evaluate the credibility of Web sites?: a study with over 2,500 participants , 2003, DUX '03.

[35]  C. I. Hovland,et al.  The Influence of Source Credibility on Communication Effectiveness , 1951 .

[36]  William A. Sandoval,et al.  Elementary children's judgments of the epistemic status of sources of justification† , 2011 .