Web credibility assessment: affecting factors and assessment techniques

Introduction. In the current era of digital communication, users share information they consider important, using wikis, blogs and social networking Websites. The digital content includes valuable as well as biased, false and demagogic information. The objectives of this review paper are, i) To understand the perceptions of users regarding Web credibility judgment and the problems faced by them, ii) To review and list the factors used in various Web credibility judgment techniques, iii) To suggest a hybrid model that takes advantage of different credibility judgment techniques. Method. This paper adopted a systematic review methodology based on the guidelines of Kitchenham. Analysis. Over 100 papers were reviewed to compile the list of factors covered in the approaches. These analyses were summarized in the form of tables featuring the methods, types and categories of approaches as well as the factors covered. Results. Our findings show that by adopting more than one approach when assessing the credibility of a Web, measuring credibility assessment becomes easier. Therefore, a hybrid approach is presented for the conduct of credibility assessment using the different approaches available to measure accuracy, authority, aesthetics, professionalism, popularity, currency, impartiality and quality. Conclusions. This paper hopes to contribute to the body of knowledge related to the identification of the factors (and categories they belong to) affecting Web credibility judgment and highlights the importance of a hybrid model for making accurate and effective Web credibility judgments.

[1]  R. L. Cromwell,et al.  Delving deeper into evaluation: exploring cognitive authority on the Internet , 2002 .

[2]  Colin Potts,et al.  Privacy policies as decision-making tools: an evaluation of online privacy notices , 2004, CHI.

[3]  Reijo Savolainen,et al.  Judging the quality and credibility of information in Internet discussion forums , 2011, J. Assoc. Inf. Sci. Technol..

[4]  Miriam J. Metzger,et al.  Social and Heuristic Approaches to Credibility Evaluation Online , 2010 .

[5]  N. Asokan,et al.  Optimistic fair exchange of digital signatures , 1998, IEEE Journal on Selected Areas in Communications.

[6]  Dimitris Kanellopoulos,et al.  Semantic Web: A state of the art survey , 2007 .

[7]  Thomas J. Johnson,et al.  A Shift in Media Credibility , 2009 .

[8]  Christian D. Schunn,et al.  Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system , 2007, Comput. Educ..

[9]  William A. Sandoval,et al.  Elementary children's judgments of the epistemic status of sources of justification† , 2011 .

[10]  Christian Köhler,et al.  How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews , 2002, BMJ : British Medical Journal.

[11]  Deepa Kundur,et al.  Dual domain watermarking for authentication and compression of cultural heritage images , 2004, IEEE Transactions on Image Processing.

[12]  Miriam J. Metzger,et al.  Perceptions of Internet Information Credibility , 2000 .

[13]  Jeffrey Bisanz,et al.  Assessing literacy in science: evaluation of scientific news briefs , 1997 .

[14]  Edward F. Gehringer,et al.  Strategies and mechanisms for electronic peer review , 2000, 30th Annual Frontiers in Education Conference. Building on A Century of Progress in Engineering Education. Conference Proceedings (IEEE Cat. No.00CH37135).

[15]  Ravit Golan Duncan,et al.  Learning to evaluate scientific models , 2008, ICLS.

[16]  Luca de Alfaro,et al.  A content-driven reputation system for the wikipedia , 2007, WWW '07.

[17]  Stein Dankert Kolstø,et al.  'To trust or not to trust,…'-pupils' ways of judging information encountered in a socio-scientific issue , 2001 .

[18]  Wang-Ying Lin,et al.  Content Analysis of the World Wide Web , 2000 .

[19]  D. Scott Brandt Evaluating information on the Internet , 1996 .

[20]  Mark A. Dochterman,et al.  Part 1: The Determination of Web Credibility: A Thematic Analysis of Web User's Judgments , 2010 .

[21]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[22]  Wendy Hall,et al.  HETWIN: Helping Evaluate the Trustworthiness of Web Information for Web Users Framework using SemanticWeb Technologies , 2012, I-SEMANTICS.

[23]  Asad Ali Shah Sri Devi Ravana Evaluating Information Credibility of Digital Content using Hybrid Approach , 2014 .

[24]  耿光刚 Statistical Cross-Language Web Content Quality Assessment , 2012 .

[25]  Niels Pinkwart,et al.  Using Collaborative Filtering Algorithms as eLearning Tools , 2009 .

[26]  D. Treise,et al.  Cultivating the Science Internet Audience , 2003 .

[27]  Barbara Poblete,et al.  Information credibility on twitter , 2011, WWW.

[28]  Anita Komlodi,et al.  Different People Different Styles: Impact of Personality Style in Web Sites Credibility Judgement , 2011, HCI.

[29]  Miriam J. Metzger,et al.  The perceived credibility of personal Web page information as influenced by the sex of the source , 2003, Comput. Hum. Behav..

[30]  Trina C. Kershaw,et al.  Undergraduate cognitive psychology students' evaluations of scientific arguments in a contrasting-essays assignment , 2008, ICLS.

[31]  International Foundation for Autonomous Agents and MultiAgent Systems ( IFAAMAS ) , 2007 .

[32]  Eleni A. Kyza,et al.  A Framework for Scaffolding Students' Assessment of the Credibility of Evidence , 2011 .

[33]  J. Giles Internet encyclopaedias go head to head , 2005, Nature.

[34]  K.S. Freeman,et al.  Effect of Contact Information on the Credibility of Online Health Information , 2009, IEEE Transactions on Professional Communication.

[35]  Mary Stansbury,et al.  Consumer health information on the Web: The relationship of visual design and perceptions of credibility , 2010 .

[36]  Karl Aberer,et al.  Web Credibility: Features Exploration and Credibility Prediction , 2013, ECIR.

[37]  Karl Aberer,et al.  A decentralized recommender system for effective web credibility assessment , 2012, CIKM '12.

[38]  Robert L. Cromwell,et al.  Evaluating Internet resources: Identity, affiliation, and cognitive authority in a networked world , 2001, J. Assoc. Inf. Sci. Technol..

[39]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[40]  Jean Anne Hattler Technology for Preservice Teachers: "Driver Education" for the Information Superhighway , 1997 .

[41]  J. Amsbary,et al.  Factors Influencing Evaluations of Web Site Information , 2003, Psychological reports.

[42]  Lei Cui,et al.  A Trust Model Award Content Security and Rating Supervision Model , 2013 .

[43]  Kristina Höök,et al.  Social navigation: techniques for building more usable systems , 2000, INTR.

[44]  Soo Young Rieh,et al.  Credibility: A multidisciplinary framework , 2007, Annu. Rev. Inf. Sci. Technol..

[45]  Kristy L. Halverson,et al.  Non-Science Majors’ Critical Evaluation of Websites in a Biotechnology Course , 2010 .

[46]  Soo Young Rieh Judgement of information quality and cognitive authority in the Web , 2002 .

[47]  D. R. Danielson,et al.  How do users evaluate the credibility of Web sites?: a study with over 2,500 participants , 2003, DUX '03.

[48]  Katsumi Tanaka,et al.  Enhancing credibility judgment of web search results , 2011, CHI.

[49]  Christian D. Schunn,et al.  Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives , 2006 .

[50]  Alastair G. Smith,et al.  Testing the Surf: Criteria for Evaluating Internet Information Resources , 1997 .

[51]  Yair Neuman,et al.  Pupils' evaluation and generation of evidence and explanation in argumentation. , 2005, The British journal of educational psychology.

[52]  Soo Young Rieh Judgment of information quality and cognitive authority in the Web , 2002, J. Assoc. Inf. Sci. Technol..

[53]  Paul Resnick,et al.  PICS: Internet access controls without censorship , 1996, CACM.

[54]  Bradley N. Miller,et al.  Social Information Filtering : Algorithms for Automating “ Word of Mouth , ” , 2017 .

[55]  Sarah K. Brem,et al.  Science on the Web: Student Evaluations of Scientific Arguments , 2001 .

[56]  Meredith Ringel Morris,et al.  Augmenting web pages and search results to support credibility assessment , 2011, CHI.

[57]  Nora Miller Wikipedia and the Disappearing "Author" , 2005 .

[58]  Miriam J. Metzger,et al.  Digital Media and Youth: Unparalleled Opportunity and Unprecedented Responsibility , 2008 .

[59]  Marc Meola,et al.  Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-Site Evaluation , 2004 .

[60]  Christopher Holden,et al.  Sick at South Shore Beach: a place-based augmented reality game as a framework for building evidence-based arguments , 2008, ICLS.

[61]  David Robins,et al.  Aesthetics and credibility in web site design , 2008, Inf. Process. Manag..

[62]  David H. Jonassen,et al.  Handbook of Research on Educational Communications and Technology : A Project of the Association for Educational Communications and Technology , 1996 .

[63]  David Wright,et al.  Developing a privacy seal scheme (that works) , 2013 .

[64]  Xiaomei Zhuang,et al.  A watermarking scheme based on digital images' signatures , 2011, 2011 International Conference on Multimedia Technology.

[65]  Ruth E. Duerr,et al.  Data Citation and Peer Review , 2010 .

[66]  Miriam J. Metzger,et al.  Credibility and trust of information in online environments: The use of cognitive heuristics , 2013 .

[67]  Miriam J. Metzger,et al.  behaviors on the perceived credibility of web-based information The role of site features, user attributes, and information verification , 2007 .

[68]  B. J. Fogg,et al.  What makes Web sites credible?: a report on a large quantitative study , 2001, CHI.

[69]  Jacquelyn A. Burkell,et al.  Believe it or not: Factors influencing credibility on the Web , 2002, J. Assoc. Inf. Sci. Technol..

[70]  Susan R. Goldman,et al.  Teaching Students to Evaluate Source Reliability during Internet Research Tasks , 2006, ICLS.

[71]  Satoshi Nakamura,et al.  Trustworthiness Analysis of Web Search Results , 2007, ECDL.

[72]  Adam Wierzbicki,et al.  Defending imitating attacks in web credibility evaluation systems , 2013, WWW '13 Companion.

[73]  Barbara K. Kaye,et al.  Using Is Believing: The Influence of Reliance on the Credibility of Online Political Information among Politically Interested Internet Users , 2000 .

[74]  B. J. Fogg,et al.  The elements of computer credibility , 1999, CHI '99.

[75]  P. Kalbfleisch Credibility for the 21st Century: Integrating Perspectives on Source, Message, and Media Credibility in the Contemporary Media Environment , 2003 .

[76]  Scott Counts,et al.  Tweeting is believing?: understanding microblog credibility perceptions , 2012, CSCW.

[77]  Miriam J. Metzger,et al.  College student Web use, perceptions of information credibility, and verification behavior , 2003, Comput. Educ..

[78]  Mark Baildon,et al.  How Do We Know?: Students Examine Issues of Credibility With a Complicated Multimodal Web-Based Text , 2009 .

[79]  William A. Sandoval,et al.  The Quality of Students' Use of Evidence in Written Scientific Explanations , 2005 .

[80]  Satoshi Nakamura,et al.  Improving Search and Information Credibility Analysis from Interaction between Web1.0 and Web2.0 Content , 2010, J. Softw..

[81]  Paola Benassi,et al.  TRUSTe: an online privacy seal program , 1999, CACM.

[82]  Athman Bouguettaya,et al.  RATEWeb: Reputation Assessment for Trust Establishment among Web services , 2009, The VLDB Journal.

[83]  W. Ford,et al.  Secure Electronic Commerce: Building the Infrastructure for Digital Signatures and Encryption , 2000 .

[84]  Susan Pancho-Festin,et al.  Rating the raters: a reputation system for wiki-like domains , 2010, SIN.

[85]  Hsin-Kai Wu,et al.  Developing Sixth Graders’ Inquiry Skills to Construct Explanations in Inquiry‐based Learning Environments , 2006 .

[86]  Tatsunori Mori,et al.  A Method for Automatically Generating a Mediatory Summary to Verify Credibility of Information on the Web , 2010, COLING.

[87]  Katherine Del Giudice Crowdsourcing credibility: The impact of audience feedback on Web page credibility , 2010, ASIST.

[88]  Miriam J. Metzger Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research , 2007, J. Assoc. Inf. Sci. Technol..

[89]  Vicki Todd,et al.  Using Graded Peer Evaluation to Improve Students' Writing Skills, Critical Thinking Ability, and Comprehension of Material in a Principles of Public Relations Course. , 2011 .

[90]  Chunyan Miao,et al.  A fuzzy logic based reputation model against unfair ratings , 2013, AAMAS.

[91]  Dean Allemang,et al.  Semantic Web for the Working Ontologist - Effective Modeling in RDFS and OWL, Second Edition , 2011 .

[92]  Marsha Ann Tate,et al.  Web Wisdom: How to Evaluate and Create Web Page Quality , 1999 .

[93]  Grady Venville,et al.  High‐school Students’ Informal Reasoning and Argumentation about Biotechnology: An indicator of scientific literacy? , 2009 .

[94]  Brian J. Reiser,et al.  Scaffolding Complex Learning: The Mechanisms of Structuring and Problematizing Student Work , 2004, The Journal of the Learning Sciences.

[95]  Peter R. Harris,et al.  How do patients evaluate and make use of online health information? , 2007, Social science & medicine.

[96]  Mihály Héder,et al.  Semantic Web for the Working Ontologist, Second dition: Effective modeling in RDFS and OWL by Allemang Dean and Hendler James, Morgan Kaufmann, 384 pp., $55, ISBN 0-123-85965-4 , 2013, The Knowledge Engineering Review.

[97]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[98]  Deepa Kundur,et al.  Digital watermarking for telltale tamper proofing and authentication , 1999, Proc. IEEE.

[99]  Shenghui Su,et al.  Digital Copyright Protection Scheme Based on JUNA Lightweight Digital Signatures , 2012, 2012 Eighth International Conference on Computational Intelligence and Security.

[100]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[101]  B. J. Fogg,et al.  Prominence-interpretation theory: explaining how people assess credibility online , 2003, CHI Extended Abstracts.

[102]  Edward F. Gehringer,et al.  Electronic peer review and peer grading in computer-science courses , 2001, SIGCSE '01.

[103]  Susan M. Land,et al.  Scaffolding Preservice Science Teachers' Evidence-Based Arguments During an Investigation of Natural Selection , 2002 .