Do quality markers for health websites affect the perception of vaccination webpages?

As people's health, and in some cases even their lives are at stake, the quality of health information on the web becomes a prime public health concern. Attempts at measuring or certifying quality usually use a set of quality markers, but their individual contribution to overall quality, and further to user perception and attitudes, is largely unknown. This study aims at assessing this contribution, using the topic of vaccination. It combines data from three sources, a survey participants filled in after completing an information search task, records of the webpages visited during that task, and a content analysis of these webpages determining the presence or absence of quality markers and the pages' tone towards vaccination. Results show that the tone of the webpages participants rated and were exposed to, is highly correlated with their attitude towards vaccination. Markers shown to be associated with high quality were also correlated with attitude, in particular when they were related to the quality of information content (such as medical ownership, specific accreditations of health content and reporting benefits of treatment/vaccination) rather than esthetic/visual and design markers. The results suggest that the approach to measuring the quality of health websites using such markers is both necessary and promising. Not all quality markers are associated with positive tone towards vaccination.Tone of webpages rated by users correlates with their attitude toward vaccination.Content-related quality markers are considered more than visual and design markers.A small set of markers reduces the time for health websites quality evaluation.

[1]  Alla Keselman,et al.  Exploring User Navigation during Online Health Information Seeking , 2006, AMIA.

[2]  R. Schiavo,et al.  The Rise of E-Health: Current Trends and Topics on Online Health Communications: , 2008 .

[3]  C. Dube,et al.  Untangling the Web--the impact of Internet use on health care and the physician-patient relationship. , 2007, Patient education and counseling.

[4]  D Charnock,et al.  DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. , 1999, Journal of epidemiology and community health.

[5]  R. Moran,et al.  Internet use and seeking health information online in Ireland: demographic characteristics and mental health characteristics of users and non-users. , 2008 .

[6]  J. V. van Weert,et al.  Low Health Literacy and Evaluation of Online Health Information: A Systematic Review of the Literature , 2015, Journal of Medical Internet Research.

[7]  Binshan Lin,et al.  The mediating effect of website quality on Internet searching behavior , 2012, Comput. Hum. Behav..

[8]  Gary L. Kreps,et al.  New directions in eHealth communication: opportunities and challenges. , 2010, Patient education and counseling.

[9]  P. Schulz,et al.  Arguments and sources on Italian online forums on childhood vaccinations: Results of a content analysis. , 2015, Vaccine.

[10]  E. Doran,et al.  A Prompt to the Web: The Media and Health Information Seeking Behaviour , 2012, PloS one.

[11]  W. Gaissmaier,et al.  Opportunities and challenges of Web 2.0 for vaccination decisions. , 2012, Vaccine.

[12]  Stephen A. Rains,et al.  Health information-seeking and perceptions of website credibility: Examining Web-use orientation, message characteristics, and structural features of websites , 2009, Comput. Hum. Behav..

[13]  Elmer V. Bernstam,et al.  Instruments to assess the quality of health information on the World Wide Web: what can our patients actually use? , 2005, Int. J. Medical Informatics.

[14]  Yan Zhang,et al.  Quality of health information for consumers on the web: A systematic review of indicators, criteria, tools, and evaluation results , 2015, J. Assoc. Inf. Sci. Technol..

[15]  Victor R. Prybutok,et al.  The moderating effect of gender on academic website impression , 2014, Comput. Hum. Behav..

[16]  Ahmed Allam,et al.  Manipulating Google’s Knowledge Graph Box to Counter Biased Information Processing During an Online Search on Vaccination: Application of a Technological Debiasing Strategy , 2016, Journal of medical Internet research.

[17]  C. Chronaki,et al.  eHealth Trends in Europe 2005-2007: A Population-Based Survey , 2008, Journal of medical Internet research.

[18]  S. Wangberg,et al.  Relations between Internet use, socio-economic status (SES), social support and subjective health. , 2008, Health promotion international.

[19]  G Eysenbach,et al.  Information in practice Towards quality management of medical information on the internet : evaluation , labelling , and filtering of information , 1998 .

[20]  Margaret M. Barry,et al.  A literature review on health information-seeking behaviour on the web: a health consumer and health , 2011 .

[21]  G. Eysenbach.  Credibility of Health Information and Digital Media: New Perspectives and Implications for Youth , 2007 .

[22]  Jean M. Roberts,et al.  Clinical websites are currently dangerous to health , 2001, Int. J. Medical Informatics.

[23]  S. A. Iverson,et al.  Impact of Internet Use on Health-Related Behaviors and the Patient-Physician Relationship: A Survey-Based Study and Review , 2008, The Journal of the American Osteopathic Association.

[24]  T. Volsko,et al.  Readability assessment of internet-based consumer health information. , 2008, Respiratory care.

[25]  R. Moser,et al.  Surveys of physicians and electronic health information. , 2010, The New England journal of medicine.

[26]  Daniel P. Lorence,et al.  Assessing Health Consumerism on the Web: A Demographic Profile of Information-Seeking Behaviors , 2006, Journal of Medical Systems.

[27]  Ron D. Appel,et al.  The Health On the Net Code of Conduct for medical and health Web sites , 1998, MedInfo.

[28]  Javier Sanz-Valero,et al.  Evaluating the quality of websites relating to diet and eating disorders. , 2011, Health information and libraries journal.

[29]  Besiki Stvilia,et al.  Disorderly reasoning in information design , 2009 .

[30]  V. Podichetty,et al.  Assessment of internet use and effects among healthcare professionals: a cross sectional survey , 2006, Postgraduate Medical Journal.

[31]  Robert A. Greenes,et al.  Positive attitudes and failed queries: an exploration of the conundrums of consumer health information retrieval , 2004, Int. J. Medical Informatics.

[32]  Daniel P. Lorence,et al.  Assessing Domains of Uncertainty in Critical Web-Based Healthcare Communities , 2005, Journal of Medical Systems.

[33]  Manish Latthe,et al.  Accuracy of information on apparently credible websites: survey of five common health topics , 2002, BMJ : British Medical Journal.

[34]  Michele L. Ybarra,et al.  Reasons, assessments and actions taken: sex and age differences in uses of Internet health information. , 2008, Health education research.

[35]  C. Hughes,et al.  Evaluation of HIV Drug Interaction Web Sites , 2003, The Annals of pharmacotherapy.

[36]  Sandra L Saperstein,et al.  Using the Internet for Health-Related Activities: Findings From a National Probability Sample , 2009, Journal of medical Internet research.

[37]  Alejandro R Jadad,et al.  Examination of instruments used to rate quality of health information on the internet: chronicle of a voyage with an unclear destination , 2002, BMJ : British Medical Journal.

[38]  P. Schulz,et al.  Comparing the quality of pro- and anti-vaccination online information: a content analysis of vaccination-related webpages , 2015, BMC Public Health.

[39]  J. Powell,et al.  Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. , 2002, JAMA.

[40]  Peter Johannes Schulz,et al.  The Impact of Search Engine Selection and Sorting Criteria on Vaccination Beliefs and Attitudes: Two Experiments Manipulating Google Output , 2014, Journal of medical Internet research.

[41]  M StrongDiane,et al.  Information quality benchmarks , 2002 .

[42]  Gary L. Kreps,et al.  Trust and sources of health information: the impact of the Internet and its implications for health care providers: findings from the first Health Information National Trends Survey. , 2005, Archives of internal medicine.

[43]  P. Korp,et al.  Health on the Internet: implications for health promotion. , 2006, Health education research.

[44]  Diane M. Strong,et al.  Information quality benchmarks: product and service performance , 2002, CACM.

[45]  Alla Keselman,et al.  Research Paper: Consumer Health Information Seeking as Hypothesis Testing , 2008, J. Am. Medical Informatics Assoc..

[46]  Jeremy C Wyatt,et al.  Survey of Doctors' Experience of Patients Using the Internet , 2002, Journal of medical Internet research.

[47]  John Willinsky,et al.  Public Access and Use of Health Research: An Exploratory Study of the National Institutes of Health (NIH) Public Access Policy Using Interviews and Surveys of Health Personnel , 2011, Journal of medical Internet research.

[48]  S. Ziebland,et al.  How the internet affects patients' experience of cancer: a qualitative study , 2004, BMJ : British Medical Journal.

[49]  Alexandre N. Tuch,et al.  Trust and distrust on the web: User experiences and website characteristics , 2015, Comput. Hum. Behav..

[50]  Philip B. Mitchell,et al.  Review of the Quality of Information on Bipolar Disorder on the Internet , 2009 .

[51]  Christian Köhler,et al.  How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews , 2002, BMJ : British Medical Journal.

[52]  Paul Kim,et al.  Published criteria for evaluating health related web sites: review , 1999, BMJ.

[53]  R. M. Wolfe,et al.  Vaccine Criticism on the World Wide Web , 2005, Journal of medical Internet research.

[54]  Valerie Njie,et al.  Internet Usage by Low-Literacy Adults Seeking Health Information: An Observational Analysis , 2004, Journal of medical Internet research.

[55]  Mary Frances Theofanos,et al.  Searching for Cancer Information on the Internet: Analyzing Natural Language Search Queries , 2003, Journal of medical Internet research.

[56]  Elizabeth Murray,et al.  The Impact of Health Information on the Internet on Health Care and the Physician-Patient Relationship: National U.S. Survey among 1.050 U.S. Physicians , 2003, Journal of medical Internet research.

[57]  Evaluation of web sites for quality and contents of Asthma patient education , 2009 .

[58]  Funda Meric-Bernstam,et al.  Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer , 2008, Cancer.

[59]  R. J. Cline,et al.  Consumer health information seeking on the Internet: the state of the art. , 2001, Health education research.

[60]  C. Chronaki,et al.  European citizens' use of E-health services: A study of seven countries , 2007, BMC public health.

[61]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[62]  Peter R. Harris,et al.  How do patients evaluate and make use of online health information? , 2007, Social science & medicine.