How Users’ Gaze Behavior Is Related to Their Quality Evaluation of a Health Website Based on HONcode Principles?

Abstract While the health website is an easily accessible source for patients to use when seeking health information, the quality of online health information has been a critical issue that concerns all stakeholders in healthcare. The aim of this research was to examine the relationship between users’ evaluation of the health website quality and their gaze behavior on the web pages. Eye tracking and a self-report questionnaire based on the HONcode principles were used to address the objective. We found that (1) the evaluations of authority, privacy, financial disclosure, and advertising policy are positively correlated with the fixation count and total fixation duration toward corresponding page components, while the evaluations of complementarity and attribution are negatively correlated with the fixation count and total fixation duration to corresponding page components; and (2) the fixation count and total fixation duration toward health information sources are negatively related to the evaluation of health website quality, while the fixation count and total fixation duration to site owner are positively related to the quality evaluation. Users’ attention to page components is closely related to the evaluation of principles, and also has a certain impact on the overall quality evaluation of a health website. Based on the findings, our research may serve to improve the health website design and be a foundation to develop an automatic evaluation approach of the health website quality.

[1]  E. Kuipers,et al.  Variable Quality and Readability of Patient‐oriented Websites on Colorectal Cancer Screening , 2017, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[2]  Ling Xia,et al.  Eye tracking and online search: Lessons learned and challenges ahead , 2008, J. Assoc. Inf. Sci. Technol..

[3]  Mia Liza A. Lustria,et al.  Can interactivity make a difference? Effects of interactivity on the comprehension of and attitudes toward online health content , 2007, J. Assoc. Inf. Sci. Technol..

[4]  Accuracy and Readability of Websites on Kidney and Bladder Cancers , 2018, Journal of Cancer Education.

[5]  T. Rea,et al.  Availability and Accuracy of EMS Information about Chronic Health and Medications in Cardiac Arrest , 2017, The western journal of emergency medicine.

[6]  P. Paudyal,et al.  Health information quality of websites on periodontology , 2017, Journal of clinical periodontology.

[7]  J C Wyatt,et al.  Commentary: measuring quality and impact of the world wide web , 1997, BMJ.

[8]  S. J. Sullivan,et al.  Concussion information online: evaluation of information quality, content and readability of concussion-related websites , 2011, British Journal of Sports Medicine.

[9]  Timothy Reilly,et al.  Completeness, accuracy, and readability of Wikipedia as a reference for patient medication information. , 2017, Journal of the American Pharmacists Association : JAPhA.

[10]  Jun Xiang,et al.  From online to offline: Exploring the role of e-health consumption, patient involvement, and patient-centered communication on perceptions of health care quality , 2017, Comput. Hum. Behav..

[11]  Michael B. Cohen,et al.  Readability of online patient education materials for parents after a failed newborn hearing screen. , 2019, International journal of pediatric otorhinolaryngology.

[12]  E. Fahy,et al.  Quality of patient health information on the Internet: reviewing a complex and evolving landscape. , 2014, The Australasian medical journal.

[13]  J. Powell,et al.  Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. , 2002, JAMA.

[14]  Yan Zhang,et al.  Quality of health information for consumers on the web: A systematic review of indicators, criteria, tools, and evaluation results , 2015, J. Assoc. Inf. Sci. Technol..

[15]  Mohan J. Dutta-Bergman.  The Impact of Completeness and Web Use Motivation on the Credibility of e‐Health Information , 2004 .

[16]  B. Bates,et al.  The effect of improved readability scores on consumers’ perceptions of the quality of health information on the internet , 2007, Journal of Cancer Education.

[17]  Elizabeth Sillence,et al.  The Effect of Credibility-Related Design Cues on Responses to a Web-Based Message About the Breast Cancer Risks From Alcohol: Randomized Controlled Trial , 2009, Journal of medical Internet research.

[18]  J. Huebner,et al.  Online Information on Complementary and Alternative Medicine for Cancer Patients: Evidence-Based Recommendations , 2013, Oncology Research and Treatment.

[19]  Y. Suzuki,et al.  A new marketing methodology by integrating brain measurement, eye tracking, and questionnaire analysis , 2012, ICSSSM12.

[20]  M. Härter,et al.  Quality of online information on type 2 diabetes: a cross-sectional study. , 2015, Health promotion international.

[21]  Arch G. Mainous,et al.  The accuracy of nutrition information on the Internet for type 2 diabetes. , 2010, Archives of internal medicine.

[22]  J. Stinson,et al.  Perspectives on quality and content of information on the internet for adolescents with cancer , 2011, Pediatric blood & cancer.

[23]  C Boyer,et al.  The Health On the Net Code of Conduct for medical and health Websites , 1998, Comput. Biol. Medicine.

[24]  J. Mocco,et al.  Neurosurgery Residency Websites: A Critical Evaluation. , 2015, World neurosurgery.

[25]  Saeideh Valizadeh-Haghi,et al.  Evaluating the trustworthiness of consumer-oriented health websites on diabetes , 2018 .

[26]  Tariq M. Alhawassi,et al.  Measuring the quality and completeness of medication-related information derived from hospital electronic health records database , 2019, Saudi pharmaceutical journal : SPJ : the official publication of the Saudi Pharmaceutical Society.

[27]  M. Rodrigo,et al.  Assessing the ethical and content quality of online parenting resources , 2018 .

[28]  Elton Antunes,et al.  La violencia contra mujeres brasileñas en las esferas pública y mediática , 2018 .

[29]  Bill Kules,et al.  Older adults searching for health information in MedlinePlus - an exploratory study of faceted online search interfaces , 2011, ASIST.

[30]  G D Lundberg,et al.  Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware. , 1997, JAMA.

[31]  [How does our specialty present itself on the Internet?]. , 2013, Zeitschrift fur Orthopadie und Unfallchirurgie.

[32]  Noel Jabbour,et al.  Quality and readability of websites for patient information on tonsillectomy and sleep apnea. , 2017, International journal of pediatric otorhinolaryngology.

[33]  Hyojin Kim.  Pharmaceutical Companies as a Source of Health Information: A Pilot Study of the Effects of Source, Web Site Interactivity, and Involvement , 2011, Health marketing quarterly.

[34]  Stefano Federici,et al.  Gaze and eye-tracking solutions for psychological research , 2012, Cognitive Processing.

[35]  Lior Flum,et al.  Quality of online health information about oral contraceptives from Hebrew-language websites , 2012, Israel Journal of Health Policy Research.

[36]  M. Preisig,et al.  Quality of Web-based information on obsessive compulsive disorder , 2013, Neuropsychiatric disease and treatment.

[37]  J G Williams,et al.  Measuring the Completeness and Currency of Codified Clinical Information , 2003, Methods of Information in Medicine.

[38]  Katherine K. Scott,et al.  Content, Accessibility, and Dissemination of Disaster Information via Social Media During the 2016 Louisiana Floods , 2017, Journal of public health management and practice : JPHMP.

[39]  M. Rodrigo,et al.  Evaluación de la calidad ética y del contenido de los recursos online para padres , 2018 .

[40]  A quantitative readability analysis of patient education resources from gastroenterology society websites , 2017, International Journal of Colorectal Disease.

[41]  I. Al-Zakwani,et al.  Primary Health Care Consumers' Acceptance, Trust and Gender Preferences towards Omani Doctors. , 2007, Oman medical journal.

[42]  Mun Y. Yi,et al.  Untangling the antecedents of initial trust in Web-based health information: The roles of argument quality, source expertise, and user perceptions of information quality and risk , 2013, Decis. Support Syst..

[43]  Content, quality, and readability of website information on dental care for patients with cancer. , 2014, Oral surgery, oral medicine, oral pathology and oral radiology.

[44]  Wonchan Choi,et al.  What makes online health information credible for older adults?: an exploratory study , 2013, CHI Extended Abstracts.

[45]  Kursat Cagiltay,et al.  Finding online health-related information: usability issues of health portals. , 2012, Studies in health technology and informatics.

[46]  Morten Moshagen,et al.  A blessing, not a curse: Experimental evidence for beneficial effects of visual aesthetics on performance , 2009, Ergonomics.

[47]  Rebecca Schnall,et al.  Eye-tracking retrospective think-aloud as a novel approach for a usability evaluation , 2019, Int. J. Medical Informatics.

[48]  Lisa Palmisano,et al.  Analysis of the accuracy and readability of herbal supplement information on Wikipedia. , 2014, Journal of the American Pharmacists Association : JAPhA.

[49]  Ridi Ferdiana,et al.  A Novel User Experience Study of Parallax Scrolling using Eye Tracking and User Experience Questionnaire , 2018, International Journal on Advanced Science, Engineering and Information Technology.

[50]  Chung-Hung Tsai,et al.  The E-Commerce Model of Health Websites: An Integration of Web Quality, Perceived Interactivity, and Web Outcomes , 2011, J. Networks.

[51]  Anushia Inthiran,et al.  How Do Older Adults View Online Health Webpages? Preliminary Results from Eye Tracking Data , 2018, HCI.

[52]  K.S. Freeman,et al.  Effect of Contact Information on the Credibility of Online Health Information , 2009, IEEE Transactions on Professional Communication.

[53]  Renke Maas,et al.  Accuracy and Completeness of Drug Information in Wikipedia: A Comparison with Standard Textbooks of Pharmacology , 2014, PloS one.

[54]  Debra L Roter,et al.  Survey of quality, readability, and social reach of websites on osteosarcoma in adolescents. , 2013, Patient education and counseling.

[55]  Alison Oberne,et al.  Quality and accuracy of sexual health information web sites visited by young people. , 2010, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[56]  Wai-Tat Fu,et al.  Age differences in credibility judgments of online health information , 2014, ACM Trans. Comput. Hum. Interact..

[57]  Tao Ma,et al.  User generated content and credibility evaluation of online health information: A meta analytic study , 2017, Telematics Informatics.

[58]  Enrique Herrera-Viedma,et al.  A quality evaluation methodology for health-related websites based on a 2-tuple fuzzy linguistic approach , 2010, Soft Comput..

[59]  R. Evans,et al.  What Is Health Information Quality? Ethical Dimension and Perception by Users , 2018, Front. Med..

[60]  F. Dikkers,et al.  Quality and readability assessment of websites related to recurrent respiratory papillomatosis , 2017, The Laryngoscope.

[61]  Gunnar Hartvigsen,et al.  Assessing the Potential Use of Eye-Tracking Triangulation for Evaluating the Usability of an Online Diabetes Exercise System , 2015, MedInfo.

[62]  M. Murad,et al.  Can Patients Trust Online Health Information? A Meta-narrative Systematic Review Addressing the Quality of Health Information on the Internet , 2019, Journal of General Internal Medicine.

[63]  Ye Tian,et al.  Exploring factors influencing Chinese user's perceived credibility of health and safety information on Weibo , 2015, Comput. Hum. Behav..

[64]  Inocencio Maramba,et al.  Methods of usability testing in the development of eHealth applications: A scoping review , 2019, Int. J. Medical Informatics.

[65]  Elizabeth Johnson Avery,et al.  The role of source and the factors audiences rely on in evaluating credibility of health information , 2010 .

[66]  Yung-Sheng Chang,et al.  The Moderator Effect of Working Memory and Emotion on the Relationship between Information Overload and Online Health Information Quality Judgment , 2018, CHIIR.

[67]  L. Hefler,et al.  Quality of websites of obstetrics and gynecology departments: a cross-sectional study , 2015, BMC Pregnancy & Childbirth.