How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews

Abstract Objectives: To describe techniques for retrieval and appraisal used by consumers when they search for health information on the internet. Design: Qualitative study using focus groups, naturalistic observation of consumers searching the world wide web in a usability laboratory, and in-depth interviews. Participants: A total of 21 users of the internet participated in three focus group sessions. 17 participants were given a series of health questions and observed in a usability laboratory setting while retrieving health information from the web; this was followed by in-depth interviews. Setting: Heidelberg, Germany. Results: Although their search technique was often suboptimal, internet users successfully found health information to answer questions in an average of 5 minutes 42 seconds (median 4 minutes 18 seconds) per question. Participants in focus groups said that when assessing the credibility of a website they primarily looked for the source, a professional design, a scientific or official touch, language, and ease of use. However, in the observational study, no participants checked any “about us” sections of websites, disclaimers, or disclosure statements. In the post-search interviews, it emerged that very few participants had noticed and remembered which websites they had retrieved information from. Conclusions: Further observational studies are needed to design and evaluate educational and technological innovations for guiding consumers to high quality health information on the web. What is already known on this topic Little is known about how consumers retrieve and assess the quality of health information on the internet Qualitative data are needed to design educational and technological innovations to guide consumers to high quality health information What this study adds Users of the internet explore only the first few links on general search engines when seeking health information Consumers say that when assessing the credibility of a site they primarily look for the source, a professional design, and a variety of other criteria In practice, internet users do not check the “about us” sections of websites, try to find out who authors or owners of the site are, or read disclaimers or disclosure statements Very few internet users later remember from which websites they retrieved information or who stood behind the sites

[1]  R Roberts,et al.  Verifying quality and safety in health informatics services , 2001, BMJ : British Medical Journal.

[2]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[3]  William R. Hersh,et al.  Filtering Web pages for quality indicators: an empirical approach to finding high quality consumer health information on the World Wide Web , 1999, AMIA.

[4]  R. Kravitz,et al.  Health information on the Internet: accessibility, quality, and readability in English and Spanish. , 2001, JAMA.

[5]  A R Jadad,et al.  Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. , 1995, Controlled clinical trials.

[6]  Pamela Jordan Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[7]  G D Lundberg,et al.  Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware. , 1997, JAMA.

[8]  Lee Rainie,et al.  The online health care revolution: how the web helps americans take better care of themselves , 2000 .

[9]  Gunther Eysenbach,et al.  Consumer health informatics , 2000, BMJ : British Medical Journal.

[10]  V P Abbott,et al.  Web page quality: can we measure it and what do we find? A report of exploratory findings. , 2000, Journal of public health medicine.

[11]  M. Dorgan,et al.  Surfing the Net--information on the World Wide Web for persons with arthritis: patient empowerment or patient deceit? , 2001, The Journal of rheumatology.

[12]  S. Singletary,et al.  Breast cancer on the world wide web: cross sectional survey of quality of information and popularity of websites , 2002, BMJ : British Medical Journal.

[13]  C Boyer,et al.  The Health On the Net Code of Conduct for medical and health Websites , 1998, Comput. Biol. Medicine.

[14]  J. Feightner,et al.  Qualitative study of consumers' perspectives , 2001 .

[15]  J. Kitzinger,et al.  Qualitative Research: Introducing focus groups , 1995 .

[16]  H. Christensen,et al.  Quality of web based information on treatment of depression: cross sectional survey , 2000, BMJ : British Medical Journal.

[17]  P. Huynh,et al.  Evaluation of the quality of self-education mammography material available for patients on the Internet. , 2000, Academic radiology.

[18]  Emma Irvin,et al.  Surfing for Back Pain Patients: The Nature and Quality of Back Pain Information on the Internet , 2001, Spine.

[19]  P. Impicciatore,et al.  Reliability of health information for the public on the world wide web: systematic survey of advice on managing fever in children at home , 1997, BMJ.

[20]  J W Feightner,et al.  Preventive health information on the Internet. Qualitative study of consumers' perspectives. , 2001, Canadian family physician Medecin de famille canadien.

[21]  J. Pennbridge,et al.  Questionnaire survey of California consumers' use and rating of sources of health care information including the Internet. , 1999, The Western journal of medicine.

[22]  Jonathan Marshall,et al.  The impact of displayed awards on the credibility and retention of Web site information , 2000, AMIA.

[23]  G Eysenbach,et al.  Labeling and Filtering of Medical Information on the Internet , 1999, Methods of Information in Medicine.

[24]  G Eysenbach,et al.  Information in practice Towards quality management of medical information on the internet : evaluation , labelling , and filtering of information , 1998 .