Web Usage Data as a Means of Evaluating Public Health Messaging and Outreach

Background The Internet is increasingly utilized by researchers, health care providers, and the public to seek medical information. The Internet also provides a powerful tool for public health messaging. Understanding the needs of the intended audience and how they use websites is critical for website developers to provide better services to the intended users. Objective The aim of the study was to examine the utilization of the chronic fatigue syndrome (CFS) website at the Centers for Disease Control and Prevention (CDC). We evaluated (1) CFS website utilization, (2) outcomes of a CDC CFS public awareness campaign, and (3) user behavior related to public awareness campaign materials and CFS continuing medical education courses. Methods To describe and evaluate Web utilization, we collected Web usage data over an 18-month period and extracted page views, visits, referring domains, and geographic locations. We used page views as the primary measure for the CFS awareness outreach effort. We utilized market basket analysis and Markov chain model techniques to describe user behavior related to utilization of campaign materials and continuing medical education courses. Results The CDC CFS website received 3,647,736 views from more than 50 countries over the 18-month period and was the 33rd most popular CDC website. States with formal CFS programs had higher visiting density, such as Washington, DC; Georgia; and New Jersey. Most visits (71%) were from Web search engines, with 16% from non-search-engine sites and 12% from visitors who had bookmarked the site. The public awareness campaign was associated with a sharp increase and subsequent quick drop in Web traffic. Following the campaign, user interest shifted from information targeting consumer basic knowledge to information for health care professionals. The market basket analysis showed that visitors preferred the 60-second radio clip public service announcement over the 30-second one. Markov chain model results revealed that most visitors took the online continuing education courses in sequential order and were less likely to drop out after they reached the Introduction pages of the courses. Conclusions The utilization of the CFS website reflects a high level of interest in the illness by visitors to the site. The high utilization shows the website to be an important online resource for people seeking basic information about CFS and for those looking for professional health care and research information. Public health programs should consider analytic methods to further public health by understanding the characteristics of those seeking information and by evaluating the outcomes of public health campaigns. The website was an effective means to provide health information about CFS and serves as an important public health tool for community outreach.

[1]  Petra Benkovská,et al.  Web Usage Mining , 2009, Encyclopedia of Database Systems.

[2]  Jaideep Srivastava,et al.  Web usage mining: discovery and applications of usage patterns from Web data , 2000, SKDD.

[3]  A. Rademaker,et al.  A community-based study of chronic fatigue syndrome. , 1999, Archives of internal medicine.

[4]  Jun Hong,et al.  Using Markov models for web site link prediction , 2002, HYPERTEXT '02.

[5]  Christian Köhler,et al.  What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the Internet , 2003, AMIA.

[6]  Suzanne D Vernon,et al.  Cost Effectiveness and Resource Allocation Open Access the Economic Impact of Chronic Fatigue Syndrome , 2022 .

[7]  W. Reeves,et al.  Challenges for molecular profiling of chronic fatigue syndrome. , 2006, Pharmacogenomics.

[8]  Robert A. Logan,et al.  Evaluating Consumer Informatics: Learning from Health Campaign Research , 2004, MedInfo.

[9]  C. Chronaki,et al.  European citizens' use of E-health services: A study of seven countries , 2007, BMC public health.

[10]  Jaideep Srivastava,et al.  Web mining: information and pattern discovery on the World Wide Web , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[11]  Dedra Buchwald,et al.  Chronic fatigue syndrome: a review. , 2003, The American journal of psychiatry.

[12]  James F. Jones,et al.  Prevalence of chronic fatigue syndrome in metropolitan, urban, and rural Georgia , 2007, Population health metrics.

[13]  I. Hickie,et al.  The chronic fatigue syndrome: a comprehensive approach to its definition and study. International Chronic Fatigue Syndrome Study Group. , 1994, Annals of internal medicine.

[14]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[15]  Alan R. Peslak.  An analysis of regional and demographic differences in United States Internet usage , 2004, First Monday.

[16]  L. Baker,et al.  Use of the Internet and e-mail for health care information: results from a national survey. , 2003, JAMA.

[17]  Gary L. Kreps,et al.  Trust and sources of health information: the impact of the Internet and its implications for health care providers: findings from the first Health Information National Trends Survey. , 2005, Archives of internal medicine.

[18]  Jaideep Srivastava,et al.  Automatic personalization based on Web usage mining , 2000, CACM.

[19]  W. Reeves,et al.  Factors influencing the diagnosis of chronic fatigue syndrome. , 2004, Archives of internal medicine.

[20]  David C Hoaglin,et al.  Prevalence and incidence of chronic fatigue syndrome in Wichita, Kansas. , 2003, Archives of internal medicine.

[21]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[22]  Marco Gori,et al.  A random-walk based scoring algorithm with application to recommender systems for large-scale e-commerce , 2006, KDD 2006.

[23]  Barak Gaster,et al.  Physicians’ use of and attitudes toward electronic mail for patient communication , 2003, Journal of General Internal Medicine.

[24]  Ernestina Menasalvas Ruiz,et al.  Web Usage Mining Project for Improving Web-Based Learning Sites , 2005, EUROCAST.

[25]  Ian Hickie,et al.  The Chronic Fatigue Syndrome: A Comprehensive Approach to Its Definition and Study , 1994, Annals of Internal Medicine.