Health information on the Internet: accessibility, quality, and readability in English and Spanish.

CONTEXT Despite the substantial amount of health-related information available on the Internet, little is known about the accessibility, quality, and reading grade level of that health information. OBJECTIVE To evaluate health information on breast cancer, depression, obesity, and childhood asthma available through English- and Spanish-language search engines and Web sites. DESIGN AND SETTING Three unique studies were performed from July 2000 through December 2000. Accessibility of 14 search engines was assessed using a structured search experiment. Quality of 25 health Web sites and content provided by 1 search engine was evaluated by 34 physicians using structured implicit review (interrater reliability >0.90). The reading grade level of text selected for structured implicit review was established using the Fry Readability Graph method. MAIN OUTCOME MEASURES For the accessibility study, proportion of links leading to relevant content; for quality, coverage and accuracy of key clinical elements; and grade level reading formulas. RESULTS Less than one quarter of the search engine's first pages of links led to relevant content (20% of English and 12% of Spanish). On average, 45% of the clinical elements on English- and 22% on Spanish-language Web sites were more than minimally covered and completely accurate and 24% of the clinical elements on English- and 53% on Spanish-language Web sites were not covered at all. All English and 86% of Spanish Web sites required high school level or greater reading ability. CONCLUSION Accessing health information using search engines and simple search terms is not efficient. Coverage of key information on English- and Spanish-language Web sites is poor and inconsistent, although the accuracy of the information provided is generally good. High reading levels are required to comprehend Web-based health information.

[1]  Edward Fry The Readability Graph Validated at Primary Levels. , 1969 .

[2]  R. P. Fishburne,et al.  Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel , 1975 .

[3]  S Kamen,et al.  The task force. , 1976, Journal of hospital dental practice.

[4]  Edward B. Fry,et al.  Fry's Readability Graph: Clarifications, Validity, and Extension to Level 17. , 1977 .

[5]  Bettye Gilliam The Fry Graph Applied to Spanish Readability. , 1980 .

[6]  E. Ginzberg Access to health care for Hispanics. , 1991, JAMA.

[7]  Irwin S. Kirsch,et al.  Adult literacy in America , 1993 .

[8]  R. Kessler,et al.  Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States. Results from the National Comorbidity Survey. , 1994, Archives of general psychiatry.

[9]  L. Mynors-Wallis,et al.  Randomised controlled trial comparing problem solving treatment with amitriptyline and placebo for major depression in primary care , 1995, BMJ.

[10]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[11]  P. Impicciatore,et al.  Reliability of health information for the public on the world wide web: systematic survey of advice on managing fever in children at home , 1997, BMJ.

[12]  D. Malone,et al.  A national estimate of the economic costs of asthma. , 1997, American journal of respiratory and critical care medicine.

[13]  K Davison,et al.  The quality of dietary information on the World Wide Web. , 1997, Clinical performance and quality health care.

[14]  D. Winchester,et al.  Standards for diagnosis and management of invasive breast carcinoma , 1998, CA: a cancer journal for clinicians.

[15]  D. Mannino,et al.  Surveillance for asthma--United States, 1960-1995. , 1998, MMWR. CDC surveillance summaries : Morbidity and mortality weekly report. CDC surveillance summaries.

[16]  M. Trivedi,et al.  Treatment of depression--newer pharmacotherapies. , 1998, Psychopharmacology bulletin.

[17]  Faith McLellan,et al.  “Like hunger, like thirst”: patients, journals, and the internet , 1998, The Lancet.

[18]  Claude Bouchard,et al.  Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults. , 1998, WMJ : official publication of the State Medical Society of Wisconsin.

[19]  H. J. Mcclung,et al.  The Internet as a source for current patient information. , 1998, Pediatrics.

[20]  Claude Bouchard,et al.  Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults: Executive summary , 1998 .

[21]  L. Soot,et al.  Vascular surgery and the Internet: a poor source of patient-oriented information. , 1999, Journal of vascular surgery.

[22]  A. Mokdad,et al.  The spread of the obesity epidemic in the United States, 1991-1998. , 1999, JAMA.

[23]  Paul Kim,et al.  Published criteria for evaluating health related web sites: review , 1999, BMJ.

[24]  J. Manson,et al.  Annual deaths attributable to obesity in the United States. , 1999, JAMA.

[25]  J. Biermann,et al.  Evaluation of cancer information on the Internet , 1999, Cancer.

[26]  F. Bellavance,et al.  Prognosis of depression in elderly community and primary care populations: a systematic review and meta-analysis. , 1999, The American journal of psychiatry.

[27]  Quality of web based information on treatment of depression: cross sectional survey. , 2000, BMJ.

[28]  T. Edejer Disseminating health information in developing countries: the role of the internet , 2000, BMJ : British Medical Journal.

[29]  J. Goldsmith,et al.  How will the Internet change our health system? , 2000, Health affairs.

[30]  Lee Rainie,et al.  The online health care revolution: how the web helps americans take better care of themselves , 2000 .

[31]  A. Risk,et al.  e-Health Code of Ethics (May 24) , 2000, Journal of medical Internet research.

[32]  H. Christensen,et al.  Quality of web based information on treatment of depression: cross sectional survey , 2000, BMJ : British Medical Journal.

[33]  D. Bozentka,et al.  Evaluating the Source and Content of Orthopaedic Information on the Internet: The Case of Carpal Tunnel Syndrome* , 2000, The Journal of bone and joint surgery. American volume.

[34]  Y. L. Jiang,et al.  Quality evaluation of orthodontic information on the World Wide Web. , 2000, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[35]  R. Mayberry,et al.  Racial and Ethnic Differences in Access to Medical Care , 2000, Medical care research and review : MCRR.

[36]  L. Epstein,et al.  Dieting and the development of eating disorders in overweight and obese adults. , 2000, Archives of internal medicine.

[37]  M. Winker,et al.  Guidelines for medical and health information sites on the internet: principles governing AMA web sites. American Medical Association. , 2000, JAMA.

[38]  Dan Brickley,et al.  Quality Management, Certification and Rating of Health Information on the Net with MedCERTAIN: Using a medPICS/RDF/XML metadata structure for implementing eHealth ethics and creating trust globally , 2000, Journal of medical Internet research.

[39]  M J Deering,et al.  Proposed frameworks to improve the quality of health web sites: review. , 2000, MedGenMed : Medscape general medicine.

[40]  John Renner,et al.  Criteria for assessing the quality of health information on the Internet. , 1997, American journal of public health.