Level of Evidence as a Future Gold Standard for the Content Quality of Health Resources on the Internet

OBJECTIVE An assessment of the quality of health information on the Internet is an absolute necessity. In this study 'sensitive' information was defined as information found in documents published on the Internet, which could be used in a medical decision. For sensitive information, the main criterion chosen for the quality of the information was an indication of the level of evidence. A survey was conducted using the CISMeF health catalogue to assess how often a score of the level of evidence is mentioned in the information accessible on the Internet in French-language health resources. METHODS Since 1999, members of the CISMeF team have systematically been searching for all documents containing 'sensitive' information and verifying whether the level of evidence was explicitly indicated as a score at least once in the document. RESULTS As of June 2001, 10,190 resources were included in CISMeF; including 2964 textual 'sensitive' resources (29.1%). Out of all these resources, only 4.7% (95% confidence interval: 4.0 - 5.5%) indicated the level of evidence. A statistically significant difference in the prevalence of indicating the level of evidence according to resource types (e.g., 18.1% for guidelines compared to 0.0% for teaching material), year of publication (almost three times greater in 1997-2001 compared with 1990-1996) and publishers was observed. CONCLUSION As the number of people accessing the growing amount of information on the Internet is increasing daily, publishers have an ethical obligation to inform their readers about the validity of 'sensitive' information their sites contain. However, the vast majority of the French language Internet resources that were surveyed do not mention a score of the level of evidence for their sensitive information.

[1]  W. W. Daniel,et al.  Biostatistics: A Foundation for Analysis in the Health Sciences, 5th Edition. , 1991 .

[2]  J. Boissel,et al.  [Hierarchies according to the level of evidence of source data, before their integration in the synthesis, in the matter of therapeutic efficacy]. , 1996, Therapie.

[3]  R. Kravitz,et al.  Health information on the Internet: accessibility, quality, and readability in English and Spanish. , 2001, JAMA.

[4]  Angel A Hernández-Borges,et al.  Can Examination of WWW Usage Statistics and other Indirect Quality Indicators Help to Distinguish the Relative Quality of Medical websites? , 1999, Journal of medical Internet research.

[5]  M. Winker,et al.  Guidelines for medical and health information sites on the internet: principles governing AMA web sites. American Medical Association. , 2000, JAMA.

[6]  H. Sandvik Health information and interaction on the internet: a survey of female urinary incontinence , 1999, BMJ.

[7]  B. Fervers,et al.  Impact of a clinical guidelines program for breast and colon cancer in a French cancer center. , 1997, JAMA.

[8]  Juha Hakala,et al.  DC-5: The Helsinki Metadata Workshop; A Report on the Workshop and Subsequent Developments , 1998, D-Lib Magazine.

[9]  J C Wyatt,et al.  Commentary: measuring quality and impact of the world wide web , 1997, BMJ.

[10]  C Boyer,et al.  The Health On the Net Code of Conduct for medical and health Websites , 1998, Comput. Biol. Medicine.

[11]  S J Darmoni,et al.  The use of Dublin Core metadata in a structured health resource guide on the internet. , 2001, Bulletin of the Medical Library Association.

[12]  M. Boulos,et al.  The Use of Quality Benchmarking in Assessing Web Resources for the Dermatology Virtual Branch Library of the National electronic Library for Health (NeLH) , 2001, Journal of medical Internet research.

[13]  H. J. Mcclung,et al.  The Internet as a source for current patient information. , 1998, Pediatrics.

[14]  S. Woolf,et al.  Practice guidelines: a new reality in medicine. I. Recent developments. , 1990, Archives of internal medicine.

[15]  S. Woolf Practice guidelines, a new reality in medicine. II. Methods of developing guidelines. , 1992, Archives of internal medicine.

[16]  M C Haugh,et al.  Quality of health information about depression on internet. Level of evidence should be gold standard. , 2001, BMJ.

[17]  J. Boissel,et al.  Implication of evidence‐based medicine in prescription guidelines taught to french medical students: Current status in the cardiovascular field E‐mail: pn@upcl.univ-lyon1.fr , 1999, Clinical pharmacology and therapeutics.

[18]  H. Christensen,et al.  Quality of web based information on treatment of depression: cross sectional survey , 2000, BMJ : British Medical Journal.

[19]  Marius Fieschi,et al.  Quality criteria and access characteristics of Web sites: proposal for the design of a health Internet directory , 1999, AMIA.

[20]  Abdulrab Habib,et al.  A search tool based on 'encapsulated' MeSH thesaurus to retrieve quality health resources on the Internet , 2001, Medical informatics and the Internet in medicine.

[21]  P Impicciatore,et al.  Parents on the Web: Risks for Quality Management of Cough in Children , 2000, Pediatrics.

[22]  M Fieschi,et al.  The French Virtual Medical University. , 2000, Studies in health technology and informatics.

[23]  G D Lundberg,et al.  Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware. , 1997, JAMA.

[24]  S J Darmoni,et al.  CISMeF: A Structured Health Resource Guide , 2000, Methods of Information in Medicine.

[25]  G Eysenbach,et al.  EU-project medCERTAIN: Certification and Rating of Trustworthy and Assessed Health Information on the Net. , 2000, Studies in health technology and informatics.

[26]  P. Impicciatore,et al.  Reliability of health information for the public on the world wide web: systematic survey of advice on managing fever in children at home , 1997, BMJ.

[27]  S J Darmoni,et al.  Simplified access to MeSH tree structures on CISMeF. , 1999, Bulletin of the Medical Library Association.

[28]  Yasuo Haruki,et al.  Internet Medical Usage in Japan: Current Situation and Issues , 2001, Journal of medical Internet research.

[29]  K. H. Pollock,et al.  Biostatistics: A Foundation for Analysis in the Health Sciences. , 1976 .