Research Paper: Effectiveness of Clinician-selected Electronic Information Resources for Answering Primary Care Physicians' Information Needs

OBJECTIVE To determine if clinician-selected electronic information resources improve primary care physicians' abilities to answer simulated clinical questions. DESIGN Observational study using hour-long interviews in physician offices and think-aloud protocols. PARTICIPANTS answered 23 multiple-choice questions and chose 2 to obtain further information using their own information resources. We established which resources physicians chose, processes used, and results obtained when looking for information to support their answers. MEASUREMENTS Correctness of answers before and after searching, resources used, and searching techniques. RESULTS 23 physicians sought answers to 46 questions using their own information resources. They spent a mean of 13.0 (SD 5.5) minutes searching for information for the two questions using an average of 1.8 resources per question and a wide variety of searching techniques. On average 43.5% of the answers to the original 23 questions were correct. For the questions that were searched, 18 (39.1%) of the 46 answers were correct before searching. After searching, the number of correct answers was 19 (42.1%). This difference of 1 correct answer was attributed to 6 questions (13.0%) going from an incorrect to correct answer and 5 (10.9%) questions going from a correct to incorrect answer. We found differences in the ability of various resources to provide correct answers. CONCLUSION For the primary care physicians studied, electronic information resources of choice did not always provide support for finding correct answers to simulated clinical questions and in some instances, individual resources may have contributed to an initially correct answer becoming incorrect.

[1]  Martin Dawes,et al.  Knowledge management in clinical practice: a systematic review of information seeking behavior in physicians , 2003, Int. J. Medical Informatics.

[2]  B. A. Rapp,et al.  Use of MEDLINE by physicians for clinical problem solving. , 1993, JAMA.

[3]  J. Stockman,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[4]  Roland M. Grad,et al.  Impact of clinical information-retrieval technology on physicians: A literature review of quantitative, qualitative and mixed methods studies , 2005, Int. J. Medical Informatics.

[5]  Timothy M. Franz,et al.  Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. , 1999, JAMA.

[6]  J I Westbrook,et al.  Use of point‐of‐care online clinical evidence by junior and senior doctors in New South Wales public hospitals , 2005, Internal medicine journal.

[7]  Guido G. Gatti,et al.  Do physicians know when their diagnoses are correct? , 2005, Journal of General Internal Medicine.

[8]  R B Haynes,et al.  Of studies, summaries, synopses, and systems: the “4S” evolution of services for finding current best evidence , 2005, ACP journal club.

[9]  W. Hersh,et al.  Factors associated with successful answering of clinical questions using an information retrieval system. , 2002, Bulletin of the Medical Library Association.

[10]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[11]  Johanna I Westbrook,et al.  The Impact of an Online Evidence System on Confidence in Decision Making in a Controlled Setting , 2005, Medical decision making : an international journal of the Society for Medical Decision Making.

[12]  C J Walker,et al.  A program to enhance clinical use of MEDLINE. A randomized controlled trial. , 1993, The Online journal of current clinical trials.

[13]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[14]  Johanna I. Westbrook,et al.  Do online information retrieval systems help experienced clinicians answer clinical questions? , 2005, Journal of the American Medical Informatics Association : JAMIA.

[15]  Caroline F. Zink,et al.  Neurobiological Correlates of Social Conformity and Independence During Mental Rotation , 2005, Biological Psychiatry.

[16]  F. van Dijk,et al.  Caution required when relying on a colleague's advice; a comparison between professional advice and evidence from the literature , 2005, BMC health services research.

[17]  Terry S. Field,et al.  Knowledge, patterns of care, and outcomes of care for generalists and specialists , 1999, Journal of General Internal Medicine.

[18]  Charles P. Friedman,et al.  Research Paper: Factors Associated with Success in Searching MEDLINE and Applying Evidence to Answer Clinical Questions , 2002, J. Am. Medical Informatics Assoc..

[19]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[20]  M. S. Klein,et al.  Effect of online literature searching on length of stay and patient care costs , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[21]  Douglas B. Fridsma,et al.  Research Paper: Computer Decision Support as a Source of Interpretation Error: The Case of Electrocardiograms , 2003, J. Am. Medical Informatics Assoc..

[22]  Mary L. Cummings,et al.  Automation Bias in Intelligent Time Critical Decision Support Systems , 2004 .

[23]  Farah Magrabi,et al.  General practitioners' use of online evidence during consultations , 2005, Int. J. Medical Informatics.