Features of Effective Medical Knowledge Resources to Support Point of Care Learning: A Focus Group Study

Objective Health care professionals access various information sources to quickly answer questions that arise in clinical practice. The features that favorably influence the selection and use of knowledge resources remain unclear. We sought to better understand how clinicians select among the various knowledge resources available to them, and from this to derive a model for an effective knowledge resource. Methods We conducted 11 focus groups at an academic medical center and outlying community sites. We included a purposive sample of 50 primary care and subspecialist internal medicine and family medicine physicians. We transcribed focus group discussions and analyzed these using a constant comparative approach to inductively identify features that influence the selection of knowledge resources. Results We identified nine features that influence users' selection of knowledge resources, namely efficiency (with sub-features of comprehensiveness, searchability, and brevity), integration with clinical workflow, credibility, user familiarity, capacity to identify a human expert, reflection of local care processes, optimization for the clinical question (e.g., diagnosis, treatment options, drug side effect), currency, and ability to support patient education. No single existing resource exemplifies all of these features. Conclusion The influential features identified in this study will inform the development of knowledge resources, and could serve as a framework for future research in this field.

[1]  Michael J. Hauan,et al.  How much effort is needed to keep up with the literature relevant for primary care? , 2004, Journal of the Medical Library Association : JMLA.

[2]  Richard Smith What clinical information do doctors need? , 1996, BMJ.

[3]  L. Hayden,et al.  Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2011 .

[4]  R. Thiele,et al.  Speed, accuracy, and confidence in Google, Ovid, PubMed, and UpToDate: results of a randomised trial , 2010, Postgraduate Medical Journal.

[5]  Atul Kumar,et al.  The practice of evidence-based medicine (EBM) in gastroenterology: discrepancies between EBM familiarity and EBM competency , 2011, Therapeutic advances in gastroenterology.

[6]  Debra Revere,et al.  Understanding the information needs of public health practitioners: A literature review to inform design of an interactive digital knowledge management system , 2007, J. Biomed. Informatics.

[7]  Gillian D Sanders,et al.  Enabling health care decisionmaking through clinical decision support and knowledge management. , 2012, Evidence report/technology assessment.

[8]  Sophia P Gladding,et al.  Should We Google It? Resource Use by Internal Medicine Residents for Point-of-Care Clinical Decision Making , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[9]  Michael L. Green,et al.  Why Do Residents Fail to Answer Their Clinical Questions? A Qualitative Study of Barriers to Practicing Evidence-Based Medicine , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Arjen Hoogendam,et al.  Answers to Questions Posed During Daily Patient Care Are More Likely to Be Answered by UpToDate Than PubMed , 2008, Journal of medical Internet research.

[11]  Eric S. Holmboe,et al.  Relationship of Electronic Medical Knowledge Resource Use and Practice Characteristics with Internal Medicine Maintenance of Certification Examination Scores , 2012, Journal of General Internal Medicine.

[12]  H. C. Coumou,et al.  How do primary care physicians seek answers to clinical questions? A literature review. , 2006, Journal of the Medical Library Association : JMLA.

[13]  N. Bennett,et al.  Physicians' Internet information‐seeking behaviors , 2004, The Journal of continuing education in the health professions.

[14]  Hong Yu,et al.  AskHERMES: An online question answering system for complex clinical questions , 2011, J. Biomed. Informatics.

[15]  Elmer V. Bernstam,et al.  Instruments to assess the quality of health information on the World Wide Web: what can our patients actually use? , 2005, Int. J. Medical Informatics.

[16]  Amit X. Garg,et al.  Searching for medical information online: a survey of Canadian nephrologists. , 2011, Journal of nephrology.

[17]  R Brian Haynes,et al.  Accessing preappraised evidence: fine-tuning the 5S model into a 6S model , 2009, Annals of Internal Medicine.

[18]  Alessandro Liberati,et al.  Speed of updating online evidence based point of care summaries: prospective cohort analysis , 2011, BMJ : British Medical Journal.

[19]  K. Davies,et al.  The information-seeking behaviour of doctors: a review of the evidence. , 2007, Health information and libraries journal.

[20]  A. Jha,et al.  Use of UpToDate and outcomes in US hospitals. , 2012, Journal of hospital medicine.

[21]  Saverio M. Maviglia,et al.  Research Paper: Patient-Care Questions that Physicians Are Unable to Answer , 2007, J. Am. Medical Informatics Assoc..

[22]  Masoomeh Faghankhani,et al.  A comparison of answer retrieval through four evidence-based textbooks (ACP PIER, Essential Evidence Plus, First Consult, and UpToDate): A randomized controlled trial , 2011, Medical teacher.

[23]  Alessandro Liberati,et al.  A Review of Online Evidence-based Practice Point-of-Care Information Summary Providers , 2010, Journal of medical Internet research.

[24]  Andrea M Ketchum,et al.  Type of Evidence Behind Point-of-Care Clinical Information Products: A Bibliometric Analysis , 2011, Journal of medical Internet research.

[25]  David M. Rind,et al.  Association of a clinical knowledge support system with improved patient safety, reduced complications and shorter length of stay among Medicare beneficiaries in acute care hospitals in the United States , 2008, Int. J. Medical Informatics.

[26]  Robert Kristofco,et al.  Information‐seeking behaviors and reflective practice , 2006, The Journal of continuing education in the health professions.

[27]  Douglas B. Fridsma,et al.  Research Paper: Effectiveness of Clinician-selected Electronic Information Resources for Answering Primary Care Physicians' Information Needs , 2006, J. Am. Medical Informatics Assoc..

[28]  F A Manian,et al.  Curbside consultations. A closer look at a common practice. , 1996, JAMA.

[29]  David A Cook,et al.  Barriers and decisions when answering clinical questions at the point of care: a grounded theory study. , 2013, JAMA internal medicine.

[30]  B. Ewigman,et al.  Answering family physicians' clinical questions using electronic medical databases. , 2001, The Journal of family practice.

[31]  R Brian Haynes,et al.  How Current Are Leading Evidence-Based Medical Textbooks? An Analytic Survey of Four Online Textbooks , 2012, Journal of medical Internet research.

[32]  Scott L. Zeger,et al.  Factors Associated with Medical Knowledge Acquisition During Internal Medicine Residency , 2007, Journal of General Internal Medicine.

[33]  Eta S Berner,et al.  Proposed Curricular Objectives to Teach Physicians Competence in Using the World Wide Web , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[34]  M. Ebell,et al.  Obstacles to answering doctors' questions about patient care with evidence: qualitative study , 2002, BMJ : British Medical Journal.

[35]  B. Glaser The Constant Comparative Method of Qualitative Analysis , 1965 .

[36]  Joan Ash,et al.  An evaluation of five bedside information products using a user-centered, task-oriented approach. , 2006, Journal of the Medical Library Association : JMLA.

[37]  Hamid Reza Baradaran,et al.  To Compare PubMed Clinical Queries and UpToDate in Teaching Information Mastery to Clinical Residents: A Crossover Randomized Controlled Trial , 2011, PloS one.

[38]  Hangwi Tang,et al.  Googling for a diagnosis—use of Google as a diagnostic aid: internet based study , 2006, BMJ : British Medical Journal.

[39]  Nancy L Wilczynski,et al.  The quality, breadth, and timeliness of content updating vary substantially for 10 online medical texts: an analytic survey. , 2012, Journal of clinical epidemiology.

[40]  Nunzia Bettinsoli Giuse,et al.  Evidence-based databases versus primary medical literature: an in-house investigation on their optimal use. , 2004, Journal of the Medical Library Association : JMLA.