An evaluation of five bedside information products using a user-centered, task-oriented approach.

PURPOSE The paper compares several bedside information tools using user-centered, task-oriented measures to assist those making or supporting purchasing decisions. METHODS Eighteen potential users were asked to attempt to answer clinical questions using five commercial products (ACP's PIER, DISEASEDEX, FIRSTConsult, InfoRetriever, and UpToDate). Users evaluated each tool for ease-of-use and user satisfaction. The average number of questions answered and user satisfaction were measured for each product. RESULTS Results show no significant differences in user perceptions of content quality. However, user interaction measures (such as screen layout) show a significant preference for the UpToDate product. In addition, users found answers to significantly more questions using UpToDate. CONCLUSION When evaluating electronic products designed for use at the point of care, the user interaction aspects of a product become as important as more traditional content-based measures of quality. Actual or potential users of such products are appropriately equipped to identify which products rate the highest on these measures.

[1]  W. Hersh,et al.  Factors associated with successful answering of clinical questions using an information retrieval system. , 2002, Bulletin of the Medical Library Association.

[2]  M A Abate,et al.  Use of two online services as drug information sources for health professionals. , 1992, Methods of information in medicine.

[3]  Cynthia D Mulrow,et al.  Welcome, PIER, A New Physicians' Information and Education Resource , 2002, Annals of Internal Medicine.

[4]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[5]  M. Ebell,et al.  Obstacles to answering doctors' questions about patient care with evidence: qualitative study , 2002, BMJ : British Medical Journal.

[6]  Daniel Z. Sands,et al.  Housestaff Use of Medical References in Ambulatory Care , 2003, AMIA.

[7]  M. Ebell,et al.  InfoRetriever: rapid access to evidence-based information on a hand-held computer. , 1998, M.D. computing : computers in medical practice.

[8]  Nicholas J. Belkin,et al.  Rutgers' TREC 2001 Interactive Track Experience , 2001, TREC.

[9]  Paul Over,et al.  TREC-6 Interactive Report , 1997, TREC.

[10]  P N Gorman,et al.  Information Seeking in Primary Care , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  Charles P. Friedman,et al.  Development and initial validation of an instrument to measure physicians' use of, knowledge about, and attitudes toward computers. , 1998, Journal of the American Medical Informatics Association : JAMIA.

[12]  G E Pugh,et al.  Computerized Databases for Emergency Care: What Impact on Patient Care? , 1994, Methods of Information in Medicine.

[13]  Gary N Fox,et al.  FIRSTConsult: a useful point-of-care clinical reference. , 2004, The Journal of family practice.

[14]  David F. Lobach,et al.  Identification of design features to enhance utilization and acceptance of systems for Internet-based decision support at the point of care , 1998, AMIA.

[15]  Jenny Field,et al.  General practitioners' perceptions of the route to evidence based medicine: a questionnaire survey , 1998, BMJ.

[16]  Brian S Alper.  Practical evidence-based Internet resources. , 2003, Family practice management.

[17]  Wei Ma.  A database selection expert system based on reference librarian's database selection strategy: A usability and empirical evaluation , 2002, J. Assoc. Inf. Sci. Technol..

[18]  B. Ewigman,et al.  Answering family physicians' clinical questions using electronic medical databases. , 2001, The Journal of family practice.

[19]  Patricia Tomasulo.  PIER—Evidence-Based Medicine from ACP , 2004 .

[20]  M H Ebell,et al.  Putting computer-based evidence in the hands of clinicians. , 1999, JAMA.

[21]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[22]  W R Hersh,et al.  How well do physicians use electronic information retrieval systems? A framework for investigation and systematic review. , 1998, JAMA.

[23]  Vimla L. Patel,et al.  'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems , 2001, Int. J. Medical Informatics.

[24]  Steve Black.  An assessment of social sciences coverage by four prominent full-text online aggregated journal packages , 1999 .

[25]  Josette F. Jones.  Development of a self-assessment method for patients to evaluate health information on the Internet , 1999, AMIA.

[26]  Paul N. Gorman,et al.  Information needs of physicians , 1995 .

[27]  Louise T. Su.  A comprehensive and systematic model of user evaluation of Web search engines: I. Theory and background , 2003, J. Assoc. Inf. Sci. Technol..

[28]  W. Rosenberg,et al.  Evidence based medicine: an approach to clinical problem-solving , 1995, BMJ.

[29]  Natalie Kupferberg,et al.  Evaluation of five full-text drug databases by pharmacy students, faculty, and librarians: do the groups agree? , 2004, Journal of the Medical Library Association : JMLA.

[30]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[31]  Kristy Lundahl,et al.  Residents’ Patient-Specific Clinical Questions: Opportunities for Evidence-Based Learning , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[32]  Patricia Flatley Brennan,et al.  Design and Evaluation of SchoolhealthLink, a Web-Based Health Information Resource , 2003, The Journal of school nursing : the official publication of the National Association of School Nurses.

[33]  G O Barnett,et al.  “Just‐in‐time” clinical information , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[34]  Gary N Fox,et al.  UpToDate: a comprehensive clinical database. , 2003, The Journal of family practice.

[35]  Cheryl Capitani,et al.  Bringing the best of medical librarianship to the patient team. , 2002, Journal of the Medical Library Association : JMLA.

[36]  M. Ebell,et al.  Analysis of questions asked by family doctors regarding patient care , 1999, BMJ.