An analysis of clinical queries in an electronic health record search utility

PURPOSE While search engines have become nearly ubiquitous on the Web, electronic health records (EHRs) generally lack search functionality; furthermore, there is no knowledge on how and what healthcare providers search while using an EHR-based search utility. In this study, we sought to understand user needs as captured by their search queries. METHODS This post-implementation study analyzed user search log files for 6 months from an EHR-based, free-text search utility at our large academic institution. The search logs were de-identified and then analyzed in two steps. First, two investigators classified all the unique queries as navigational, transactional, or informational searches. Second, three physician reviewers categorized a random sample of 357 informational searches into high-level semantic types derived from the Unified Medical Language System (UMLS). The reviewers were given overlapping data sets, such that two physicians reviewed each query. RESULTS We analyzed 2207 queries performed by 436 unique users over a 6-month period. Of the 2207 queries, 980 were unique queries. Users of the search utility included clinicians, researchers and administrative staff. Across the whole user population, approximately 14.5% of the user searches were navigational searches and 85.1% were informational. Within informational searches, we found that users predominantly searched for laboratory results and specific diseases. CONCLUSIONS A variety of user types, ranging from clinicians to administrative staff, took advantage of the EHR-based search utility. Though these users' search behavior differed, they predominantly performed informational searches related to laboratory results and specific diseases. Additionally, a number of queries were part of words, implying the need for a free-text module to be included in any future concept-based search algorithm.

[1]  James J. Cimino,et al.  Automated Discovery of Patient-Specific Clinician Information Needs Using Clinical Information System Log Files , 2003, AMIA.

[2]  Andrei Broder,et al.  A taxonomy of web search , 2002, SIGF.

[3]  E Nygren,et al.  Reading the medical record. I. Analysis of physicians' ways of reading the medical record. , 1992, Computer methods and programs in biomedicine.

[4]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[5]  Stefan Schulz,et al.  Evaluation of a Document Search Engine in a Clinical Department System , 2008, AMIA.

[6]  Mark Levene,et al.  Associating search and navigation behavior through log analysis , 2005, J. Assoc. Inf. Sci. Technol..

[7]  A Hasman,et al.  An experimental electronic medical-record system with multiple views on medical narratives. , 1997, Computer methods and programs in biomedicine.

[8]  Anders Grimsmo,et al.  Instant availability of patient records, but diminished availability of patient information: A multi-method study of GP's use of electronic patient records , 2008, BMC Medical Informatics Decis. Mak..

[9]  Carl Heneghan,et al.  Using the Turning Research Into Practice (TRIP) database: how do clinicians really search? , 2007, Journal of the Medical Library Association : JMLA.

[10]  Mark Sanderson,et al.  Advantages of query biased summaries in information retrieval , 1998, SIGIR '98.

[11]  David W. Bates,et al.  Analysis of Information Needs of Users of MEDLINEplus, 2002 - 2003 , 2006, AMIA.

[12]  Serguei V. S. Pakhomov,et al.  Electronic medical records for clinical research: application to the identification of heart failure. , 2007, The American journal of managed care.

[13]  Thorsten Joachims,et al.  Evaluating Retrieval Performance Using Clickthrough Data , 2003, Text Mining.

[14]  Peter L. Elkin,et al.  UMLS Concept Indexing for Production Databases: A Feasibility Study , 2001, J. Am. Medical Informatics Assoc..

[15]  Monika Henzinger,et al.  Analysis of a very large web search engine query log , 1999, SIGF.

[16]  George Hripcsak,et al.  WebCIS: large scale deployment of a Web-based clinical information system , 1999, AMIA.

[17]  Vimla L. Patel,et al.  The Classification of Clinicians' Information Needs While Using a Clinical Information System , 2003, AMIA.

[18]  James J. Cimino,et al.  Use, Usability, Usefulness, and Impact of an Infobutton Manager , 2006, AMIA.

[19]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[20]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[21]  Vimla L. Patel,et al.  Clinical Information Needs in Context: An Observational Study of Clinicians While Using a Clinical Information System , 2003, AMIA.

[22]  Bernard J. Jansen,et al.  Search log analysis: What it is, what's been done, how to do it , 2006 .

[23]  Suzanne Bakken,et al.  Development of user-configurable information source pages for medical information retrieval. , 2007, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[24]  Richard Smith What clinical information do doctors need? , 1996, BMJ.

[25]  Joel D. Martin,et al.  Automated Information Extraction of Key Trial Design Elements from Clinical Trial Publications , 2008, AMIA.

[26]  Hang Li,et al.  A new approach to intranet search based on information extraction , 2005, CIKM '05.

[27]  William R. Hersh,et al.  SAPHIRE International: a tool for cross-language information retrieval , 1998, AMIA.

[28]  B. Buchanan,et al.  Physicians' information needs: analysis of questions posed during clinical teaching. , 1991, Annals of internal medicine.

[29]  Stefan Klink,et al.  Improving Document Transformation Techniques with Collaborative Learned Term-Based Concepts , 2004, Reading and Learning.

[30]  Jaime Teevan,et al.  Implicit feedback for inferring user preference: a bibliography , 2003, SIGF.

[31]  H. J. Suermondt,et al.  Semantic integration of information in a physician's workstation. , 1994, International journal of bio-medical computing.

[32]  James J. Cimino,et al.  Research Paper: Providing Concept-oriented Views for Clinical Data Using a Knowledge-based System: An Evaluation , 2002, J. Am. Medical Informatics Assoc..

[33]  W R Hersh,et al.  Applications of Technology: Clini Web: Managing Clinical Information on the World Wide Web , 1996, J. Am. Medical Informatics Assoc..

[34]  David A. Hanauer,et al.  EMERSE: The Electronic Medical Record Search Engine , 2006, AMIA.

[35]  Dina Demner-Fushman,et al.  Application of Information Technology: Essie: A Concept-based Search Engine for Structured Biomedical Text , 2007, J. Am. Medical Informatics Assoc..

[36]  William R. Hersh,et al.  Information Retrieval: A Health and Biomedical Perspective , 2002 .

[37]  Jeremy C Wyatt,et al.  Helping clinicians to find data and avoid delays , 1998, The Lancet.

[38]  Steve Fox,et al.  Evaluating implicit measures to improve web search , 2005, TOIS.

[39]  Jaime Teevan,et al.  Information re-retrieval: repeat queries in Yahoo's logs , 2007, SIGIR.

[40]  J. Hippisley-Cox,et al.  The electronic patient record in primary care—regression or progression? A cross sectional study , 2003, BMJ : British Medical Journal.

[41]  Ophir Frieder,et al.  Hourly analysis of a very large topically categorized web query log , 2004, SIGIR '04.

[42]  H J Tange,et al.  The paper-based patient record: is it really so bad? , 1995, Computer methods and programs in biomedicine.

[43]  Tsuyoshi Murata,et al.  Extracting Users' Interests from Web Log Data , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[44]  Dario A. Giuse,et al.  StarTracker: An Integrated, Web-based Clinical Search Engine , 2003, AMIA.