Supporting effective health and biomedical information retrieval and navigation: A novel facet view interface evaluation

There is a need to provide a more effective user interface to facilitate non-domain experts' health information seeking in authoritative online databases such as MEDLINE. We developed a new topic cluster based information navigation system called SimMed. Instead of offering a list of documents, SimMed presents users with a list of ranked clusters. Topically similar documents are grouped together to provide users with a better overview of the search results and to support exploration of similar literature within a cluster. We conducted an empirical user study to compare SimMed to a traditional document list based search interface. A total of 42 study participants were recruited to use both interfaces for health information exploration search tasks. The results showed that SimMed is more effective in terms of users' perceived topic knowledge changes and their engagement in user-system interactions. We also developed a new metric to assess users' efforts to find relevant citations. On average, users need significantly fewer clicks to find relevant information in SimMed than in the baseline system. Comments from study participants indicated that SimMed is more helpful in finding similar citations, providing related medical terms, and presenting better organized search results, particularly when the initial search is unsatisfactory. Findings from the study shed light on future health and biomedical information retrieval system and interface designs.

[1]  George Hripcsak,et al.  Development, implementation, and a cognitive evaluation of a definitional question answering system for physicians , 2007, J. Biomed. Informatics.

[2]  Amanda Spink,et al.  Web searching on the Vivisimo search engine , 2006, J. Assoc. Inf. Sci. Technol..

[3]  W. Pratt,et al.  The usefulness of dynamically categorizing search results. , 2000, Journal of the American Medical Informatics Association : JAMIA.

[4]  Zhiyong Lu,et al.  Improving accuracy for identifying related PubMed queries by an integrated approach , 2009, J. Biomed. Informatics.

[5]  Alfred D. Eaton,et al.  HubMed: a web-based biomedical literature search interface , 2006, Nucleic Acids Res..

[6]  Mohammad R. Akbarzadeh-Totonchi,et al.  A hierarchical fuzzy rule-based approach to aphasia diagnosis , 2007, J. Biomed. Informatics.

[7]  Johanna I. Westbrook,et al.  Research Paper: Do clinicians use online evidence to support patient care? a study of 55, 000 clinicians , 2003, J. Am. Medical Informatics Assoc..

[8]  James P. Callan,et al.  Experiments Using the Lemur Toolkit , 2001, TREC.

[9]  Elmer V. Bernstam,et al.  A day in the life of PubMed: analysis of a typical day's query log. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[10]  Marti A. Hearst Clustering versus faceted categories for information exploration , 2006, Commun. ACM.

[11]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[12]  James Allan,et al.  Find-similar: similarity browsing as a search tool , 2006, SIGIR.

[13]  Marti A. Hearst,et al.  Reexamining the cluster hypothesis: scatter/gather on retrieval results , 1996, SIGIR '96.

[14]  Joydeep Ghosh,et al.  Under Consideration for Publication in Knowledge and Information Systems Generative Model-based Document Clustering: a Comparative Study , 2003 .

[15]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[16]  Kun Lu,et al.  Towards effective genomic information retrieval: The impact of query complexity and expansion strategies , 2010, J. Inf. Sci..

[17]  Manfred Tscheligi,et al.  CHI '04 Extended Abstracts on Human Factors in Computing Systems , 2004, CHI 2004.

[18]  David W. Martin,et al.  Doing psychology experiments , 1977 .

[19]  Oren Etzioni,et al.  Grouper: A Dynamic Clustering Interface to Web Search Results , 1999, Comput. Networks.

[20]  Ryen W. White,et al.  Supporting exploratory search , 2006 .

[21]  Yasunori Yamamoto,et al.  Biomedical knowledge navigation by literature clustering , 2007, J. Biomed. Informatics.

[22]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[23]  Alla Keselman,et al.  Research Paper: Consumer Health Information Seeking as Hypothesis Testing , 2008, J. Am. Medical Informatics Assoc..

[24]  Johanna I. Westbrook,et al.  Do online information retrieval systems help experienced clinicians answer clinical questions? , 2005, Journal of the American Medical Informatics Association : JAMIA.

[25]  Saverio Perugini,et al.  Supporting multiple paths to objects in information hierarchies: Faceted classification, faceted search, and symbolic links , 2010, Inf. Process. Manag..

[26]  W. Bruce Croft,et al.  Combining classifiers in text categorization , 1996, SIGIR '96.

[27]  W. John Wilbur,et al.  The Effectiveness of Document Neighboring in Search Enhancement , 1994, Inf. Process. Manag..

[28]  George W. Furnas,et al.  Effective view navigation , 1997, CHI.

[29]  Christine Ros,et al.  Effects of domain knowledge on reference search with the PubMed database: An experimental study , 2009, J. Assoc. Inf. Sci. Technol..

[30]  Elaine Toms,et al.  How consumers search for health information , 2007, Health Informatics J..

[31]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[32]  Anthony Jameson,et al.  Depth- and breadth-first processing of search result lists , 2004, CHI EA '04.

[33]  Jimmy J. Lin,et al.  Navigating information spaces: A case study of related article search in PubMed , 2008, Inf. Process. Manag..

[34]  Susan T. Dumais,et al.  Bringing order to the Web: automatically categorizing search results , 2000, CHI.

[35]  Kun Lu,et al.  Search strategies on a new health information retrieval system , 2010, Online Inf. Rev..

[36]  W. Bruce Croft,et al.  Support for Browsing in an Intelligent Text Retrieval System , 1989, Int. J. Man Mach. Stud..

[37]  Anthony K. H. Tung,et al.  Spatial clustering methods in data mining : A survey , 2001 .

[38]  Mika Käki,et al.  Findex: search result categories help users when document ranking fails , 2005, CHI.

[39]  R A Greenes,et al.  Characteristics of Consumer Terminology for Health Information Retrieval , 2002, Methods of Information in Medicine.

[40]  Amanda Spink,et al.  Searching the Web: the public and their queries , 2001 .

[41]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[42]  Jiawei Han,et al.  Geographic Data Mining and Knowledge Discovery , 2001 .

[43]  Mary Lynn Rice-Lively,et al.  Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries , 2009, JCDL 2009.

[44]  Hans-Peter Frei,et al.  SIGIR '96 : proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 18-22, 1996, Zurich, Switzerland , 1996 .

[45]  Annie Y. S. Lau,et al.  Research Paper: Can Cognitive Biases during Consumer Health Information Searches Be Reduced to Improve Decision Making? , 2009, J. Am. Medical Informatics Assoc..

[46]  P. Pirolli Information Foraging Theory: Adaptive Interaction with Information , 2007 .

[47]  Muh-Chyun Tang Browsing and searching in a faceted information space: A naturalistic study of PubMed users' interaction with a display tool , 2007 .

[48]  Annie Y. S. Lau,et al.  Research Paper: Do People Experience Cognitive Biases while Searching for Information? , 2007, J. Am. Medical Informatics Assoc..

[49]  Damaraju Raghavarao,et al.  Block Designs: Analysis, Combinatorics and Applications , 2005 .

[50]  Dawid Weiss,et al.  A survey of Web clustering engines , 2009, CSUR.

[51]  Peter D. Stetson,et al.  Development and evaluation of nursing user interface screens using multiple methods , 2009, J. Biomed. Informatics.

[52]  Wanda Pratt Dynamic organization of search results using the UMLS , 1997, AMIA.

[53]  Barbara M. Wildemuth,et al.  The effects of domain knowledge on search tactic formulation , 2004, J. Assoc. Inf. Sci. Technol..

[54]  Matthew Banta,et al.  What do exploratory searchers look at in a faceted search interface? , 2009, JCDL '09.

[55]  Ben Shneiderman,et al.  Users can change their web search tactics: Design guidelines for categorized overviews , 2008, Inf. Process. Manag..

[56]  Chris Buckley,et al.  OHSUMED: an interactive retrieval evaluation and new large test collection for research , 1994, SIGIR '94.

[57]  Dagobert Soergel,et al.  Helping Healthcare Consumers Understand: An "Interpretive Layer" for Finding and Making Sense of Medical Information , 2004, MedInfo.

[58]  Charles W. Krueger,et al.  New methods in software product line practice , 2006, CACM.

[59]  Adem Karahoca,et al.  Information system design for a hospital emergency department: A usability analysis of software prototypes , 2010, J. Biomed. Informatics.

[60]  Brian D. Davison,et al.  Web page classification: Features and algorithms , 2009, CSUR.

[61]  W. Bruce Croft,et al.  Combining the language model and inference network approaches to retrieval , 2004, Inf. Process. Manag..

[62]  Debra Revere,et al.  Understanding the information needs of public health practitioners: A literature review to inform design of an interactive digital knowledge management system , 2007, J. Biomed. Informatics.

[63]  Hai-Tao Zheng,et al.  GOClonto: An ontological clustering approach for conceptualizing PubMed abstracts , 2010, J. Biomed. Informatics.