Studying PubMed usages in the field for complex problem solving: Implications for tool design

Many recent studies on MEDLINE-based information seeking have shed light on scientists' behaviors and associated tool innovations that may improve efficiency and effectiveness. Few if any studies, however, examine scientists' problem-solving uses of PubMed in actual contexts of work and corresponding needs for better tool support. Addressing this gap, we conducted a field study of novice scientists (14 upper level undergraduate majors in molecular biology) as they engaged in a problem solving activity with PubMed in a laboratory setting. Findings reveal many common stages and patterns of information seeking across users as well as variations, especially variations in cognitive search styles. Based on findings, we suggest tool improvements that both confirm and qualify many results found in other recent studies. Our findings highlight the need to use results from context-rich studies to inform decisions in tool design about when to offer improved features to users.

[1]  Marcia J. Bates,et al.  Where should the person stop and the information search interface start? , 1990, Inf. Process. Manag..

[2]  Wanda Pratt,et al.  H.3.3 Information Search and Retrieval , 2022 .

[3]  Forbes Gibb,et al.  Uncertainty in information seeking and retrieval: A study in an academic environment , 2011, Inf. Process. Manag..

[4]  David Ellis,et al.  A Comparison of the Information seeking Patterns of researchers in the Physical and Social Sciences , 1993, J. Documentation.

[5]  Hong Yu,et al.  Automatically classifying sentences in full-text biomedical articles into Introduction, Methods, Results and Discussion , 2009, Bioinform..

[6]  Hsinchun Chen,et al.  An end user evaluation of query formulation and results review tools in three medical meta-search engines , 2007, Int. J. Medical Informatics.

[7]  K. Bretonnel Cohen,et al.  HIGH‐PRECISION BIOLOGICAL EVENT EXTRACTION: EFFECTS OF SYSTEM AND OF DATA , 2011, Comput. Intell..

[8]  Zhiyong Lu,et al.  Understanding PubMed® user search behavior through log analysis , 2009, Database J. Biol. Databases Curation.

[9]  Zhiyong Lu,et al.  PubMed and beyond: a survey of web tools for searching biomedical literature , 2011, Database J. Biol. Databases Curation.

[10]  Ellen J. Barton.  Linguistic Discourse Analysis: How t he Language in Texts Works , 2003 .

[11]  Nicholas J. Belkin,et al.  An exploration of the relationships between work task and interactive information search behavior , 2010 .

[12]  Halil Kilicoglu,et al.  Semantic MEDLINE: A web application for managing the results of PubMed searches , 2008, SMBM 2008.

[13]  M. Bates.  The invisible substrate of information science , 1999 .

[14]  Muh-Chyun Tang.  Browsing and searching in a faceted information space: A naturalistic study of PubMed users' interaction with a display tool , 2007 .

[15]  Ann Blandford,et al.  Investigating the information-seeking behaviour of academic lawyers: From Ellis's model to design , 2008, Inf. Process. Manag..

[16]  Yan Zhang,et al.  Academic users' interactions with ScienceDirect in search tasks: Affective and cognitive behaviors , 2008, Inf. Process. Manag..

[17]  José Luís Oliveira,et al.  Concept-based query expansion for retrieving gene related publications from MEDLINE , 2010, BMC Bioinformatics.

[18]  Neil R. Smalheiser,et al.  Arrowsmith two-node search interface: A tutorial on finding meaningful links between two disparate sets of articles in MEDLINE , 2009, Comput. Methods Programs Biomed..

[19]  Anita Komlodi,et al.  Attorneys interacting with legal information systems: Tools for mental model building and task integration , 2005, ASIST.

[20]  Kathleen M Gehring,et al.  Information fluency for undergraduate biology majors: applications of inquiry-based learning in a developmental biology course. , 2008, CBE life sciences education.

[21]  Ryen W. White,et al.  Evaluating advanced search interfaces using established information-seeking models , 2009, J. Assoc. Inf. Sci. Technol..

[22]  Vimla L. Patel,et al.  Emerging paradigms of cognition in medical decision-making , 2002, J. Biomed. Informatics.

[23]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[24]  Carol Collier Kuhlthau,et al.  Accommodating the User's Information Search Process: Challenges for Information Retrieval System Designers , 2005 .

[25]  David Ellis,et al.  Modelling the information seeking patterns of engineers and research scientists in an industrial environment , 1997, J. Documentation.

[26]  Theresa Dirndorfer Anderson,et al.  Uncertainty in action: observing information seeking within the creative processes of scholarly research , 2006, Inf. Res..

[27]  Hong Xie,et al.  Shifts of interactive intentions and information-seeking strategies in interactive information retrieval , 2000, Journal of the American Society for Information Science.

[28]  Fang Liu,et al.  SLIM: an alternative Web interface for MEDLINE/PubMed searches – a preliminary study , 2005, BMC Medical Informatics Decis. Mak..

[29]  Barbara M. Wildemuth,et al.  Evidence-based practice in search interface design , 2006, J. Assoc. Inf. Sci. Technol..

[30]  Shashank Agarwal,et al.  Automatically Classifying Sentences in Full-Text Biomedical Articles into Introduction, Methods, Results and Discussion , 2009, Summit on translational bioinformatics.

[31]  B. Koslowski,et al.  Information Becomes Evidence when an Explanation Can Incorporate It into a Causal Framework. , 2008 .

[32]  Catherine N. Norton,et al.  LigerCat: Using "MeSH Clouds" from Journal, Article, or Gene Citations to Facilitate the Identification of Relevant Biomedical Literature , 2009, AMIA.

[33]  W. Pratt,et al.  The usefulness of dynamically categorizing search results. , 2000, Journal of the American Medical Informatics Association : JAMIA.

[34]  Alfred D. Eaton,et al.  HubMed: a web-based biomedical literature search interface , 2006, Nucleic Acids Res..

[35]  Elmer V. Bernstam,et al.  A day in the life of PubMed: analysis of a typical day's query log. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[36]  Catherine Blake,et al.  Beyond genes, proteins, and abstracts: Identifying scientific claims from full-text biomedical articles , 2010, J. Biomed. Informatics.

[37]  Daniel Berleant,et al.  PubMed Assistant: a biologist-friendly interface for enhanced PubMed search , 2006, Bioinform..

[38]  Ryen W. White,et al.  Evaluating advanced search interfaces using established information-seeking models , 2009 .

[39]  Stephann Makri,et al.  Information for inspiration: Understanding architects' information seeking and use behaviors to inform design , 2010 .

[40]  W. Pratt,et al.  Collaborative information synthesis I: A model of information behaviors of scientists in medicine and public health , 2006 .

[41]  M. HamidR.Jamali,et al.  The information seeking behaviour of the users of digital scholarly journals , 2006, Inf. Process. Manag..

[42]  Susan T. Dumais,et al.  To personalize or not to personalize: modeling queries with variation in user intent , 2008, SIGIR '08.

[43]  Hong Iris Xie.  Shifts of interactive intentions and information-seeking strategies in interactive information retrieval , 2000 .

[44]  Bernard J. Jansen,et al.  Using the taxonomy of cognitive learning to model online searching , 2009, Inf. Process. Manag..

[45]  Marti A. Hearst.  The Use of Categories and Clusters for Organizing Retrieval Results , 1999 .

[46]  Elaine Toms,et al.  Information interaction: Providing a framework for information architecture , 2002, J. Assoc. Inf. Sci. Technol..

[47]  Hsinchun Chen,et al.  User-Centered Evaluation of Arizona BioPathway: An Information Extraction, Integration, and Visualization System , 2007, IEEE Transactions on Information Technology in Biomedicine.

[48]  D. Hounsell,et al.  The development of students’ ways of thinking and practising in three final-year biology courses , 2005 .

[49]  W. John Wilbur,et al.  Spelling correction in the PubMed search engine , 2006, Information Retrieval.

[50]  Filip Radlinski,et al.  How does clickthrough data reflect retrieval quality? , 2008, CIKM '08.

[51]  Ann Peterson Bishop,et al.  Document Structure and Digital Libraries: How Researchers Mobilize Information in Journal Articles , 1999, Inf. Process. Manag..

[52]  Chen Li,et al.  Supporting BioMedical Information Retrieval: The BioTracer Approach , 2011, Trans. Large Scale Data Knowl. Centered Syst..

[53]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[54]  Soo Young Rieh,et al.  Cuisine: Classification using stylistic feature sets and-or name-based feature sets , 2010 .

[55]  Vimla L. Patel,et al.  Cognitive Science and Biomedical Informatics , 2014 .

[56]  Gloria J. Leckie,et al.  Modeling the Information Seeking of Professionals: A General Model Derived from Research on Engineers, Health Care Professionals, and Lawyers , 1996, The Library Quarterly.

[57]  A. Strauss,et al.  Grounded theory methodology: An overview. , 1994 .

[58]  Jimmy J. Lin,et al.  Modeling actions of PubMed users with n-gram language models , 2009, Information Retrieval.

[59]  Dan Morris,et al.  Investigating the querying and browsing behavior of advanced search engine users , 2007, SIGIR.

[60]  Fan Meng,et al.  Cross-Domain Neurobiology Data Integration and Exploration , 2009, IJCBS.

[61]  Wanda Pratt,et al.  Collaborative information synthesis II: Recommendations for information systems to support synthesis activities , 2006, J. Assoc. Inf. Sci. Technol..

[62]  W. Bruce Croft,et al.  Improving the effectiveness of information retrieval with local context analysis , 2000, TOIS.

[63]  Kalervo Järvelin,et al.  Information interaction in molecular medicine: integrated use of multiple channels , 2010, IIiX.

[64]  Jimmy J. Lin,et al.  Navigating information spaces: A case study of related article search in PubMed , 2008, Inf. Process. Manag..

[65]  David Ellis,et al.  A Behavioural Approach to Information Retrieval System Design , 1989, J. Documentation.

[66]  Carol Tenopir,et al.  Finding and using journal-article components: Impacts of disaggregation on teaching and research practice , 2008, J. Assoc. Inf. Sci. Technol..