Collaborative Information Synthesis I : A Model of Information Behaviors of Scientists in Medicine and Public Health

Scientists engage in the discovery process more than any other user population, yet their day-today activities are often elusive. One activity that consumes much of a scientist's time is developing models that balance contradictory and redundant evidence. Driven by our desire to understand the information behaviors of this important user group, and the behaviors of scientific discovery in general, we conducted an observational study of academic research scientists as they resolved different experimental results reported in the biomedical literature. This article is the first of two that reports our findings. In this article, we introduce the Collaborative Information Synthesis (CIS) model that reflects the salient information behaviors that we observed. The CIS model emerges from a rich collection of qualitative data including interviews, electronic recordings of meetings, meeting minutes, e-mail communications, and extraction worksheets. Our findings suggest that scientists provide two information constructs: a hypothesis projection and context information. They also engage in four critical tasks: retrieval, extraction, verification, and analysis. The findings also suggest that science is not an individual but rather a collaborative activity and that scientists use the results of one analysis to inform new analyses. In Part 2, we compare and contrast existing information and cognitive models that have inadvertently reported synthesis, and then provide five recommendations that will enable designers to build information systems that support the important synthesis activity. Introduction Scientists engage in the discovery process more than any other user population, yet their day-today activities are often elusive. Even a scientist who actively makes discoveries in one discipline can find the activities conducted in a related field a mystery. Regardless of their specific discipline , the role of a good scientist is to develop a model of the world that accurately explains the available evidence. The development of accurate models often requires that a scientist resolve conflicting evidence. One activity that consumes much of a scientists' time is synthesis, " the dialectic combination of thesis and antithesis into a higher stage of truth " (Merriam-Webster's Collegiate Dictionary, 2004). This dictionary definition reflects the alternative viewpoints that often occur when multiple empirical studies explore the same phenomena. The synthesis activity results in an overall finding—a higher stage of truth— which scientists achieve by resolving conflicting evidence. Thus, the synthesis activity requires accurately weighing a body of evidence that includes contradictions (when the study results differ) and redundancies (when study results concur) that are inevitable …

[1]  T O Tengs,et al.  The link between smoking and impotence: two decades of evidence. , 2001, Preventive medicine.

[2]  David Moher,et al.  Meta-analysis of Observational Studies in Epidemiology , 2000 .

[3]  M E Funk,et al.  Indexing consistency in MEDLINE. , 1983, Bulletin of the Medical Library Association.

[4]  David Ellis,et al.  Modelling the information seeking patterns of engineers and research scientists in an industrial environment , 1997, J. Documentation.

[5]  B. Dervin,et al.  Information needs and uses. , 1986 .

[6]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[7]  Checklist of Information for Inclusion in Reports of Clinical Trials , 1996, Annals of Internal Medicine.

[8]  P. Tugwell,et al.  Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? , 2000, The Lancet.

[9]  I Olkin,et al.  [Improving the quality of reports on randomized controlled trials. Recommendations of the CONSORT Study Group]. , 1998, Revista espanola de salud publica.

[10]  Nicholas Rescher,et al.  Peirce's Philosophy of Science: Critical Studies in His Theory of Induction and Scientific Method , 1978 .

[11]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[12]  F. Schmidt Meta-Analysis , 2008 .

[13]  Merriam Webster Merriam-Webster's Collegiate Dictionary , 2016 .

[14]  Steven K. Feiner,et al.  PERSIVAL, a system for personalized search and summarization over multimedia healthcare information , 2001, JCDL '01.

[15]  P. Lavori,et al.  Electronic Trial Banks: A Complementary Method for Reporting Randomized Trials , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[16]  George Hripcsak,et al.  Review Paper: Reference Standards, Judges, and Comparison Subjects: Roles for Experts in Evaluating System Performance , 2002, J. Am. Medical Informatics Assoc..

[17]  M. Clarke,et al.  Handsearching versus electronic searching to identify reports of randomized trials. , 2002, The Cochrane database of systematic reviews.

[18]  I. Olkin,et al.  Estimating time to conduct a meta-analysis from number of citations retrieved. , 1999, JAMA.

[19]  David R. Jones,et al.  Systematic reviews of trials and other studies. , 1998, Health technology assessment.

[20]  L. Murphy,et al.  Spinal palpation: The challenges of information retrieval using available databases. , 2003, Journal of manipulative and physiological therapeutics.

[21]  David Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials , 2001, Annals of Internal Medicine.

[22]  D. Ellis Modeling the Information-Seeking Patterns of Academic Researchers: A Grounded Theory Approach , 1993, The Library Quarterly.

[23]  L. Murphy,et al.  Searching biomedical databases on complementary medicine: the use of controlled vocabulary among authors, indexers and investigators , 2003, BMC complementary and alternative medicine.

[24]  Marcia J. Bates,et al.  Rigorous Systematic Bibliography. , 1976 .

[25]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[26]  Steve McDonald,et al.  Development of the Cochrane Collaboration’s Central Register of Controlled Clinical Trials , 2002, Evaluation & the health professions.

[27]  David L. Post,et al.  Medical Problem Solving: An Analysis of Clinical Reasoning , 1979 .

[28]  Wanda Pratt,et al.  Collaborative information synthesis II: Recommendations for information systems to support synthesis activities , 2006, J. Assoc. Inf. Sci. Technol..

[29]  Karen A Robinson,et al.  Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. , 2002, International journal of epidemiology.