Influences on the Outcome of Literature Searches for Integrative Research Reviews

Three influences on the outcomes of literature searches undertaken as part of integrative research reviews were examined: (1) the degree of expertise of the searcher; (2) the amount of information available (i.e., keywords, bibliographics, abstracts), and (3) the cognitive characteristics of the searcher. Participants were presented with descriptions of documents varying in (1) topic area (related or not related to their expertise), (2) amount of information, and (3) whether the document was relevant or irrelevant to the search. Results revealed no difference between experts and nonexperts in accuracy of judging relevant documents, but experts were better able to discern that irrelevant documents were in fact irrelevant. Judgments based on abstracts were more accurate than judgments based on keywords or bibliographrcs, which did not differ, and this effect was more pronounced for relevant than irrelevant articles. Participants who had previously conducted more literature searches or published more research reviews made more accurate judgments, as did searchers high in conceptual complexity or tolerance of ambiguity.

[1]  D. Campbell.  Recommendations for APA test standards regarding construct, trait, or discriminant validity. , 1960 .

[2]  J. S. Vannoy.  GENERALITY OF COGNITIVE COMPLEXITY-SIMPLICITY AS A PERSONALITY CONSTRUCT. , 1965, Journal of personality and social psychology.

[3]  Betty K. Oldroyd.  Study of strategies used in online searching 5: differences between the experienced and the inexperienced searcher , 1984 .

[4]  E. Frenkel-Brunswik,et al.  Intolerance of ambiguity as an emotional and perceptual personality variable. , 1949, Psychological issues.

[5]  Carol Hansen Fenichel.  An examination of the relationship between searching behavior and searcher background , 1980 .

[6]  Marcia J. Bates,et al.  Factors affecting subject catalog search success , 1977, J. Am. Soc. Inf. Sci..

[7]  M. L. Smith,et al.  Meta-analysis of psychotherapy outcome studies. , 1977, The American psychologist.

[8]  Harris Cooper,et al.  Locus of control and academic achievement: A literature review. , 1983 .

[9]  Helen Howard,et al.  Measures that discriminate among online searchers with different training and experience , 1982 .

[10]  Tefko Saracevic,et al.  RELEVANCE: A review of and a framework for the thinking on the notion in information science , 1997, J. Am. Soc. Inf. Sci..

[11]  W. A. Scott.  Cognitive Complexity and Cognitive Flexibility , 1962 .

[12]  A Hunt,et al.  TUBEROUS SCLEROSIS: A SURVEY OF 97 CASES. III: FAMILY ASPECTS , 1983, Developmental medicine and child neurology.

[13]  David Tom,et al.  Influences of student background and teacher authoritarianism on teacher expectations. , 1984 .

[14]  S. Budner.  Intolerance of ambiguity as a personality variable. , 1962, Journal of personality.

[15]  David Davidson,et al.  The effect of individual differences of cognitive style on judgments of document relevance , 1977, J. Am. Soc. Inf. Sci..

[16]  Terry Honess.  Cognitive Complexity and Social Prediction , 1976 .

[17]  G. J. Rath,et al.  Comparisons of four types of lexical indicators of content , 1961 .