Measuring the Effect of Virtual Librarian Intervention on Student Online Search

Abstract In this paper we describe the results from a case study of the online search behavior of high school students, and the effect of virtual librarian intervention on the quality of the search results. Search log data of students' actions were analyzed, librarians recommended revised search terms, new searches were conducted with these terms, and the difference in results was analyzed. Results showed that the librarians' recommended queries were more focused and produced results of a higher reading level, which was used as a proxy for source quality. The work presented here is a preliminary investigation of how librarian search expertise can improve online search results, and raises questions about how to support online student search that are of interest to both librarians and information science researchers. Possible directions for future research are discussed.

[1]  Chirag Shah,et al.  Coagmento- A Collaborative Information Seeking, Synthesis and Sense-Making Framework (an integrated , 2009 .

[2]  Michael J. Cole,et al.  Task Topic Knowledge vs. Background Domain Knowledge: Impact of Two Types of Knowledge on User Search Performance , 2013, WorldCIST.

[3]  Lindsay Fullerton,et al.  Trust Online: Young Adults' Evaluation of Web Content , 2010 .

[4]  Anne Aula,et al.  How does search behavior change as search becomes more difficult? , 2010, CHI.

[5]  Klaus Nordhausen,et al.  Modeling successful performance in Web searching , 2006 .

[6]  Amanda Spink,et al.  Patterns of query reformulation during Web searching , 2009 .

[7]  Ann Blandford,et al.  Designing for Expert Information Finding Strategies , 2004, BCS HCI.

[8]  Susan M. Land,et al.  A conceptual framework for scaffolding III-structured problem-solving processes using question prompts and peer interactions , 2004 .

[9]  Barbara M. Wildemuth,et al.  The effects of domain knowledge on search tactic formulation , 2004, J. Assoc. Inf. Sci. Technol..

[10]  Efthimis N. Efthimiadis,et al.  Analyzing and evaluating query reformulation strategies in web search logs , 2009, CIKM.

[11]  Chirag Shah,et al.  Coagmento: A system for supporting collaborative information seeking , 2011, ASIST.

[12]  Pertti Vakkari,et al.  Changes of search terms and tactics while writing a research proposal: A longitudinal case study , 2003, Inf. Process. Manag..

[13]  R. P. Fishburne,et al.  Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel , 1975 .

[14]  Van Scoyoc,et al.  Reducing Library Anxiety in First-Year Students: The Impact of Computer-Assisted Instruction and Bibliographic Instruction , 2003 .

[15]  Elizabeth D. Liddy,et al.  The effects of expertise and feedback on search term selection and subsequent learning , 2005, J. Assoc. Inf. Sci. Technol..

[16]  Wen-Hua Ren,et al.  Library instruction and college student self-efficacy in electronic information searching , 2000 .

[17]  Alison J. Head,et al.  Beyond Google: How do students conduct academic research? , 2007, First Monday.

[18]  T. Smalley.  College Success: High School Librarians Make the Difference , 2004 .

[19]  Helen Georgas,et al.  Google vs. the Library (Part II): Student Search Patterns and Behaviors when Using Google and a Federated Search Tool , 2014 .

[20]  Barrie Gunter,et al.  The Google generation: the information behaviour of the researcher of the future , 2008, Aslib Proc..

[21]  Jonathan A. Plucker,et al.  Why Can't I Find Newton's Third Law? Case Studies of Students' Use of the Web as a Science Resource , 2002 .

[22]  Stacey Knight-Davis,et al.  Analysis of Citations in Undergraduate Papers , 2008 .

[23]  Thorsten Joachims,et al.  Eye-tracking analysis of user behavior in WWW search , 2004, SIGIR '04.

[24]  Rui Wang,et al.  The Lasting Impact of a Library Credit Course , 2006 .

[25]  Susan C. Curtis.  Listening to Generation X , 2000 .

[26]  Michael B. Eisenberg,et al.  Truth Be Told: How College Students Evaluate and Use Information in the Digital Age , 2010 .

[27]  Heidi E. Julien,et al.  How high-school students find and evaluate scientific information : A basis for information literacy skills development , 2009 .

[28]  M. Gross,et al.  Attaining information literacy: An investigation of the relationship between skill level, self-estimates of skill, and library anxiety , 2007 .

[29]  Thorsten Joachims,et al.  In Google We Trust: Users' Decisions on Rank, Position, and Relevance , 2007, J. Comput. Mediat. Commun..

[30]  Dan Morris,et al.  Investigating the querying and browsing behavior of advanced search engine users , 2007, SIGIR.

[31]  Bernard J. Jansen,et al.  Search log analysis: What it is, what's been done, how to do it , 2006 .

[32]  Els Kuiper,et al.  Students' use of Web literacy skills and strategies: searching, reading and evaluating Web information , 2008, Inf. Res..

[33]  Virginia E. Young,et al.  Evaluation of Student Research Paper Bibliographies: Refining Evaluation Criteria. , 1995 .

[34]  Soo Young Rieh,et al.  Analysis of multiple query reformulations on the web: The interactive information retrieval context , 2006, Information Processing & Management.

[35]  Diane Mizrachi.  Undergraduates' academic information and library behaviors: preliminary results , 2010 .

[36]  Karen M. Drabenstott,et al.  Do nondomain experts enlist the strategies of domain experts? , 2003, J. Assoc. Inf. Sci. Technol..

[37]  James E. Herring.  Improving Students' Web Use and Information Literacy , 2010 .

[38]  Philip M. Davis,et al.  Impact of Farmer Field Schools on Agricultural Productivity and Poverty in East Africa , 2012 .

[39]  Elizabeth Yakel,et al.  A Faceted Taxonomy for Rating Student Bibliographies in an Online Information Literacy Game , 2012, Coll. Res. Libr..

[40]  Ryen W. White,et al.  Characterizing the influence of domain expertise on web search behavior , 2009, WSDM '09.