Effects of popularity and quality on the usage of query suggestions during information search

Many search systems provide users with recommended queries during online information seeking. Although usage statistics are often used to recommend queries, this information is usually not displayed to the user. In this study, we investigate how the presentation of this information impacts use of query suggestions. Twenty-three subjects used an experimental search system to find documents about four topics. Eight query suggestions were provided for each topic: four were high quality queries and four were low quality queries. Fake usage information indicating how many other people used the queries was also provided. For half the queries this information was high and for the other half this information was low. Results showed that subjects could distinguish between high and low quality queries and were not influenced by the usage information. Qualitative data revealed that subjects felt favorable about the suggestions, but the usage information was less important for the search task used in this study.

[1]  Barry Smyth,et al.  Collecting community wisdom: integrating social search & social navigation , 2007, IUI '07.

[2]  S. Bikhchandani,et al.  You have printed the following article : A Theory of Fads , Fashion , Custom , and Cultural Change as Informational Cascades , 2007 .

[3]  Dinan Gunawardena,et al.  Social tags: meaning and suggestions , 2008, CIKM '08.

[4]  Kristina Höök,et al.  Social navigation of food recipes , 2001, CHI.

[5]  Pertti Vakkari,et al.  Changes in Search Tactics and Relevance Judgements when Preparing a Research Proposal A Summary of the Findings of a Longitudinal Study , 2001, Information Retrieval.

[6]  L. Rook.  An Economic Psychological Approach to Herd Behavior , 2006 .

[7]  A. Banerjee,et al.  A Simple Model of Herd Behavior , 1992 .

[8]  Thorsten Joachims,et al.  Accurately Interpreting Clickthrough Data as Implicit Feedback , 2017 .

[9]  Robert S. Baron,et al.  The forgotten variable in conformity research: Impact of task importance on social influence. , 1996 .

[10]  Yi-Fen Chen,et al.  Herd behavior in purchasing books online , 2008, Comput. Hum. Behav..

[11]  Ellen M. Voorhees,et al.  Overview of the TREC 2006 , 2007, TREC.

[12]  T. Joachims.  WebWatcher : A Tour Guide for the World Wide Web , 1997 .

[13]  Roland Imhoff,et al.  What Motivates Nonconformity? Uniqueness Seeking Blocks Majority Influence , 2009, Personality & social psychology bulletin.

[14]  James Surowiecki.  The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations Doubleday Books. , 2004 .

[15]  Dan Cosley,et al.  Think different: increasing online community participation using uniqueness and group dissimilarity , 2004, CHI.

[16]  Barry Smyth,et al.  Are people biased in their use of search engines? , 2008, CACM.

[17]  Nicholas J. Belkin,et al.  Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems , 1995 .

[18]  Noah J. Goldstein,et al.  Social influence: compliance and conformity. , 2004, Annual review of psychology.

[19]  Thorsten Joachims,et al.  Web Watcher: A Tour Guide for the World Wide Web , 1997, IJCAI.

[20]  Ed H. Chi,et al.  Towards a model of understanding social search , 2008, SSM '08.

[21]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[22]  R. Cialdini.  Influence: Science and Practice , 1984 .

[23]  S. Sénécal,et al.  The influence of online product recommendations on consumers' online choices , 2004 .

[24]  Ward Hanson,et al.  Hits and misses: Herd behavior and online product popularity , 1996 .

[25]  Karl Gyllstrom,et al.  A comparison of query and term suggestion features for interactive searching , 2009, SIGIR.

[26]  Mark Rosenstein,et al.  Recommending and evaluating choices in a virtual community of use , 1995, CHI '95.

[27]  Marcia J. Bates,et al.  Idea tactics , 1980, IEEE Transactions on Professional Communication.

[28]  M. Deutsch,et al.  A study of normative and informational social influences upon individual judgement. , 1955, Journal of abnormal psychology.

[29]  Ellen M. Voorhees,et al.  Overview of the TREC 2004 Robust Retrieval Track , 2004 .

[30]  Ryen W. White,et al.  Studying the use of popular destinations to enhance web search interaction , 2007, SIGIR.

[31]  John Riedl,et al.  Is seeing believing?: how recommender system interfaces affect users' opinions , 2003, CHI '03.

[32]  Barry Smyth,et al.  Exploiting Query Repetition and Regularity in an Adaptive Community-Based Web Search Engine , 2004, User Modeling and User-Adapted Interaction.