Exploration of dynamic query suggestions and dynamic search results for their effects on search behaviors

While search behavior using dynamic query suggestions is understudied, it is virtually non-existent for dynamic search results (as currently experienced with Google Instant). We report results from a controlled lab study aimed at exploring the effects of these recent search interface developments ‐ dynamic query suggestions and dynamic search results ‐ on users’ search behaviors. Based on the availability of these two features, 36 participants were assigned to three conditions and were asked to complete an exploratory search task. Analyses on user behaviors were conducted based on log data, screen videos, and eye tracking. Our results showed that while the dynamic search results feature exposed the participants to more search results pages, shorter querying time and shorter queries, such a functionality did not change users’ general search process transition, as well as number of search sites, queries, and visited webpages. The findings also indicate a need to evaluate search interface features in the broader context of task completion rather than information searching and query running only.

[1]  Nicholas J. Belkin,et al.  Display time as implicit feedback: understanding task effects , 2004, SIGIR '04.

[2]  Nicholas J. Belkin,et al.  Personalizing information retrieval for multi-session tasks: the roles of task stage and task type , 2010, SIGIR '10.

[3]  Jacek Gwizdka,et al.  Search behaviors in different task types , 2010, JCDL '10.

[4]  J. Liu,et al.  Usefulness as the Criterion for Evaluation of Interactive Information Retrieval , 2009 .

[5]  Chirag Shah,et al.  Coagmento: A system for supporting collaborative information seeking , 2011, ASIST.

[6]  Yoichi Shinoda,et al.  Information filtering based on user behavior analysis and best match text retrieval , 1994, SIGIR '94.

[7]  Anne Aula,et al.  How does search behavior change as search becomes more difficult? , 2010, CHI.

[8]  Gary Marchionini,et al.  Examining the effectiveness of real-time query expansion , 2007, Inf. Process. Manag..

[9]  Micheline Beaulieu,et al.  Experiments on interfaces to support query expansion , 1997, J. Documentation.

[10]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[11]  Peter G. Anick,et al.  A longitudinal study of real-time search assistance adoption , 2008, SIGIR '08.

[12]  Hsinchun Chen,et al.  An end user evaluation of query formulation and results review tools in three medical meta-search engines , 2007, Int. J. Medical Informatics.

[13]  Roberto I. González-Ibáñez,et al.  Evaluating the synergic effect of collaboration in information seeking , 2011, SIGIR.

[14]  Nicholas J. Belkin,et al.  A Model for Evaluation of Interactive Information Retrieval , 2009 .

[15]  Nicholas J. Belkin,et al.  A case for interaction: a study of interactive information retrieval behavior and effectiveness , 1996, CHI.

[16]  Roberto I. González-Ibáñez,et al.  Exploring information seeking processes in collaborative search tasks , 2010, ASIST.

[17]  Chirag Shah,et al.  Coagmento- A Collaborative Information Seeking, Synthesis and Sense-Making Framework (an integrated , 2009 .

[18]  Ryen W. White,et al.  Assessing the scenic route: measuring the value of search trails in web logs , 2010, SIGIR.

[19]  Pertti Vakkari,et al.  Exploratory Searching As Conceptual Exploration , 2010 .