Analysis and evaluation of query reformulations in different task types

Users engaged in information search often reformulate or modify their queries. This paper reports on an investigation of how task type and task situation influence users' query reformulation behavior. A controlled experiment was conducted with 48 participants, each working on six web search tasks classified into three types according to the task structure: Simple, Hierarchical and Parallel. We developed a taxonomy of query reformulation and used an automated method to detect the reformulations. Our results showed that Specialization was most frequently used in Simple tasks, and Word Substitution was most frequently used in Parallel tasks. After visiting and saving a useful web page, Generalization was less likely to be used while New query was more likely to be used. We also found that the effectiveness of each query reformulation type varied in different task types. The results of this study demonstrate the effect of task type on users' query reformulation behavior and have implications for the design of query suggestions that are offered to users during searching.

[1]  Elaine Toms,et al.  Task Effects on Interactive Search: The Query Factor , 2008, INEX.

[2]  Ingrid Hsieh-Yee,et al.  Effects of Search Experience and Subject Knowledge on the Search Tactics of Novice and Experienced Searchers. , 1993 .

[3]  Barbara M. Wildemuth,et al.  The effects of domain knowledge on search tactic formulation , 2004, J. Assoc. Inf. Sci. Technol..

[4]  Amanda Spink,et al.  Defining a session on Web search engines , 2007, J. Assoc. Inf. Sci. Technol..

[5]  Efthimis N. Efthimiadis,et al.  Analyzing and evaluating query reformulation strategies in web search logs , 2009, CIKM.

[6]  Daqing He,et al.  Combining evidence for automatic Web session identification , 2002, Inf. Process. Manag..

[7]  Raya Fidel,et al.  Moves in online searching , 1985 .

[8]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[9]  Eric Horvitz,et al.  Patterns of search: analyzing and modeling Web query refinement , 1999 .

[10]  Amanda Spink,et al.  Defining a session on Web search engines: Research Articles , 2007 .

[11]  Yuelin Li,et al.  Relationships among work tasks, search tasks, and interactive information searching behavior , 2008 .

[12]  Soo Young Rieh,et al.  Analysis of multiple query reformulations on the web: The interactive information retrieval context , 2006, Information Processing & Management.

[13]  Jacek Gwizdka,et al.  Analysis of Query Reformulation Types on Different Search Tasks , 2010 .

[14]  Ingrid Hsieh-Yee,et al.  Search Tactics of Web Users in Searching for Texts, Graphics, Known Items and Subjects , 1998 .

[15]  Elizabeth D. Liddy,et al.  The effects of expertise and feedback on search term selection and subsequent learning , 2005, J. Assoc. Inf. Sci. Technol..

[16]  Seda Ozmutlu Automatic new topic identification using multiple linear regression , 2006 .