Queries in authentic work tasks: the effects of task type and complexity

Purpose The purpose of this paper is to investigate information retrieval (IR) in the context of authentic work tasks (WTs), as compared to traditional experimental IR study designs. Design/methodology/approach The participants were 22 professionals working in municipal administration, university research and education, and commercial companies. The data comprise 286 WTs and 420 search tasks (STs). The data were collected in natural situations. It includes transaction logs, video recordings, interviews, observation, and daily questionnaires. Findings The analysis included the effects of WT type and complexity on the number of STs, queries, search keys and types of queries. The findings suggest that simple STs are enough to support most WTs. Complex WTs (vs more simple ones) and intellectual WTs (vs communication, support and editing WTs) include more STs than other WT categories. Research limitations/implications Further research should address the problems related to controllability of field studies and enhance the use of realistic WT situations in test-based studies, as well. Originality/value The study is an attempt to bring traditional IR studies and realistic research settings closer to each other. Using authentic WTs when studying IR is still rare. The representativeness of the WT/ST types used in interactive IR experiments should be carefully addressed: in the work flow, people seldom consciously recognise separate “STs”. This means that STs may mainly be an academic construct even to the point that studying IR without a decent context does violence to the further understanding of the phenomenon.

[1]  Gary Marchionini,et al.  Examining the effectiveness of real-time query expansion , 2007, Inf. Process. Manag..

[2]  Christina Courtright Context in information behavior research , 2007 .

[3]  Zhizhong Li,et al.  Task complexity: A review and conceptualization framework , 2012 .

[4]  Kalervo Järvelin,et al.  Task complexity affects information seeking and use , 1995 .

[5]  Carol Collier Kuhlthau Towards collaboration between information seeking and information retrieval , 2005 .

[6]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[7]  Yuelin Li Exploring the relationships between work task and search task in information search , 2009 .

[8]  Ian Ruthven,et al.  Searcher's Assessments of Task Complexity for Web Searching , 2004, ECIR.

[9]  Pasi Pyöriä,et al.  The concept of knowledge work revisited , 2005, J. Knowl. Manag..

[10]  Thorvald Haerem,et al.  The influence of degree of expertise and objective task complexity on perceived task complexity and performance. , 2007, The Journal of applied psychology.

[11]  Jia Tina Du Information use and information sharing in marketing: A diary study , 2012, ASIST.

[12]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[13]  Hong Iris Xie Shifts of interactive intentions and information-seeking strategies in interactive information retrieval , 2000 .

[14]  Brenda Dervin,et al.  Given a context by any other name: methodological tools for taming the unruly beast , 1997 .

[15]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[16]  Anne Aula,et al.  How does search behavior change as search becomes more difficult? , 2010, CHI.

[17]  Ian Rowlands,et al.  Researchers’ e-journal use and information seeking behaviour , 2010, J. Inf. Sci..

[18]  Preben Hansen,et al.  Conceptual framework for tasks in information studies , 2005, J. Assoc. Inf. Sci. Technol..

[19]  Pertti Vakkari,et al.  Task-based information searching , 2005, Annu. Rev. Inf. Sci. Technol..

[20]  Amanda Spink,et al.  Multitasking information seeking and searching processes , 2002, J. Assoc. Inf. Sci. Technol..

[21]  Peter Ingwersen,et al.  Information technology and information use: towards a unified view of information and information technology , 1986 .

[22]  Dorota Glowacka,et al.  Supporting exploratory search tasks with interactive user modeling , 2013, ASIST.

[23]  Sanna Kumpulainen,et al.  Trails across the heterogeneous information environment: Manual integration patterns of search systems in molecular medicine , 2014, J. Documentation.

[24]  Jessica Lingel,et al.  Information practices of urban newcomers: An analysis of habits and wandering , 2015, J. Assoc. Inf. Sci. Technol..

[25]  Ian Rowlands,et al.  Online use and information seeking behaviour: institutional and subject comparisons of UK researchers , 2009, J. Inf. Sci..

[26]  Laura Hollink,et al.  Search behavior of media professionals at an audiovisual archive: A transaction log analysis , 2010 .

[27]  Luanne Freund,et al.  Assigning search tasks designed to elicit exploratory search behaviors , 2012, HCIR '12.

[28]  Kalervo Järvelin,et al.  Search task features in work tasks of varying types and complexity , 2017, J. Assoc. Inf. Sci. Technol..

[29]  Amanda Spink,et al.  How are we searching the World Wide Web? A comparison of nine search engine transaction logs , 2006, Inf. Process. Manag..

[30]  Jingjing Liu,et al.  Exploring search task difficulty reasons in different task types and user knowledge groups , 2015, Inf. Process. Manag..

[31]  Diane Kelly Measuring online information seeking context, Part 1: Background and method , 2006 .

[32]  Pertti Vakkari,et al.  A theory of the task-based information retrieval process: a summary and generalisation of a longitudinal study , 2001, J. Documentation.

[33]  Kalervo Järvelin,et al.  Task complexity and information searching in administrative tasks revisited , 2012, IIiX.

[34]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[35]  Pertti Vakkari,et al.  Relevance and contributing information types of searched documents in task performance , 2000, SIGIR '00.

[36]  Nils Pharo,et al.  A new model of information behaviour based on the Search Situation Transition schema , 2004, Inf. Res..

[37]  Michael A. Shepherd,et al.  The impact of task on the usage of web browser navigation mechanisms , 2006, Graphics Interface.

[38]  Fabrizio Silvestri,et al.  Mining Query Logs: Turning Search Usage Data into Knowledge , 2010, Found. Trends Inf. Retr..

[39]  Pertti Vakkari,et al.  Task-Based Information Interaction Evaluation , 2015, ACM Trans. Inf. Syst..

[40]  Hilary Yerbury,et al.  Re-enactment and its information practices; tensions between the individual and the collective , 2015, J. Documentation.

[41]  Die Hu,et al.  Interactive retrieval using simulated versus real work task situations: Differences in sub-facets of tasks and interaction performance , 2013, ASIST.

[42]  Jia Tina Du,et al.  The information journey of marketing professionals: Incorporating work task‐driven information seeking, information judgments, information use, and information sharing , 2014, J. Assoc. Inf. Sci. Technol..

[43]  Amanda Spink,et al.  Searching for people on Web search engines , 2004, J. Documentation.

[44]  Peter Ingwersen,et al.  The development of a method for the evaluation of interactive information retrieval systems , 1997, J. Documentation.

[45]  Mary Czerwinski,et al.  A diary study of task switching and interruptions , 2004, CHI.

[46]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[47]  Peng Xu,et al.  Can distributed software development be agile? , 2006, CACM.

[48]  Pertti Vakkari,et al.  Changes of search terms and tactics while writing a research proposal: A longitudinal case study , 2003, Inf. Process. Manag..

[49]  Pertti Vakkari Task complexity, information types, search strategies and relevance: integrating studies on information seeking and retrieval , 1999 .

[50]  Bernard J. Jansen,et al.  The Methodology of Search Log Analysis , 2009 .

[51]  Nils Pharo,et al.  The SST Method Schema: a Tool for Analysing Work Task-Based Web Information Search Processes , 2002 .

[52]  Elaine Toms,et al.  Untangling search task complexity and difficulty in the context of interactive information retrieval studies , 2014, J. Documentation.

[53]  Nicholas J. Belkin,et al.  A faceted approach to conceptualizing tasks in information seeking , 2008, Inf. Process. Manag..