How Much is Too Much?: Whole Session vs. First Query Behaviors in Task Type Prediction

One of the emerging and important problems in Interactive Information Retrieval research is predicting search tasks. Given a searcher's behavior during a search session, can the searcher's task be predicted? Which aspects of the task can be predicted, and how quickly and how accurately can the prediction be made? Much past literature has examined relationships between browsing behavior and task type at a statistical level, and recent work is moving towards prediction. While one may think whole session measures are useful for prediction, recent findings on common measures have suggested the contrary. Can less of the session still be useful? We examine the opposite end: the first query. Using multiple data sets for comparison, our results suggest that first query measures can be at least as good as -- and sometimes better than -- whole session measures for certain task type predictions.

[1]  Daqing He,et al.  Searching, browsing, and clicking in a search session: changes in user behavior by task and over time , 2014, SIGIR.

[2]  R. Weisberg A-N-D , 2011 .

[3]  Nicholas J. Belkin,et al.  A faceted approach to conceptualizing tasks in information seeking , 2008, Inf. Process. Manag..

[4]  Preben Hansen,et al.  Conceptual framework for tasks in information studies , 2005, J. Assoc. Inf. Sci. Technol..

[5]  Diane Kelly,et al.  Engaged or Frustrated?: Disambiguating Emotional State in Search , 2017, SIGIR.

[6]  Chirag Shah,et al.  User Activity Patterns During Information Search , 2015, ACM Trans. Inf. Syst..

[7]  Preben Hansen,et al.  Conceptual framework for tasks in information studies: Book Reviews , 2005 .

[8]  D. Campbell Task Complexity: A Review and Analysis , 1988 .

[9]  Nicholas J. Belkin,et al.  Personalization of search results using interaction behaviors in search sessions , 2012, SIGIR '12.

[10]  Xu Jun,et al.  SIGIR 2014 workshop on semantic matching in information retrievalProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval - SIGIR '14 , 2014 .

[11]  Ben Carterette,et al.  Overview of the TREC 2014 Session Track , 2014, TREC.

[12]  Chirag Shah,et al.  Extracting Information Seeking Intentions for Web Search Sessions , 2016, SIGIR.

[13]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[14]  Dorota Glowacka,et al.  Is exploratory search different? A comparison of information search behavior for exploratory and lookup tasks , 2016, J. Assoc. Inf. Sci. Technol..

[15]  Chirag Shah,et al.  The Paradox of Personalization: Does Task Prediction Require Individualized Models? , 2018, CHIIR.

[16]  Nicholas J. Belkin,et al.  Predicting information searchers' topic knowledge at different search stages , 2016, J. Assoc. Inf. Sci. Technol..

[17]  Jaime Arguello Predicting Search Task Difficulty , 2014, ECIR.

[18]  Nicholas J. Belkin,et al.  Predicting Search Task Difficulty at Different Search Stages , 2014, CIKM.

[19]  Jacek Gwizdka,et al.  Search behaviors in different task types , 2010, JCDL '10.