People , Interacting with Information 1

Recent recognition in IR that people engage in information seeking sessions; attempts to formally model search sessions; and, the move toward evaluation of IR systems over entire search sessions, are evidence of a new, broader understanding of IR's goals. This move takes IR's goal beyond identification of relevant information objects, to supporting people in achievement of the goal or task which led them to engage in information seeking. The emergence of the term, interactive information retrieval, the amount of research conducted under that rubric, and the lack of agreement about how to conduct and evaluate such research, testify to both the significance and the difficulty of addressing this new goal. In this new context, IR faces daunting challenges, including: understanding why people engage in information seeking; identifying aspects of that condition that need to be considered in supporting them in achieving their goals; designing support for evolving user goals and knowledge; and, perhaps most daunting, how to evaluate, in ways as rigorous and successful as IR evaluation has been to date, IR systems which attempt to address this broader goal. I, and others, have proposed that moving from relevance to usefulness as the main criterion for evaluation of IR system performance, could provide a basis for addressing many of these challenges. In this paper, I discuss how such a move might be implemented, some possible alternative means for addressing this broader goal for IR, and what serious attention to users of IR systems, and their interactions with information objects and systems, could mean for research and practice of IR.

[1]  R. Tagliacozzo Estimating the satisfaction of information users. , 1977, Bulletin of the Medical Library Association.

[2]  Robert N. Oddy,et al.  INFORMATION RETRIEVAL THROUGH MAN‐MACHINE DIALOGUE , 1977 .

[3]  Nicholas J. Belkin,et al.  Distributed expert problem treatment as a model for information system analysis and design , 1982 .

[4]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part I. Background and Theory , 1997, J. Documentation.

[5]  Nicholas J. Belkin,et al.  Using problem structures for driving human-computer dialogues , 1997, RIAO.

[6]  Nicholas J. Belkin,et al.  Research on information interaction and intelligent information provision mechanisms , 1986, J. Inf. Sci..

[7]  Karen Spärck Jones A Look Back and a Look Forward , 1988, SIGIR Forum.

[8]  Louise T. Su Evaluation Measures for Interactive Information Retrieval , 1992, Inf. Process. Manag..

[9]  Nicholas J. Belkin,et al.  Interaction with Texts: Information Retrieval as Information-Seeking Behavior , 1993, Information Retrieval.

[10]  Nicholas J. Belkin,et al.  Intelligent Information Retrieval: Whose Intelligence? , 1996, ISI.

[11]  Louise T. Su Value of Search Results as a Whole as the Best Single Measure of Information Retrieval Performance , 1998, Inf. Process. Manag..

[12]  Nicholas J. Belkin,et al.  A faceted approach to conceptualizing tasks in information seeking , 2008, Inf. Process. Manag..

[13]  Susan T. Dumais An interdisciplinary perspective on information retrieval , 2009, SIGIR.

[14]  J. Liu,et al.  Usefulness as the Criterion for Evaluation of Interactive Information Retrieval , 2009 .

[15]  Nicholas J. Belkin,et al.  On the evaluation of interactive information retrieval systems , 2010 .

[16]  Nicholas J. Belkin,et al.  An exploration of the relationships between work task and interactive information search behavior , 2010, J. Assoc. Inf. Sci. Technol..

[17]  Jacek Gwizdka,et al.  Search behaviors in different task types , 2010, JCDL '10.

[18]  J. Schneider,et al.  The Janus Faced Scholar: A Festschrift in Honour of Peter Ingwersen , 2010 .

[19]  Jacek Gwizdka,et al.  Task and user effects on reading patterns in information search , 2011, Interact. Comput..

[20]  Nicholas J. Belkin,et al.  Exploring and predicting search task difficulty , 2012, CIKM '12.

[21]  Nicholas J. Belkin,et al.  Rutgers at the TREC 2012 Session Track , 2012, TREC.

[22]  Jingjing Liu,et al.  Personalizing information retrieval for multi‐session tasks: Examining the roles of task stage, task type, and topic knowledge on the interpretation of dwell time as an indicator of document usefulness , 2015, J. Assoc. Inf. Sci. Technol..

[23]  Chirag Shah,et al.  User Activity Patterns During Information Search , 2015, ACM Trans. Inf. Syst..