Scenarios in information seeking and information retrieval research: A methodological application and discussion

Abstract Scenario has been used as a research tool to study information seeking and information retrieval. This review of the nature and development of scenario use reveals a variety of applications and a number of practical methodological issues. While scenarios have a number of advantages, there are limitations. Consideration of these advantages and challenges leads to recommendations for constructing and presenting scenarios.

[1]  Edie Rasmussen,et al.  Evaluating interactive systems in TREC , 1996 .

[2]  Christian Kay,et al.  The Oxford English Dictionary Online , 2004, Lit. Linguistic Comput..

[3]  Andrew Sears,et al.  Human-Computer Interaction: Development Process , 2009 .

[4]  Noriko Kando,et al.  How Task Types and User Experiences Affect Information-Seeking Behavior on the Web: Using Eye-tracking and Client-side Search Logs , 2009, UIIR@SIGIR.

[5]  M. Herskovits.  The Hypothetical Situation: A Technique of Field Research , 1950, Southwestern Journal of Anthropology.

[6]  Richard J. Whiddett,et al.  New Zealanders’ attitudes towards access to their electronic health records: Preliminary results from a national study using vignettes , 2009, Health Informatics J..

[7]  Joan Giesecke.  Scenario Planning and Collection Development , 1999 .

[8]  Christine Urquhart,et al.  Nurses' information-seeking skills and perceptions of information sources: assessment using vignettes , 1994, J. Inf. Sci..

[9]  J. Piaget.  The Moral Judgment of the Child , 1932 .

[10]  H. H. Anderson,et al.  An introduction To Projective Techniques , 1951 .

[11]  Yan Zhang,et al.  The impact of task complexity on people's mental models of MedlinePlus , 2012, Inf. Process. Manag..

[12]  Ryen W. White,et al.  A task-oriented study on the influencing effects of query-biased summarisation in web searching , 2003, Inf. Process. Manag..

[13]  Jeonghyun Kim.  Describing and predicting information-seeking behavior on the Web , 2009 .

[14]  S. Hirsh.  Children's Relevance Criteria and Information Seeking on Electronic Resources , 1999, J. Am. Soc. Inf. Sci..

[15]  Ian Ruthven,et al.  The emotional impact of search tasks , 2010, IIiX.

[16]  Dania Bilal,et al.  Perspectives on children's navigation of the World Wide Web: does the type of search task make a difference? , 2002, Online Inf. Rev..

[17]  Nicholas J. Belkin,et al.  Evaluating an integrated system supporting multiple information-seeking strategies , 2010 .

[18]  Preben Hansen,et al.  Effects of foreign language and task scenario on relevance assessment , 2005, J. Documentation.

[19]  E. Renold,et al.  The use of vignettes in qualitative research , 1999 .

[20]  Gary Marchionini,et al.  Examining the effectiveness of real-time query expansion , 2007, Inf. Process. Manag..

[21]  C. Jeffries,et al.  Comparing Vignette Instruction and Assessment Tasks to Classroom Observations and Reflections , 2011 .

[22]  Joemon M. Jose,et al.  Effectiveness of additional representations for the search result presentation on the web , 2008, Inf. Process. Manag..

[23]  Daniel M. Russell,et al.  Assigned tasks are not the same as self-chosen Web search tasks , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[24]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[25]  Paul Solomon.  Children, technology, and instruction: A case study of elementary school children using an online catalog (OPAC) , 1994 .

[26]  Yunjie Xu,et al.  Novelty and topicality in interactive information retrieval , 2008 .

[27]  Ryen W. White,et al.  An implicit feedback approach for interactive information retrieval , 2006, Inf. Process. Manag..

[28]  James Weber,et al.  Scenarios in Business Ethics Research: Review, Critical Assessment, and Recommendations , 1992, Business Ethics Quarterly.

[29]  G. Marchionini,et al.  Awareness in collaborative information seeking , 2010, J. Assoc. Inf. Sci. Technol..

[30]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[31]  Jeonghyun Kim,et al.  Task as a Context of Information Seeking: An Investigation of Daily Life Tasks on the Web , 2008 .

[32]  S. Hannabuss.  Scenario planning for libraries , 2001 .

[33]  C. J. van Rijsbergen,et al.  Incorporating user search behavior into relevance feedback , 2003, J. Assoc. Inf. Sci. Technol..

[34]  Donald H. Kraft,et al.  Experimental and quasi-experimental designs for research in information science , 1984, Inf. Process. Manag..

[35]  Joemon M. Jose,et al.  How users assess Web pages for information seeking , 2005, J. Assoc. Inf. Sci. Technol..

[36]  Janice Redish,et al.  Task analysis , 2002 .

[37]  Ryen W. White,et al.  A study of interface support mechanisms for interactive information retrieval , 2006 .

[38]  H. Becker,et al.  The Use of Vignettes in Survey Research , 1978 .

[39]  Joemon M. Jose,et al.  Spatial querying for image retrieval: a user-oriented evaluation , 1998, SIGIR '98.

[40]  Yuling Pan,et al.  The Use of Vignettes in Evaluating Multilingual Questionnaires 1 , 2009 .

[41]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[42]  Peter Ingwersen,et al.  Searchers' relevance judgments and criteria in evaluating web pages in a learning style perspective , 2008, IIiX.

[43]  Christine Urquhart,et al.  Using vignettes to diagnose information seeking strategies: opportunities and possible problems for information use studies of health professionals , 1999 .

[44]  Anne Aula,et al.  How does search behavior change as search becomes more difficult? , 2010, CHI.

[45]  Dorothy Williams,et al.  Teachers' approaches to finding and using research evidence: an information literacy perspective , 2007 .

[46]  Nicholas J. Belkin,et al.  An exploration of the relationships between work task and interactive information search behavior , 2010 .

[47]  Joemon M. Jose,et al.  Exploring Results Organisation for Image Searching , 2005, INTERACT.

[48]  Dong Wang,et al.  Order effect in relevance judgment , 2008 .

[49]  J. Gwizdka,et al.  The role of subjective factors in the information search process , 2009 .

[50]  Peter Ingwersen,et al.  The development of a method for the evaluation of interactive information retrieval systems , 1997, J. Documentation.

[51]  Robert L. Campbell,et al.  WILL THE REAL SCENARIO PLEASE STAND UP? , 1992, ACM SIGCHI Bull..

[52]  J. Finch.  The Vignette Technique in Survey Research , 1987 .

[53]  Ben Shneiderman,et al.  Users can change their web search tactics: Design guidelines for categorized overviews , 2008, Inf. Process. Manag..

[54]  Carol F. Landry,et al.  Work roles, tasks, and the information behavior of dentists , 2006 .

[55]  Youngok Choi,et al.  The communication of meaning and the structuration of expectations: Giddens' “structuration theory” and Luhmann's “self-organization” , 2010 .

[56]  Andrew Thatcher,et al.  Web search strategies: The influence of Web experience and task type , 2008, Inf. Process. Manag..

[57]  Bonnie A. Nardi,et al.  The use of scenarios in design , 1992, SGCH.

[58]  D. Gould.  Using vignettes to collect data for nursing research studies: how valid are the findings? , 1996, Journal of clinical nursing.

[59]  Ardion Beldad,et al.  Reading the least read? Indicators of users' intention to consult privacy statements on municipal websites , 2010, Gov. Inf. Q..

[60]  Pia Borlund,et al.  Experimental components for the evaluation of interactive information retrieval systems , 2000, J. Documentation.

[61]  G. Jasso,et al.  Do Values Matter?An Analysis of Advance Directives for Medical Treatment , 1999 .

[62]  Karen E. Fisher,et al.  Making Sense of an Information World: The Everyday‐Life Information Behavior of Preteens , 2009, The Library Quarterly.

[63]  Peter Demian,et al.  Effects of granularity of search results on the relevance judgment behavior of engineers: Building systems for retrieval and understanding of context , 2010 .

[64]  Joemon M. Jose,et al.  An Ostensive Browsing and Searching on the Web , 2007, CIR.

[65]  Xin Fu.  Towards a model of implicit feedback for Web search , 2010 .

[66]  Christine Urquhart,et al.  Understanding student information behavior in relation to electronic information services: Lessons from longitudinal monitoring and evaluation, Part 1 , 2007 .

[67]  M. Huby,et al.  The application of vignettes in social and nursing research. , 2002, Journal of advanced nursing.

[68]  Nils Pharo.  The effect of granularity and order in XML element retrieval , 2008, Inf. Process. Manag..

[69]  Mary Stansbury,et al.  Results of a factorial survey investigating the health information seeking behaviors of older adults , 2009, ASIST.

[70]  E. Goyder,et al.  Meeting the educational needs of people at risk of diabetes‐related amputation: a vignette study with patients and professionals , 2005, Health expectations : an international journal of public participation in health care and health policy.

[71]  Joette Stefl-Mabry,et al.  A social judgment analysis of information source preference profiles: An exploratory study to empirically represent media selection patterns , 2003, J. Assoc. Inf. Sci. Technol..

[72]  Alesia Zuccalá,et al.  Open access and civic scientific information literacy , 2010, Inf. Res..