Informing the Design of Spoken Conversational Search: Perspective Paper

We conducted a laboratory-based observational study where pairs of people performed search tasks communicating verbally. Examination of the discourse allowed commonly used interactions to be identi€ed for Spoken Conversational Search (SCS). We compared the interactions to existing models of search behaviour. We €nd that SCS is more complex and interactive than traditional search. ‘is work enhances our understanding of di‚erent search behaviours and proposes research opportunities for an audio-only search system. Future work will focus on creating models of search behaviour for SCS and evaluating these against actual SCS systems.

[1]  Peter Bailey,et al.  User Variability and IR System Evaluation , 2015, SIGIR.

[2]  Nicholas J. Belkin,et al.  Braque: Design of an Interface to Support User Interaction in Information Retrieval , 1993, Inf. Process. Manag..

[3]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[4]  Filip Radlinski,et al.  A Theoretical Framework for Conversational Search , 2017, CHIIR.

[5]  Daniel McDuff,et al.  MISC: A data set of information-seeking conversations , 2017 .

[6]  Ivan Koychev,et al.  Within-Document Retrieval: A User-Centred Evaluation of Relevance Profiling , 2004, Information Retrieval.

[7]  Nicholas J. Belkin,et al.  Using discourse analysis for the design of information retrieval interaction mechanisms , 1983, Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.

[8]  James Allan,et al.  Frontiers, challenges, and opportunities for information retrieval: Report from SWIRL 2012 the second strategic workshop on information retrieval in Lorne , 2012, SIGF.

[9]  N. J. Belkin.  A methodology for taking account of user tasks, goals and behavior for design of computerized library catalogs , 1991, SGCH.

[10]  Adelheit Stein,et al.  Structuring collaborative information-seeking dialogues , 1995, Knowl. Based Syst..

[11]  Adelheit Stein,et al.  Modelling the Illocutionary Aspects of Information-Seeking Dialogues , 1992, Inf. Process. Manag..

[12]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[13]  Robert N. Oddy,et al.  INFORMATION RETRIEVAL THROUGH MAN‐MACHINE DIALOGUE , 1977 .

[14]  Jon Atle Gulla,et al.  User-Tailored Planning of Mixed Initiative Information-Seeking Dialogues , 2004, User Modeling and User-Adapted Interaction.

[15]  Michael F. McTear,et al.  Book Review: Spoken Dialogue Technology: Toward the Conversational User Interface, by Michael F. McTear , 2002, CL.

[16]  Ryen W. White.  Interactions with Search Systems , 2016 .

[17]  Shimei Pan,et al.  Designing and Evaluating an Adaptive Spoken Dialogue System , 2002, User Modeling and User-Adapted Interaction.

[18]  Nicholas J. Belkin,et al.  Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems , 1995 .

[19]  Marilyn A. Walker,et al.  PARADISE: A Framework for Evaluating Spoken Dialogue Agents , 1997, ACL.

[20]  Tony Stockman,et al.  A comparative analysis of the information-seeking behavior of visually impaired and sighted searchers , 2012, J. Assoc. Inf. Sci. Technol..

[21]  Penny J. Daniels,et al.  Cognitive Models in Information Retrieval - an Evaluative Review , 1986, J. Documentation.

[22]  Niels Ole Bernsen,et al.  Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..

[23]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[24]  Tefko Saracevic,et al.  The Stratified Model of Information Retrieval Interaction: Extension and Applications , 1997 .

[25]  Nicholas J. Belkin,et al.  Cognitive models and information transfer , 1984 .

[26]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[27]  Douglas W. Oard.  Query by babbling: a research agenda , 2012, IKM4DR '12.

[28]  Ed H. Chi,et al.  An elaborated model of social search , 2010, Inf. Process. Manag..

[29]  Meredith Ringel Morris,et al.  Collaborative search revisited , 2013, CSCW.

[30]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[31]  David Griol,et al.  The Conversational Interface , 2016 .

[32]  Mark Sanderson,et al.  How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis , 2017, CHIIR.

[33]  Ido Guy,et al.  Searching by Talking: Analysis of Voice Queries on Mobile Web Search , 2016, SIGIR.

[34]  Ravi Kuber,et al.  Should I Trust It When I Cannot See It?: Credibility Assessment for Blind Web Users , 2016, ASSETS.

[35]  Mark S. Ackerman,et al.  The perfect search engine is not enough: a study of orienteering behavior in directed search , 2004, CHI.

[36]  Paul Solomon,et al.  Looking for Information—A Survey of Research on Information Seeking, Needs, and Behavior , 2003, Information Retrieval.

[37]  Regina Barzilay,et al.  Information Fusion in the Context of Multi-Document Summarization , 1999, ACL.