Informing the Design of Spoken Conversational Search: Perspective Paper

We conducted a laboratory-based observational study where pairs of people performed search tasks communicating verbally. Examination of the discourse allowed commonly used interactions to be identified for Spoken Conversational Search (SCS). We compared the interactions to existing models of search behaviour. We find that SCS is more complex and interactive than traditional search. This work enhances our understanding of different search behaviours and proposes research opportunities for an audio-only search system. Future work will focus on creating models of search behaviour for SCS and evaluating these against actual SCS systems.

[1]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[2]  Douglas W. Oard.  Query by babbling: a research agenda , 2012, IKM4DR '12.

[3]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[4]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[5]  James F. Allen,et al.  Draft of DAMSL Dialog Act Markup in Several Layers , 2007 .

[6]  Tony Stockman,et al.  A comparative analysis of the information-seeking behavior of visually impaired and sighted searchers , 2012, J. Assoc. Inf. Sci. Technol..

[7]  Ryen W. White.  Interactions with Search Systems , 2016 .

[8]  Michael F. McTear,et al.  Book Review: Spoken Dialogue Technology: Toward the Conversational User Interface, by Michael F. McTear , 2002, CL.

[9]  Hans-Christoph Hobohm.  Peter Ingwersen, Kalervo Järvelin: The Turn. Integration of Information Seeking and Retrieval in Context , 2007 .

[10]  Ed H. Chi,et al.  An elaborated model of social search , 2010, Inf. Process. Manag..

[11]  Tefko Saracevic,et al.  The Stratified Model of Information Retrieval Interaction: Extension and Applications , 1997 .

[12]  David Griol,et al.  The Conversational Interface: Talking to Smart Devices , 2016 .

[13]  N. J. Belkin.  A methodology for taking account of user tasks, goals and behavior for design of computerized library catalogs , 1991, SGCH.

[14]  Aaron D. Wyner,et al.  A Mathematical Theory of Communication , 1993 .

[15]  Ivan Koychev,et al.  Within-Document Retrieval: A User-Centred Evaluation of Relevance Profiling , 2004, Information Retrieval.

[16]  Ido Guy,et al.  Searching by Talking: Analysis of Voice Queries on Mobile Web Search , 2016, SIGIR.

[17]  Paul Solomon,et al.  Looking for Information—A Survey of Research on Information Seeking, Needs, and Behavior , 2003, Information Retrieval.

[18]  Daniel McDuff,et al.  MISC: A data set of information-seeking conversations , 2017 .

[19]  Shimei Pan,et al.  Designing and Evaluating an Adaptive Spoken Dialogue System , 2002, User Modeling and User-Adapted Interaction.

[20]  Ravi Kuber,et al.  Should I Trust It When I Cannot See It?: Credibility Assessment for Blind Web Users , 2016, ASSETS.

[21]  Mark S. Ackerman,et al.  The perfect search engine is not enough: a study of orienteering behavior in directed search , 2004, CHI.

[22]  Nicholas J. Belkin,et al.  Using discourse analysis for the design of information retrieval interaction mechanisms , 1983, SIGIR '83.

[23]  Robert S. Taylor.  The process of asking questions , 1962 .

[24]  Adelheit Stein,et al.  Structuring collaborative information-seeking dialogues , 1995, Knowl. Based Syst..

[25]  Meredith Ringel Morris,et al.  Collaborative search revisited , 2013, CSCW.

[26]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[27]  James Allan,et al.  Frontiers, challenges, and opportunities for information retrieval: Report from SWIRL 2012 the second strategic workshop on information retrieval in Lorne , 2012, SIGF.

[28]  Nicholas J. Belkin,et al.  Cognitive models and information transfer , 1984 .

[29]  Mark Sanderson,et al.  How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis , 2017, CHIIR.

[30]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[31]  Robert N. Oddy,et al.  INFORMATION RETRIEVAL THROUGH MAN‐MACHINE DIALOGUE , 1977 .

[32]  Nicholas J. Belkin,et al.  Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems , 1995 .

[33]  Regina Barzilay,et al.  Information Fusion in the Context of Multi-Document Summarization , 1999, ACL.

[34]  Adelheit Stein,et al.  Modelling the Illocutionary Aspects of Information-Seeking Dialogues , 1992, Inf. Process. Manag..

[35]  Jon Atle Gulla,et al.  User-Tailored Planning of Mixed Initiative Information-Seeking Dialogues , 2004, User Modeling and User-Adapted Interaction.

[36]  Peter Bailey,et al.  User Variability and IR System Evaluation , 2015, SIGIR.

[37]  Nicholas J. Belkin,et al.  Braque: Design of an Interface to Support User Interaction in Information Retrieval , 1993, Inf. Process. Manag..

[38]  Marilyn A. Walker,et al.  PARADISE: A Framework for Evaluating Spoken Dialogue Agents , 1997, ACL.

[39]  Filip Radlinski,et al.  A Theoretical Framework for Conversational Search , 2017, CHIIR.

[40]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[41]  SaltonGerard,et al.  Term-weighting approaches in automatic text retrieval , 1988 .

[42]  Penny J. Daniels,et al.  Cognitive Models in Information Retrieval - an Evaluative Review , 1986, J. Documentation.

[43]  Niels Ole Bernsen,et al.  Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..