Conversational Browsing

How can we better understand the mechanisms behind multi-turn information seeking dialogues? How can we use these insights to design a dialogue system that does not require explicit query formulation upfront as in question answering? To answer these questions, we collected observations of human participants performing a similar task to obtain inspiration for the system design. Then, we studied the structure of conversations that occurred in these settings and used the resulting insights to develop a grounded theory, design and evaluate a first system prototype. Evaluation results show that our approach is effective and can complement query-based information retrieval approaches. We contribute new insights about information-seeking behavior by analyzing and providing automated support for a type of information-seeking strategy that is effective when the clarity of the information need and familiarity with the collection content are low.

[1]  Dan Brickley,et al.  Google Dataset Search: Building a search engine for datasets in an open Web ecosystem , 2019, WWW.

[2]  Marcia J. Bates,et al.  Information search tactics , 1979, J. Am. Soc. Inf. Sci..

[3]  Antoine Raux,et al.  The Dialog State Tracking Challenge , 2013, SIGDIAL Conference.

[4]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[5]  Yi Zhang,et al.  Personalized interactive faceted search , 2008, WWW.

[6]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[7]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part I. Background and Theory , 1997, J. Documentation.

[8]  David Ellis,et al.  A Behavioural Approach to Information Retrieval System Design , 1989, J. Documentation.

[9]  Robert S. Taylor.  Question-Negotiation and Information Seeking in Libraries , 1968, Coll. Res. Libr..

[10]  Gary Marchionini,et al.  Synthesis Lectures on Information Concepts, Retrieval, and Services , 2009 .

[11]  Filip Radlinski,et al.  A Theoretical Framework for Conversational Search , 2017, CHIIR.

[12]  Charles L. A. Clarke,et al.  Exploring Conversational Search With Humans, Assistants, and Wizards , 2017, CHI Extended Abstracts.

[13]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[14]  M. de Rijke,et al.  Message Passing for Complex Question Answering over Knowledge Graphs , 2019, CIKM.

[15]  C. Humby,et al.  Process Mining: Data science in Action , 2014 .

[16]  Jianfeng Gao,et al.  Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access , 2016, ACL.

[17]  Prasetya Utama,et al.  Voice-based Data Exploration : Chatting with your Database , 2017 .

[18]  Nicholas J. Belkin,et al.  A case for interaction: a study of interactive information retrieval behavior and effectiveness , 1996, CHI.

[19]  Guillaume Bouchard,et al.  Interpretation of Natural Language Rules in Conversational Machine Reading , 2018, EMNLP.

[20]  Sebastian Neumaier,et al.  Talking Open Data , 2017, ESWC.

[21]  Wil M. P. van der Aalst,et al.  Process Mining , 2016, Springer Berlin Heidelberg.

[22]  Carol Collier Kuhlthau,et al.  Inside the search process: Information seeking from the user's perspective , 1991, J. Am. Soc. Inf. Sci..

[23]  M. de Rijke,et al.  Conversational Exploratory Search via Interactive Storytelling , 2017, ArXiv.

[24]  Matthias Hagen,et al.  Query session detection as a cascade , 2011, CIKM '11.

[25]  Vadim Savenkov,et al.  TableQA: Question Answering on Tabular Data , 2017, SEMANTiCS.

[26]  Vadim Bulitko,et al.  Interactive Narrative: An Intelligent Systems Approach , 2012, AI Mag..

[27]  Nicholas J. Belkin,et al.  Iterative exploration, design and evaluation of support for query reformulation in interactive information retrieval , 2001, Inf. Process. Manag..

[28]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[29]  Vadim Savenkov,et al.  Open Data Chatbot , 2019, ESWC.

[30]  Karl Gyllstrom,et al.  A comparison of query and term suggestion features for interactive searching , 2009, SIGIR.

[31]  Oliver Lemon,et al.  Natural Language Generation as Incremental Planning Under Uncertainty: Adaptive Information Presentation for Statistical Dialogue Systems , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[32]  Johanna D. Moore,et al.  Information Presentation in Spoken Dialogue Systems , 2006, EACL.

[33]  Donna K. Harman,et al.  Towards Interactive Query Expansion , 1988, SIGIR Forum.

[34]  Bruce L. Bachelder,et al.  A Theory of Intelligence: I. Span and the Complexity of Stimulus Control. , 1977 .

[35]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[36]  Dana McKay,et al.  Manoeuvres in the Dark: Design Implications of the Physical Mechanics of Library Shelf Browsing , 2017, CHIIR.

[37]  Denis G. Fedorenko,et al.  Avoiding Echo-Responses in a Retrieval-Based Conversation System , 2017, ArXiv.

[38]  Antoine Raux,et al.  The Dialog State Tracking Challenge Series: A Review , 2016, Dialogue Discourse.

[39]  Bert F. Green,et al.  Baseball: an automatic question-answerer , 1899, IRE-AIEE-ACM '61 (Western).

[40]  Daniel Schwabe,et al.  Frameworks for Information Exploration - A Case Study , 2015, IESD@ISWC.

[41]  Rubén San-Segundo-Hernández,et al.  Methodology for dialogue design in telephone-based spoken dialogue systems: a Spanish train information system , 2001, INTERSPEECH.

[42]  Percy Liang,et al.  Know What You Don’t Know: Unanswerable Questions for SQuAD , 2018, ACL.

[43]  Danielle S. McNamara,et al.  Predicting Text Comprehension, Processing, and Familiarity in Adult Readers: New Approaches to Readability Formulas , 2017, Discourse Processes.

[44]  Maarten de Rijke,et al.  Report on the DATA: SEARCH'18 workshop - Searching Data on the Web , 2019, SIGF.

[45]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part II. Results of a Design Study , 1982, J. Documentation.

[46]  James Allan,et al.  Effective and efficient user interaction for long queries , 2008, SIGIR '08.

[47]  Robert N. Oddy,et al.  INFORMATION RETRIEVAL THROUGH MAN‐MACHINE DIALOGUE , 1977 .

[48]  M. de Rijke,et al.  QRFA: A Data-Driven Model of Information-Seeking Dialogues , 2018, ECIR.

[49]  J. Boger,et al.  Interactive search through iterative refinement , 2018 .

[50]  Tsung-Hsien Wen,et al.  Neural Belief Tracker: Data-Driven Dialogue State Tracking , 2016, ACL.

[51]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[52]  Elena Paslaru Bontas Simperl,et al.  A Query Log Analysis of Dataset Search , 2017, ICWE.

[53]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[54]  Lihong Li,et al.  Neural Approaches to Conversational AI , 2019, Found. Trends Inf. Retr..

[55]  Jürgen Umbrich,et al.  Open Data Hopes and Fears: Determining the Barriers of Open Data , 2017, 2017 Conference for E-Democracy and Open Government (CeDEM).

[56]  Ryen W. White,et al.  Exploratory Search: Beyond the Query-Response Paradigm , 2009, Exploratory Search: Beyond the Query-Response Paradigm.

[57]  G. Harry McLaughlin,et al.  SMOG Grading - A New Readability Formula. , 1969 .

[58]  Sander J. J. Leemans,et al.  Process and Deviation Exploration with Inductive Visual Miner , 2014, BPM.

[59]  Mark Sanderson,et al.  How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis , 2017, CHIIR.

[60]  Ian Ruthven,et al.  Re-examining the potential effectiveness of interactive query expansion , 2003, SIGIR.

[61]  Elena Paslaru Bontas Simperl,et al.  The Trials and Tribulations of Working with Structured Data: -a Study on Information Seeking Behaviour , 2017, CHI.

[62]  Xu Chen,et al.  Towards Conversational Search and Recommendation: System Ask, User Respond , 2018, CIKM.