Macaw: An Extensible Conversational Information Seeking Platform

Conversational information seeking (CIS) has been recognized as a major emerging research area in information retrieval. Such research will require data and tools, to allow the implementation and study of conversational systems. This paper introduces Macaw, an open-source framework with a modular architecture for CIS research. Macaw supports multi-turn, multi-modal, and mixed-initiative interactions, and enables research for tasks such as document retrieval, question answering, recommendation, and structured data exploration. It has a modular design to encourage the study of new CIS algorithms, which can be evaluated in batch mode. It can also integrate with a user interface, which allows user studies and data collection in an interactive mode, where the back end can be fully algorithmic or a wizard of oz setup. Macaw is distributed under the MIT License.

[1]  Jason Weston,et al.  Reading Wikipedia to Answer Open-Domain Questions , 2017, ACL.

[2]  Christopher Joseph Pal,et al.  Towards Deep Conversational Recommendations , 2018, NeurIPS.

[3]  Daniel McDuff,et al.  MISC: A data set of information-seeking conversations , 2017 .

[4]  W. Bruce Croft,et al.  Joint Modeling and Optimization of Search and Recommendation , 2018, DESIRES.

[5]  Yi Zhang,et al.  Conversational Recommender System , 2018, SIGIR.

[6]  Filip Radlinski,et al.  Coached Conversational Preference Elicitation: A Case Study in Understanding Movie Preferences , 2019, SIGdial.

[7]  Hamed Zamani,et al.  Learning a Joint Search and Recommendation Model from User-Item Interactions , 2020, WSDM.

[8]  Eunsol Choi,et al.  QuAC: Question Answering in Context , 2018, EMNLP.

[9]  W. Bruce Croft,et al.  Indri: A language-model based search engine for complex queries1 , 2005 .

[10]  Paul Thomas,et al.  Data Sets for Spoken Conversational Search , 2019, BIIRRR@CHIIR.

[11]  Hamed Zamani,et al.  Analyzing and Predicting News Popularity in an Instant Messaging Service , 2019, SIGIR.

[12]  Filip Radlinski,et al.  A Theoretical Framework for Conversational Search , 2017, CHIIR.

[13]  M. de Rijke,et al.  Pyndri: A Python Interface to the Indri Search Engine , 2017, ECIR.

[14]  Danqi Chen,et al.  CoQA: A Conversational Question Answering Challenge , 2018, TACL.

[15]  W. Bruce Croft,et al.  Asking Clarifying Questions in Open-Domain Information-Seeking Conversations , 2019, SIGIR.

[16]  Emine Yilmaz,et al.  Research Frontiers in Information Retrieval Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018) , 2018 .

[17]  Jeff Dalton,et al.  Vote Goat: Conversational Movie Recommendation , 2018, SIGIR.

[18]  Xu Chen,et al.  Towards Conversational Search and Recommendation: System Ask, User Respond , 2018, CIKM.