Common Conversational Community Prototype: Scholarly Conversational Assistant

This paper discusses the potential for creating academic resources (tools, data, and evaluation approaches) to support research in conversational search, by focusing on realistic information needs and conversational interactions. Specifically, we propose to develop and operate a prototype conversational search system for scholarly activities. This Scholarly Conversational Assistant would serve as a useful tool, a means to create datasets, and a platform for running evaluation challenges by groups across the community. This article results from discussions of a working group at Dagstuhl Seminar 19461 on Conversational Search.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  Editors , 1986, Brain Research Bulletin.

[3]  James Allan,et al.  Frontiers, challenges, and opportunities for information retrieval: Report from SWIRL 2012 the second strategic workshop on information retrieval in Lorne , 2012, SIGF.

[4]  James Allan,et al.  Frontiers, Challenges, and Opportunities for Information Retrieval , 2012 .

[5]  Diego Reforgiato Recupero,et al.  Conference Live: Accessible and Sociable Conference Semantic Data , 2015, WWW.

[6]  Johanne R. Trippas.  Spoken Conversational Search: Speech-only Interactive Information Retrieval , 2016, CHIIR.

[7]  Mark Sanderson,et al.  How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis , 2017, CHIIR.

[8]  Filip Radlinski,et al.  A Theoretical Framework for Conversational Search , 2017, CHIIR.

[9]  Martin Halvey,et al.  Conceptualizing agent-human interactions during the conversational search process , 2018 .

[10]  Fernando Diaz,et al.  Research Frontiers in Information Retrieval: Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018) , 2018, SIGF.

[11]  Jeff Dalton,et al.  Vote Goat: Conversational Movie Recommendation , 2018, SIGIR.

[12]  Emine Yilmaz,et al.  Research Frontiers in Information Retrieval Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018) , 2018 .

[13]  Jimmy J. Lin,et al.  Evaluation-as-a-Service for the Computational Sciences , 2018, ACM J. Data Inf. Qual..

[14]  Waleed Ammar,et al.  GrapAL: Connecting the Dots in Scientific Literature , 2019, ACL.

[15]  Waleed Ammar,et al.  GrapAL: Querying Semantic Scholar's Literature Graph , 2019, ArXiv.

[16]  Johanne R. Trippas,et al.  Spoken Conversational Search: Audio-only Interactive Information Retrieval , 2019 .

[17]  Sören Auer,et al.  Open Research Knowledge Graph: Next Generation Infrastructure for Semantic Scholarly Knowledge , 2019, K-CAP.

[18]  Benno Stein,et al.  TIRA Integrated Research Architecture , 2019, Information Retrieval Evaluation in a Changing World.

[19]  Svitlana Vakulenko,et al.  Knowledge-based Conversational Search , 2019, ArXiv.

[20]  Martha Larson,et al.  Continuous Evaluation of Large-Scale Information Access Systems: A Case for Living Labs , 2019, Information Retrieval Evaluation in a Changing World.

[21]  M. de Rijke,et al.  QRFA: A Data-Driven Model of Information-Seeking Dialogues , 2018, ECIR.

[22]  Krisztian Balog,et al.  Personal Knowledge Graphs: A Research Agenda , 2019, ICTIR.

[23]  Iryna Gurevych,et al.  When is ACL's Deadline? A Scientific Conversational Agent , 2019, ArXiv.

[24]  Jing Zhang,et al.  AMiner: Search and Mining of Academic Social Networks , 2019, Data Intelligence.

[25]  M. D. Rijke,et al.  Information Retrieval Evaluation in a Changing World: Lessons Learned from 20 Years of CLEF , 2019, Information Retrieval Evaluation in a Changing World.

[26]  Hideo Joho,et al.  Towards a Model for Spoken Conversational Search , 2019, Inf. Process. Manag..

[27]  Hamed Zamani,et al.  Macaw: An Extensible Conversational Information Seeking Platform , 2019, SIGIR.