An intelligent discussion-bot for answering student queries in threaded discussions

This paper describes a discussion-bot that provides answers to students' discussion board questions in an unobtrusive and human-like way. Using information retrieval and natural language processing techniques, the discussion-bot identifies the questioner's interest, mines suitable answers from an annotated corpus of 1236 archived threaded discussions and 279 course documents and chooses an appropriate response. A novel modeling approach was designed for the analysis of archived threaded discussions to facilitate answer extraction. We compare a self-out and an all-in evaluation of the mined answers. The results show that the discussion-bot can begin to meet students' learning requests. We discuss directions that might be taken to increase the effectiveness of the question matching and answer extraction algorithms. The research takes place in the context of an undergraduate computer science course.

[1]  Sanda M. Harabagiu,et al.  High performance question/answering , 2001, SIGIR '01.

[2]  Terry Winograd,et al.  A Language/Action Perspective on the Design of Cooperative Work , 1987, SGCH.

[3]  Sanda M. Harabagiu,et al.  The Structure and Performance of an Open-Domain Question Answering System , 2000, ACL.

[4]  Gerald Salton,et al.  Automatic text processing , 1988 .

[5]  Eduard H. Hovy,et al.  Question Answering in Webclopedia , 2000, TREC.

[6]  Eduard Hovy,et al.  Knowledge-Based Question Answering , 2002 .

[7]  Ingrid Zukerman,et al.  Corpus-based Generation of Easy Help-desk Responses , 2005 .

[8]  Cristina Conati,et al.  Building and evaluating an intelligent pedagogical agent to improve the effectiveness of an educational game , 2004, IUI '04.

[9]  Simon Buckingham Shum.  Workshop report: computer-supported collaborative argumentation for learning communities , 2000, LINK.

[10]  Chad S. Carr.  Computer-Supported Collaborative Argumentation : Supporting Problem-based Learning in Legal Education , 2001 .

[11]  Clifford Nass,et al.  Helper agent: designing an assistant for human-human interaction in a virtual meeting space , 2000, CHI.

[12]  Wayne Wobcke,et al.  An agent-based approach to dialogue management in personal assistants , 2005, IUI.

[13]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[14]  Alan M. Lesgold,et al.  A Computational Approach to Analyzing Online Knowledge Sharing Interaction , 2003 .

[15]  Jennifer Chu-Carroll,et al.  Question Answering Using Constraint Satisfaction: QA-By-Dossier-With-Contraints , 2004, ACL.

[16]  Nick Hammond,et al.  Graphical Argumentation and Design Cognition , 1997, Hum. Comput. Interact..

[17]  Siriwan Suebnukarn,et al.  A collaborative intelligent tutoring system for medical problem-based learning , 2004, IUI '04.

[18]  Laurie P. Dringus,et al.  An Investigation of the Effect of Learning Style on Student Success in an Online Learning Environment , 2000 .

[19]  Nick Hammond,et al.  Argumentation-based design rationale: what use at what cost? , 1994, Int. J. Hum. Comput. Stud..

[20]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[21]  Fatos Xhafa,et al.  Thread-based analysis of patterns of collaborative interaction in chat , 2005, AIED.

[22]  Jinxi Xu,et al.  TREC 2003 QA at BBN: Answering Definitional Questions , 2003, TREC.

[23]  Oren Etzioni,et al.  Towards a theory of natural language interfaces to databases , 2003, IUI.

[24]  Oren Etzioni,et al.  A reliable natural language interface to household appliances , 2003, IUI '03.

[25]  Marti A. Hearst.  Multi-Paragraph Segmentation Expository Text , 1994, ACL.

[26]  Erin Shaw.  Assessing and Scaffolding Collaborative Learning in Online Discussions , 2005, AIED.