Modeling and Assessing Student Activities in On-Line Discussions

As web-enhanced courses become more successful, they put considerable burdens on instructors and teaching assistants. We present our work on developing software tools to support instructors by automatic assessment of pedagogical discussions. We are developing prototype measures of discussion quality that rely on the quantity of discussion contributions. We are also developing techniques for assessing discussion contributions automatically by mining discussion text. Using information retrieval and natural language processing techniques, our tools learn to detect the conversation focus of threaded discussions, classify topics of discussions, and estimate technical depth of contributions. The results from these assessment tools provide basis for the development of scaffolding and question answering techniques for pedagogical discourse.

[1]  J. J. Rocchio,et al.  Relevance feedback in information retrieval , 1971 .

[2]  Thorsten Joachims,et al.  A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization , 1997, ICML.

[3]  木村 和夫 Pragmatics , 1997, Language Teaching.

[4]  Clifford Nass,et al.  Helper agent: designing an assistant for human-human interaction in a virtual meeting space , 2000, CHI.

[5]  Simon Buckingham Shum Workshop report: computer-supported collaborative argumentation for learning communities , 2000, LINK.

[6]  Arthur C. Graesser,et al.  Teaching Tactics and Dialog in AutoTutor , 2001 .

[7]  Adam Kowalczyk,et al.  Combining clustering and co-training to enhance text classification using unlabelled data , 2002, KDD.

[8]  Daniel Marcu,et al.  Sentence Level Discourse Parsing using Syntactic and Lexical Information , 2003, NAACL.

[9]  Caroline Coffin,et al.  Impacts of directed tutorial activities in computer conferencing: a case study , 2003 .

[10]  Alan M. Lesgold,et al.  A Computational Approach to Analyzing Online Knowledge Sharing Interaction , 2003 .

[11]  Philip S. Yu,et al.  Text Classification by Labeling Words , 2004, AAAI.

[12]  Ingrid Zukerman,et al.  Corpus-based Generation of Easy Help-desk Responses , 2005 .

[13]  Erin Shaw Assessing and Scaffolding Collaborative Learning in Online Discussions , 2005, AIED.

[14]  Fatos Xhafa,et al.  Thread-based analysis of patterns of collaborative interaction in chat , 2005, AIED.

[15]  Jihie Kim,et al.  Learning to Detect Conversation Focus of Threaded Discussions , 2006, NAACL.

[16]  Jihie Kim,et al.  An intelligent discussion-bot for answering student queries in threaded discussions , 2006, IUI '06.

[17]  J. Sadock Speech acts , 2007 .

[18]  Thomas K. Landauer Applications of Latent Semantic Analysis , 2002 .