Robust Question Answering for Speech Transcripts: UPC Experience in QAst 2008

This paper describes the participation of the Technical University of Catalonia in the CLEF 2009 Question Answering on Speech Transcripts track. We have participated in the English and Spanish scenarios of QAST. For both manual and automatic transcripts we have used a robust factual Question Answering that uses minimal syntactic information. We have also developed a NERC designed to handle automatic transcripts. We perform a detailed analysis of our results and draw conclusions relating QA performance to word error rate and the difference between written and spoken questions.

[1]  Sanda Harabagiu,et al.  High-performance, open-domain question answering from large text collections , 2001 .

[2]  Mihai Surdeanu,et al.  Design and performance analysis of a factoid question answering system for spontaneous speech transcriptions , 2006, INTERSPEECH.

[3]  Dan Roth,et al.  Learning question classifiers: the role of semantic information , 2005, Natural Language Engineering.

[4]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT.

[5]  Paolo Rosso,et al.  Overview of QAST 2009 , 2009, CLEF.

[6]  Xavier Carreras,et al.  Named Entity Extraction using AdaBoost , 2002, CoNLL.

[7]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[8]  Mihai Surdeanu,et al.  Robust Question Answering for Speech Transcripts Using Minimal Syntactic Analysis , 2007, CLEF.

[9]  Pere Comas,et al.  Spoken Document Retrieval Based on Approximated Sequence Alignment , 2008, TSD.

[10]  Pere Comas,et al.  Robust Question Answering for Speech Transcripts: UPC Experience in QAst 2008 , 2008, CLEF.

[11]  Lori Lamel,et al.  Overview of QAST 2008 , 2008, CLEF.

[12]  Carol Peters,et al.  Evaluating Systems for Multilingual and Multimodal Information Access, 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers , 2009, CLEF.

[13]  Carol Peters,et al.  Cross-Language Information Retrieval and Evaluation , 2001, Lecture Notes in Computer Science.