Automated Question Answering From Videos : NLP vs . Pattern Matching

We have explored the feasibility of automated question answering from video material used in conjunction with PowerPoint slides. We have tested separately and combined two recently becoming popular approaches to question answering: 1) the approach based on deep Natural Language parsing and 2) a self-learning probabilistic pattern matching approach. The advantages and shortcomings of each of the approach are discussed. We present the results of the comparison and our qualitative observations.

[1]  Marios C. Angelides,et al.  Developing Knowledge-Based Intelligent Multimedia Tutoring Systems Using Semantic Content-Based Modelling , 2004, Artificial Intelligence Review.

[2]  Sanda M. Harabagiu,et al.  FALCON: Boosting Knowledge for Answer Engines , 2000, TREC.

[3]  Helsinki Taggers and Parsers for English , 2000, Corpora Galore.

[4]  Ellen M. Voorhees,et al.  Building a question answering test collection , 2000, SIGIR '00.

[5]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[6]  Martin M. Soubbotin,et al.  Use of Patterns for Detection of Likely Answer Strings: A Systematic Approach , 2002, TREC.

[7]  Dmitri Roussinov,et al.  Web Question Answering: Technology and Business Applications , 2004, AMCIS.

[8]  Ellen M. Voorhees,et al.  The TREC-8 Question Answering Track Report , 1999, TREC.

[9]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[10]  Jimmy J. Lin,et al.  Web question answering: is more always better? , 2002, SIGIR '02.

[11]  Grace Hui Yang,et al.  VideoQA: question answering on news video , 2003, MULTIMEDIA '03.

[12]  Jay F. Nunamaker,et al.  A natural language approach to content-based video indexing and retrieval for interactive e-learning , 2004, IEEE Transactions on Multimedia.

[13]  Harold A. Linstone,et al.  Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis: R.J. Lempert, S.W. Popper, and S.C. Bankes, Santa Monica, CA, The RAND Corporation, 2003 , 2004 .

[14]  D. Finegold.  Book and Resource Reviews , 2005 .