Learning strategies for story comprehension: a reinforcement learning approach

This paper describes the use of machine learning to improve the performance of natural language question answering systems. We present a model for improving story comprehension through inductive generalization and reinforcement learning, based on classified examples. In the process, the model selects the most relevant and useful pieces of lexical information to be used by the inference procedure. We compare our approach to three prior non-learning systems, and evaluate the conditions under which learning is effective. We demonstrate that a learning-based approach can improve upon "matching and extraction"-only techniques.

[1]  Ellen Riloff,et al.  A Rule-based Question Answering System for Reading Comprehension Tests , 2000 .

[2]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[3]  Vibhu O. Mittal,et al.  Bridging the lexical chasm: statistical approaches to answer-finding , 2000, SIGIR '00.

[4]  Roni Khardon,et al.  Learning to Take Actions , 1996, Machine Learning.

[5]  Eric Brill,et al.  Transformation-Based Error-Driven Learning and Natural Language Processing: A Case Study in Part-of-Speech Tagging , 1995, CL.

[6]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[7]  Nils J. Nilsson,et al.  Reacting, Planning, and Learning in an Autonomous Agent , 1996, Machine Intelligence 14.

[8]  Daniel Marcu,et al.  Towards Developing Probabilistic Generative Models for Reasoning with Natural Language Representations , 2005, CICLing.

[9]  Lynette Hirschman,et al.  Deep Read: A Reading Comprehension System , 1999, ACL.

[10]  Craig A. Knoblock Automatically Generating Abstractions for Planning , 1994, Artif. Intell..

[11]  S. Pattinson,et al.  Learning to fly. , 1998 .

[12]  Scott Benson,et al.  Inductive Learning of Reactive Action Models , 1995, ICML.

[13]  Yasemin Altun,et al.  Reading Comprehension Programs in a Statistical-Language-Processing Class , 2000 .

[14]  Prasad Tadepalli,et al.  A Formal Framework for Speedup Learning from Problems and Solutions , 1996, J. Artif. Intell. Res..