论文信息 - A method for evaluating answers by comparing semantic information in a question and answer interaction

A method for evaluating answers by comparing semantic information in a question and answer interaction

In this paper we describe a method for evaluating the validity of answers to questions related to the surface contents of a story in English in order to appropriately ascertain the learner’s comprehension state as part of a language learning tool. Since our interactive question and answer tool allows the input of free-form answers written in natural language, it is necessary to judge the validity of an answer by comparing semantic information in the answer text to that present in the story. As well as identifying discrepancies in these sets of semantic information and checking for the appropriateness of insertions, omissions, and substitutions in the response, our evaluation method attempts to eliminate ambiguities in the natural language processing results. In this paper we also present the results of an investigation into the range of answers to which our response judgment method is applicable as a means of evaluating the method. © 2007 Wiley Periodicals, Inc. Syst Comp Jpn, 38(7): 84–97, 2007; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/scj.20432

Tsukasa Hirashima | Hidenobu Kunichika | Akira Takeuchi | Minoru Honda

[1] Tsukasa Hirashima,et al. A Definition of Complexity of Questions for Question and Answer and its Evaluation , 2002 .

[2] Maureen Murphy,et al. Learner Modelling for Intelligent CALL , 1997 .

[3] Hidenobu Kunichika,et al. Hypermedia English Learning Environment Based on Language Understanding and Error Origin Identification (Special Issue on Intelligent CAI and Hypermedia) , 1994 .

[4] Akira Nagai,et al. Template-Automaton-Based ILTS for Japanese-English Composition , 2001 .

[5] H. Brown,et al. Principles of Language Learning and Teaching , 1980 .

[6] David H. D. Warren,et al. Definite Clause Grammars for Language Analysis - A Survey of the Formalism and a Comparison with Augmented Transition Networks , 1980, Artif. Intell..

[7] Lori S. Levin,et al. ALICE-chan: A Case Study in ICALL Theory and Practice , 1995 .

[8] Tsukasa HIRASHIMA,et al. A Method to Resolve Ambiguity of Interpretation of English Sentences for Intelligent English Learning Support Systems , 2003 .

[9] Tsukasa Hirashima,et al. A Method of Judgment by Comparing Answer Sentences with Expected Correct Answers for Questions and Answers in CALL , 2004 .