Towards an automated system for short-answer assessment using ontology mapping

A key concern for any e-assessment tool (computer assisted assessment) is its efficiency in assessing the learner's knowledge, skill set and ability. Multiple-choice questions are the most common means of assessment used in e-assessment systems, and are also successful. An efficient e-assessment system should use variety of question types including short- answers, essays etc. and modes of response to assess learner's performance. In this paper, we consider the task of assessing short-answer questions. Several researches have been performed on the evaluation and assessment of short-answer questions and many products are deployed to assess the same as part of e-learning systems. We propose an automated system for assessing short-answers using ontology mapping. We also compare our approach with some existing systems and give an overall evaluation of experiment results, which shows that our approach using ontology mapping gives an optimized result.

[1]  Evgeniy Gabrilovich,et al.  Wikipedia-based Semantic Interpretation for Natural Language Processing , 2014, J. Artif. Intell. Res..

[2]  M. Kowar,et al.  Extracting Noun Phrases in Subject and Object Roles for Exploring Text Semantics , 2011 .

[3]  Stephen Pulman,et al.  Automarking: using computational linguistics to score short‚ free−text responses , 2003 .

[4]  Martin Zácek,et al.  Knowledge patterns for conversion of sentences in natural language into RDF graph language , 2011, 2011 Federated Conference on Computer Science and Information Systems (FedCSIS).

[5]  Huda Yasin,et al.  Automated Score Evaluation of Unstructured Text using Ontology , 2012 .

[6]  Amit P. Sheth,et al.  A Framework for Schema-Driven Relationship Discovery from Unstructured Text , 2006, SEMWEB.

[8]  Xiang Zhang,et al.  Ontology summarization based on rdf sentence graph , 2007, WWW '07.

[9]  Carlo Strapparava,et al.  Automatic Assessment of Students' Free-Text Answers Underpinned by the Combination of a BLEU-Inspired Algorithm and Latent Semantic Analysis , 2005, FLAIRS Conference.

[10]  Catherine Faron-Zucker,et al.  Semantic Annotation of Texts with RDF Graph Contexts , 2008, ICCS Supplement.

[11]  Sally E. Jordan,et al.  e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback , 2009, Br. J. Educ. Technol..

[12]  Rada Mihalcea,et al.  Text-to-Text Semantic Similarity for Automatic Short Answer Grading , 2009, EACL.

[13]  Isabelle Augenstein,et al.  LODifier: Generating Linked Data from Unstructured Text , 2012, ESWC.

[14]  Marija Cubric,et al.  Towards automatic generation of e-assessment using semantic web technologies , 2011 .

[15]  Ted Briscoe,et al.  Automated assessment of ESOL free text examinations , 2010 .

[16]  Martin Chodorow,et al.  C-rater: Automated Scoring of Short-Answer Questions , 2003, Comput. Humanit..

[17]  De Xu,et al.  Concept vector for semantic similarity and relatedness based on WordNet structure , 2012, J. Syst. Softw..

[18]  Kiran Jyoti,et al.  Automated Assessment of Short One-Line Free-Text Responses In Computer Science , 2012 .

[19]  Steffen Staab,et al.  Text clustering based on good aggregations , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[20]  Angelo Kyrilov,et al.  Automated assessment of short free-text responses in computer science using latent semantic analysis , 2011, ITiCSE '11.

[21]  Stephen G. Pulman,et al.  Automatic Short Answer Marking , 2005, ACL 2005.

[22]  Vivian Chu,et al.  Facilitating pattern discovery for relation extraction with semantic-signature-based clustering , 2011, CIKM '11.

[23]  Christopher D. Manning,et al.  Stanford typed dependencies manual , 2010 .

[24]  Jill Burstein,et al.  AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0 , 2004 .

[25]  Tom Mitchell,et al.  Towards robust computerised marking of free-text responses , 2002 .

[26]  Xinming Hu,et al.  Automated Assessment System for Subjective Questions Based on LSI , 2010, 2010 Third International Symposium on Intelligent Information Technology and Security Informatics.

[27]  Salvatore Valenti,et al.  An Overview of Current Research on Automated Essay Grading , 2003, J. Inf. Technol. Educ..

[28]  Mitsuru Ishizuka,et al.  A Word Sense Disambiguation Approach for Converting Natural Language Text into a Common Semantic Description , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[29]  Arthur C. Graesser,et al.  Lexico-syntactic subsumption for textual entailment , 2007 .

[30]  Rosheena Siddiqi,et al.  Improving Teaching and Learning through Automated Short-Answer Marking , 2010, IEEE Transactions on Learning Technologies.

[31]  Sebastian Rudolph,et al.  Conceptual Knowledge Acquisition Using Automatically Generated Large-Scale Semantic Networks , 2010, ICCS.

[32]  Andrew Y. Ng,et al.  Robust Textual Inference via Graph Matching , 2005, HLT.