A novel approach to generate MCQs from domain ontology

Ontologies are structures, used for knowledge representation, which model domain knowledge in the form of concepts, roles, instances and their relationships. This knowledge can be exploited by an assessment system in the form of multiple choice questions (MCQs). The existing approaches, which use ontologies expressed in the Web Ontology Language (OWL) for MCQ generation, are limited to simple concept related questions - "What is C?" or "Which of the following is an example of C?" (where C is a concept symbol) - or analogy type questions involving roles. There are no efforts in the literature which make use of the terminological axioms in the ontology such as existential, universal and cardinality restrictions on concepts and roles for MCQ generation. Also, there are no systematic methods for generating incorrect answers (distractors) from ontologies. Distractor generation process has to be given much importance, since the generated distractors determine the quality and hardness of an MCQ. We propose two new MCQ generation approaches, which generate MCQs that are very useful and realistic in conducting assessment tests, and the corresponding distractor generating techniques. Our distractor generation techniques, unlike other methods, consider the open-world assumption, so that the generated MCQs will always be valid (falsity of distractors is ensured). Furthermore, we present a measure to determine the difficulty level (a value between 0 and 1) of the generated MCQs. The proposed system is implemented, and experiments on specific ontologies have shown the effectiveness of the approaches. We also did an empirical study by generating question items from a real-world ontology and validated our results with the help of domain experts.

[1]  Marija Cubric,et al.  Towards automatic generation of e-assessment using semantic web technologies , 2011 .

[2]  Bijan Parsia,et al.  Generating Multiple Choice Questions From Ontologies: Lessons Learnt , 2014, OWLED.

[3]  Andreas Papasalouros,et al.  Automated Transformation of SWRL Rules into Multiple-Choice Questions , 2011, FLAIRS.

[4]  Dennis Doverspike,et al.  THREE‐ALTERNATIVE MULTIPLE CHOICE TESTS: AN ATTRACTIVE OPTION , 1994 .

[5]  Bijan Parsia,et al.  Mining Ontologies for Analogy Questions: A Similarity-based Approach , 2012, OWLED.

[6]  Pierre Zweigenbaum,et al.  Medical question answering: translating medical questions into sparql queries , 2012, IHI '12.

[7]  Slavomir Stankov,et al.  Dynamic test generation over ontology-based knowledge representation in authoring shell , 2009, Expert Syst. Appl..

[8]  Riccardo Albertoni,et al.  Semantic Similarity of Ontology Instances Tailored on the Application Context , 2006, OTM Conferences.

[9]  Ian Horrocks,et al.  Reasoning with Individuals for the Description Logic SHIQ , 2000, CADE.

[10]  Marija Cubric,et al.  SeMCQ – Protégé Plugin for Automatic Ontology-Driven Multiple Choice Question Tests Generation , 2009 .

[11]  Barbara Gross Davis Tools for Teaching. A Publication in the Jossey-Bass Higher and Adult Education Series. , 1993 .

[12]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[13]  Anni-Yasmin Turhan,et al.  A Framework for Semantic-Based Similarity Measures for $\mathcal{ELH}$ -Concepts , 2012, JELIA.

[14]  Claus Pahl,et al.  Adaptive E-learning content generation based on semantic web technology , 2005 .

[15]  Pau Klein,et al.  San Francisco, California , 2007 .

[16]  Bijan Parsia,et al.  A similarity-based theory of controlling MCQ difficulty , 2013, 2013 Second International Conference on E-Learning and E-Technologies in Education (ICEEE).

[17]  B. Davis Tools for Teaching , 1993 .

[18]  Asma Ben Abacha,et al.  Medical Ontology Validation through Question Answering , 2013, AIME.

[19]  Maha Al-Yahya,et al.  Ontology-Based Multiple Choice Question Generation , 2014, TheScientificWorldJournal.

[20]  Andreas Papasalouros,et al.  Automatic Generation Of Multiple Choice Questions From Domain Ontologies , 2008, e-Learning.

[21]  Gert Smolka,et al.  Attributive Concept Descriptions with Complements , 1991, Artif. Intell..