A Study on the Possibility of Automatically Estimating the Confidence Value of Students' Knowledge in Generated Conceptual Models

We propose a new metric to automatically evaluate the confidence that a student knows a certain concept included in his or her conceptual model. The conceptual model is defined as a simplified representation of the concepts and relationships among them that a student keeps in his or her mind about an area of knowledge. Each area of knowledge comprises several topics and each topic several concepts. Each concept can be identified by a term that the students should use. A concept can belong to one topic or to several topics. Terms are automatically extracted from the answers provided to an automatic and adaptive free-text scoring system using Machine Learning techniques. In fact, the conceptual model is fully generated from the answers provided by the students to this system. In the paper, the automatic procedure that makes it possible is reviewed in detail. Finally, concept maps are used to graphically display the conceptual model to teachers and students. In this way, they can instantly see which concepts have already been assimilated and which ones should still be reviewed.

[1]  Enrique Alfonseca,et al.  On the Dynamic Adaptation of Computer Assisted Assessment of Free-Text Answers , 2006, AH.

[2]  Vania Dimitrova,et al.  CourseVis: Externalising Student Information to Facilitate Instructors in Distance Learning , 2003 .

[3]  Jim E. Greer,et al.  Externalising Learner Modelling Representations , 2001 .

[4]  E. Yalow.  Educational psychology: A cognitive view. 2nd ed. , 1978 .

[5]  Martin Chodorow,et al.  Automated Scoring Using A Hybrid Feature Identification Technique , 1998, ACL.

[6]  Diana Pérez-Marín,et al.  Automatic Identification of Terms for the Generation of Students' Concept Maps , 2007 .

[7]  Marcus Specht,et al.  Flexible Navigation Support in the WINDS Learning Environment for Architecture and Design , 2004, AH.

[8]  E. Yalow.  On Educational psychology: A cognitive view. , 1979 .

[9]  M. Araceli Ruiz-Primo,et al.  Examining Concept Maps as an Assessment Tool , 2004 .

[10]  Tom Mitchell,et al.  Towards robust computerised marking of free-text responses , 2002 .

[11]  C A Nelson,et al.  Learning to Learn , 2017, Encyclopedia of Machine Learning and Data Mining.

[12]  Antonio Moreno-Sandoval,et al.  Automatic Generation of Students’ Conceptual Models Underpinned by Free-Text Adaptive Computer Assisted Assessment , 2006 .

[13]  Li-Hsuan Hsu,et al.  Concept maps as an assessment tool in a nursing course. , 2005, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[14]  Andreas Meier,et al.  Learner Modeling in iClass , 2005 .

[15]  Peter W. Foltz,et al.  The intelligent essay assessor: Applications to educational technology , 1999 .

[16]  J. Novak.  The Theory Underlying Concept Maps and How To Construct Them , 2004 .

[17]  Valerie J. Shute,et al.  Formative Evaluation of an Automated Knowledge Elicitation and Organization Tool , 2003 .

[18]  John W. Coffey.  LEO: A Concept Map Based Course Visualization Tool for Instructors and Students , 2005, Knowledge and Information Visualization.

[19]  Vania Dimitrova,et al.  STyLE-OLM: Interactive Open Learner Modelling , 2003, Int. J. Artif. Intell. Educ..

[20]  Ana Arruarte,et al.  Modelado de Grupos en Actividades de Aprendizaje Basado en Mapas Conceptuales , 2004 .

[21]  Robert Williams,et al.  Automatically grading essays with markit , 2004 .

[22]  Manuel Freire,et al.  A graph-based interface to complex hypermedia structure visualization , 2004, AVI.

[23]  David Leake,et al.  Managing, Mapping, and Manipulating Conceptual Knowledge* , 1999 .

[24]  William Wresch,et al.  The Imminence of Grading Essays by Computer-25 Years Later , 1993 .

[25]  Robert Williams,et al.  E-TESTER: A computer-based Tool for Auto-generated Question and Answer Assessment , 2005 .

[26]  Almudena Ballester,et al.  Combining statistics on n-grams for automatic term recognition , 2002, LREC.