Learners automated evaluation with the ODALA approach

We present in this paper ODALA approach (Ontology-Driven Auto-evaluation for e-Learning Approach) for an automated evaluation of the learners state of knowledge. The context considered is Computer Based Human Learning Environnement (CBHLE) in a self-learning by doing mode. This approach, that we put in work and test in the setting of a self-learning system for an algorithmic language, is founded on the representation of the teaching domain as domain ontology on the one hand and on errors classification and detection on the other hand. The evaluation process that we recommend is structured in four stages, starting from the learner solution form analysis (that consists at this step of our research to a lexico-syntactic analysis) and finish with the update of the learner model, while passing by a semantic analysis and a marking process. After a brief introduction of the main aspects raising of the CBHLE domain to which we refer here, we develop our approach of the learners evaluation problem, while especially insisting on its independence of the teaching domain and on the possibility to take in account answers to open questions, freely built by the learner. We also present, at the end, the results of the algorithmic self-learning system development, where the main stages of our evaluation approach are implemented.

[1]  Christine Michel,et al.  Génération de documents d'évaluation des connaissances pour l'e-learning , 2003 .

[2]  Jean-Marc Labat EIAH : Quel retour d'informations pour le tuteur ? , 2002 .

[3]  Ryan Shaun Joazeiro de Baker,et al.  Detecting Student Misuse of Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[4]  Jean-François Nicaud,et al.  Automatic Calculation of Students' Conceptions in Elementary Algebra from Aplusix Log Files , 2006, Intelligent Tutoring Systems.

[5]  Amel Bouzeghoub,et al.  Un modèle de description sémantique des ressources pédagogiques basé sur une ontologie de domaine , 2005 .

[6]  Roger Nkambou,et al.  Hierarchical Representation and Evaluation of the Student in an Intelligent Tutoring System , 2002, Intelligent Tutoring Systems.

[7]  John S. Brown Steps Toward a Theoretical Foundation for Complex, Knowledge-based CAI. , 1975 .

[8]  Stéphanie Jean-Daubias PEPITE : un système d’assistance au diagnostic de compétences en algèbre , 2000 .

[9]  John R. Anderson,et al.  The LISP tutor: it approaches the effectiveness of a human tutor , 1985 .

[10]  William Lewis Johnson,et al.  Intention-based diagnosis of errors in novice programs (program understanding, debugging, intelligent computer-aided instruction) , 1986 .

[11]  Mark L. Miller,et al.  Structured Planning and Debugging: A Linguistic Theory of Design. AI Memo 387. , 1976 .

[12]  Pascal Leroux,et al.  Raisonner sur la trace : analyse de sessions avec l'application ROBOTEACH , 1997 .

[13]  Dominique Py Dominique Py : Environnements interactifs d’apprentissage et démonstration en géométrie, HDR en informatique de l’université de Rennes I, 5 juillet 2001 , 2001 .

[14]  Lee A. Gladwin,et al.  Intention-Based Diagnosis of Novice Programming Errors , 1987, IEEE Expert.

[15]  Heidi J. C. Ellis,et al.  An Assessment of a Self-Directed Learning Approach in a Graduate Web Application Design and Development Course , 2007, IEEE Transactions on Education.

[16]  Stéphanie Jean Stéphanie Jean, PÉPITE : un système d’assistance au diagnostic de compétences, Thèse en informatique de l’université du Maine, 21 janvier 2000 , 2000 .

[17]  Magdalena Wolska,et al.  Handling Errors in Mathematical Formulas , 2006, Intelligent Tutoring Systems.

[18]  Joël Bisault,et al.  Le mémoire en IUFM, théorie et pratique , 1995 .

[19]  Etienne Wenger,et al.  Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge , 1987 .

[20]  Sébastien L'haire,et al.  Diagnostic d´erreurs dans le projet FreeText , 2003 .

[21]  Derek H. Sleeman,et al.  Modelling Student's Problem Solving , 1981, Artif. Intell..

[22]  Valéry Psyché,et al.  Apport de l'ingénierie ontologique aux environnements de formation à distance , 2003 .