Evaluating the integration of fuzzy logic into the student model of a web-based learning environment

In this paper, we evaluate the effectiveness and accuracy of the student model of a web-based educational environment for teaching computer programming. Our student model represents the learner's knowledge through an overlay model and uses a fuzzy logic technique in order to define and update the student's knowledge level of each domain concept, each time that s/he interacts with the e-learning system. Evaluation of the student model of an Intelligent Tutoring System (ITS) is an aspect for which there are not clear guidelines to be provided by literature. Therefore, we choose to use two well-known evaluation methods for the evaluation of our fuzzy student model, in order to design an accurate and correct evaluation methodology. These evaluation models are: the Kirkpatrick's model and the layered evaluation method. Our system was used by the students of a postgraduate program in the field of Informatics in the University of Piraeus, in order to learn how to program in the programming language C. The results of the evaluation were very encouraging.

[1]  Mohammad Bagher Menhaj,et al.  A Systematic Fuzzy Decision-Making Process to Choose the Best Model Among a Set of Competing Models , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Francesco Ricci,et al.  Understanding Recommender Systems : Experimental Evaluation Challenges , 2003 .

[3]  Vladan Devedzic.  Semantic Web and education , 2006 .

[4]  Loc Nguyen,et al.  Learner Model in Adaptive Learning , 2008 .

[5]  José-Luis Pérez-de-la-Cruz,et al.  Bayesian networks for student model engineering , 2010, Comput. Educ..

[6]  Olga C. Santos,et al.  Providing Dynamic Instructional Adaptation in Programming Learning , 2008, HAIS.

[7]  Nor Azan Mat Zin,et al.  Adaptive Educational Hypermedia System using Cognitive style approach: Challenges and opportunities , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[8]  Cristina Gena,et al.  Methods and techniques for the evaluation of user-adaptive systems , 2005, The Knowledge Engineering Review.

[9]  João Gama,et al.  An Adaptive Predictive Model for Student Modeling , 2006 .

[10]  Feng Wang,et al.  E-learning Behavior Analysis Based on Fuzzy Clustering , 2009, 2009 Third International Conference on Genetic and Evolutionary Computing.

[11]  Dragan Gasevic,et al.  Student modeling and assessment in intelligent tutoring of software patterns , 2012, Expert Syst. Appl..

[12]  Rob Phillips,et al.  Approaches to evaluating the effect of ICT on student learning , 2002 .

[13]  Marija J. Norusis,et al.  SPSS 16.0 Statistical Procedures Companion , 2003 .

[14]  Antonija Mitrovic,et al.  Using Evaluation to Shape ITS Design: Results and Experiences with SQL-Tutor , 2002, User Modeling and User-Adapted Interaction.

[15]  Vincent P. Wade,et al.  The evaluation of adaptive and personalised information retrieval systems: a review , 2011, Int. J. Knowl. Web Intell..

[16]  Cristina Gena,et al.  Usability Engineering for the Adaptive Web , 2007, The Adaptive Web.

[17]  Dragan Gasevic,et al.  Evaluating an Intelligent Tutoring System for Design Patterns: the DEPTHS Experience , 2009, J. Educ. Technol. Soc..

[18]  George D. Magoulas,et al.  Personalizing the Interaction in a Web-based Educational Hypermedia System: the case of INSPIRE , 2003, User Modeling and User-Adapted Interaction.

[19]  Russell V. Lenth,et al.  SPSS 12.0 Statistical Procedures Companion , 2005 .

[20]  Ramon Fabregat,et al.  User Integral Model in Adaptive Virtual Learning Environment , 2008 .

[21]  Gerhard Weber,et al.  User Modeling and Adaptive Navigation Support in WWW-Based Tutoring Systems , 1997 .

[22]  Athanasios Drigas,et al.  Decade Review (1999-2009): Artificial Intelligence Techniques in Student Modeling , 2009, WSKS.

[23]  Yavuz Akbulut,et al.  Adaptive educational hypermedia accommodating learning styles: A content analysis of publications from 2000 to 2011 , 2012, Comput. Educ..

[24]  Markus A. Thies.  Adaptive User Interfaces , 1994, IFIP Congress.

[25]  Paulo Alves,et al.  Case-Based Reasoning Approach to Adaptive Web-Based Educational Systems , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[26]  Loc Nguyen,et al.  Combination of Bayesian Network and Overlay Model in User Modeling , 2009, iJET.

[27]  Leon Sterling,et al.  Applying Agent Technology to Evaluation Tasks in e-Learning Environments , 2003 .

[28]  Shiou-Wen Yeh,et al.  Designing an adaptive web-based learning system based on students' cognitive styles identified online , 2012, Comput. Educ..

[29]  Carla Limongelli,et al.  Adaptive Learning with the LS-Plan System: A Field Evaluation , 2009, IEEE Transactions on Learning Technologies.

[30]  Eurico Carrapatoso,et al.  User Modeling in Adaptive Hypermedia Educational Systems , 2008, J. Educ. Technol. Soc..

[31]  Analía Amandi,et al.  eTeacher: Providing personalized assistance to e-learning students , 2008, Comput. Educ..

[32]  G. H.Shakouri,et al.  Implementation of a hybrid fuzzy system as a decision support process: A FAHP-FMCDM-FIS composition , 2012, Expert Syst. Appl..

[33]  D. Kirkpatrick.  Techniques for evaluating training programs , 1979 .

[34]  Antonija Mitrovic,et al.  Towards a negotiable student model for constraint-based ITSs , 2009 .

[35]  Peter Brusilovsky,et al.  Layered evaluation of adaptive learning systems , 2004 .

[36]  Kinshuk,et al.  A practical student model for a location-aware and context-sensitive Personalized Adaptive Learning System , 2010, 2010 International Conference on Technology for Education.

[37]  Elizabeth Boyle,et al.  The Evaluation of Adaptive Systems , 1990 .

[38]  Joachim Meyer,et al.  The Evaluation of In-Vehicle Adaptive Systems , 2005 .

[39]  Konstantina Chrysafiadi,et al.  Modeling Student’s Knowledge on Programming Using Fuzzy Techniques , 2010 .

[40]  David N. Chin.  Empirical Evaluation of User Models and User-Adapted Systems , 2001, User Modeling and User-Adapted Interaction.

[41]  Tzu-Chien Liu,et al.  Analysis of learners' navigational behaviour and their learning styles in an online course , 2010, J. Comput. Assist. Learn..

[42]  Peter Brusilovsky,et al.  User Models for Adaptive Hypermedia and Adaptive Educational Systems , 2007, The Adaptive Web.

[43]  Slavomir Stankov,et al.  Controlled experiment replication in evaluation of e-learning system's educational influence , 2009, Comput. Educ..

[44]  Seref Sagiroglu,et al.  A web based adaptive educational system , 2007, Sixth International Conference on Machine Learning and Applications (ICMLA 2007).

[45]  Z. Sevarac.  Neuro Fuzzy Reasoner for Student Modeling , 2006 .

[46]  Stephan Weibelzahl,et al.  Evaluating the Inference Mechanism of Adaptive Learning Systems , 2003, User Modeling.