Application of Multiple Criteria Decision Analysis and Optimisation Methods in Evaluation of Quality of Learning Objects

This paper analyses and presents the new scientific models and methods for the expert evaluation of quality of learning objects (LOs) paying special attention to LOs reusability level. Currently all existing approaches in the area are quite subjective and depend only on the experience of the decision-makers. The authors analyse several scientific methods and principles to minimise the subjectivity level in the expert evaluation of LOs quality. They are: (a) the principles of multi-criteria decision analysis for identification of quality criteria, (b) technological quality criteria classification principle, (c) fuzzy group decision making theory to obtain evaluation measures, (d) normalisation of the weights of criteria, and (e) scalarisation method for LOs quality optimisation. The authors demonstrate that the complex application of these approaches could significantly improve the quality of the expert evaluation of LOs and noticeably reduce the level of the expert evaluation subjectivity. The paper also presents the example of practical application of these approaches for evaluation of LOs for Mathematics subject.

[1]  Mehdi Khosrowpour,et al.  Web-Based Instructional Learning , 2002 .

[2]  Theodor J. Stewart,et al.  Multiple Criteria Decision Analysis , 2001 .

[3]  John C. Nesbit,et al.  Learning Object Evaluation: Computer-Mediated Collaboration And Inter-Rater Reliability , 2003 .

[4]  Margaret Haughey,et al.  Evaluating Learning Objects for Schools , 2005 .

[5]  Albertas Caplinskas,et al.  Methodology to Evaluate the Functionality of Specification Languages , 2006, Informatica.

[6]  Ambjörn Naeve,et al.  Establishing technical quality criteria for Learning Objects , 2006 .

[7]  L. Esnault.  International Journal of Web-Based Learning and Teaching Technologies , 2007 .

[8]  John C. Nesbit,et al.  A Framework for Evaluating the Quality of Multimedia Learning Resources , 2007, J. Educ. Technol. Soc..

[9]  Eugenijus Kurilovas.  Digital library of educational resources and services: evaluation of components , 2008 .

[10]  Henda Ben Ghezala,et al.  Evaluation framework based on fuzzy measured method in adaptive learning systems , 2008 .

[11]  A. K. Aggarwal,et al.  Minimal Functionalities of Course Management Systems: A Faculty Perspective , 2009, Int. J. Web Based Learn. Teach. Technol..

[12]  Eugenijus Kurilovas,et al.  Learning Objects and Virtual Learning Environments Technical Evaluation Criteria. , 2009 .

[13]  Eugenijus Kurilovas,et al.  Multiple Criteria Comparative Evaluation of E-Learning Systems and Components , 2009, Informatica.

[14]  Eugenijus Kurilovas.  Learning Objects Reusability and Their Adaptation for Blended Learning , 2009, 2009 Fifth International Conference on Networking and Services.

[15]  Eugenijus Kurilovas.  Interoperability, Standards and Metadata for E-Learning , 2009, IDC.

[16]  Eugenijus Kurilovas.  Evaluation and Optimisation of e-Learning Software Packages: Learning Object Repositories , 2009, 2009 Fourth International Conference on Software Engineering Advances.

[17]  Manuel Ahedo,et al.  Comparing the Principles of Adult Learning with Traditional Pedagogical Teaching in Relation to the Use of Technology: The Tacit Dimension in ICT-Based University Teaching , 2009, Int. J. Web Based Learn. Teach. Technol..

[18]  Iyad Abu Doush,et al.  Automatic Semantic Generation and Arabic Translation of Mathematical Expressions on the Web , 2013, Int. J. Web Based Learn. Teach. Technol..