A Learning Quality Metadata approach: Automatic quality assessment of virtual training from metadata

This paper presents the LQM metadata schema, an extension of the IEEE LOM standard. LQM is capable of registering information related to the quality of virtual education resources. As a complement, we have developed a cataloging and evaluation tool capable of registering LQM metadata and performing the subsequent quality estimation according to UNE 66181:2012. The proposal identifies and describes the dimensions and properties of the LQM element data. The research results show that it is feasible to provide an automatic estimation of quality of digital educational resources using LQM. LQM is a metadata schema based on IEEE LOM which has been expanded with information on quality of educational resources.The quality of virtual education courses cataloged with LQM can be automatically evaluated with the tool LOMPAD-Q.Using metadata for representing the quality of learning objects is a key point for fostering quality in e-learning.

[1]  Hugh C. Davis,et al.  The evolution of metadata from standards to semantics in E-learning applications , 2006, HYPERTEXT '06.

[2]  Erik Duval,et al.  Interoperability for Searching Learning Object Repositories: The ProLearn Query Language , 2008, D Lib Mag..

[3]  Miguel-Angel Sicilia,et al.  On the Concepts of Usability and Reusability of Learning Objects , 2003 .

[4]  U. Ehlers.  Quality in e-Learning from a Learner’s Perspective , 2004, Distances et médiations des savoirs.

[5]  Elena García Barriocanal,et al.  Statistical profiles of highly-rated learning objects , 2011, Comput. Educ..

[6]  Yao-Ting Sung,et al.  Evaluating the reliability and impact of a quality assurance system for E-learning courseware , 2011, Comput. Educ..

[7]  Marti A. Hearst,et al.  Statistical profiles of highly-rated web sites , 2002, CHI.

[8]  Mikael Nilsson,et al.  Semantic Web Meta-data for e-Learning : Some Architectural Guidelines , 2002, WWW 2002.

[9]  Patrick E. Parrish,et al.  The trouble with learning objects , 2004 .

[10]  Miltiadis D. Lytras,et al.  Informal learning in work environments: training with the Social Web in the workplace , 2012, Behav. Inf. Technol..

[11]  Iván Martínez-Ortiz,et al.  Using e-learning standards in educational video games , 2013, Comput. Stand. Interfaces.

[12]  Eugenijus Kurilovas.  Interoperability, Standards and Metadata for E-Learning , 2009, IDC.

[13]  Erik Duval,et al.  Towards Interoperable Learning Object Repositories: The Ariadne Experience , 2003, ICWI.

[14]  Erik Duval,et al.  Reusable learning objects: a survey of LOM-based repositories , 2002, MULTIMEDIA '02.

[15]  Gabriel López-Morteo,et al.  An international analysis of the extensions to the IEEE LOMv1.0 metadata standard , 2013, Comput. Stand. Interfaces.

[16]  Everard van Kemenade,et al.  More Value to Defining Quality , 2008 .

[17]  Ana M. Fernández-Pampillón Cesteros.  Development of a Spanish Standard for Quality Assessment of Digital Educational Material , 2014, IEEE Revista Iberoamericana de Tecnologias del Aprendizaje.

[18]  Marek Hatala,et al.  The interoperability of learning object repositories and services: standards, implementations and lessons learned , 2004, WWW Alt. '04.

[19]  James H. Martin,et al.  Automatically characterizing resource quality for educational digital libraries , 2009, JCDL '09.

[20]  Bernd J. Krämer.  Learning objects: Standards, metadata, repositories, and LCMS - Edited by Keith Harman & Alex Koohang , 2010, Br. J. Educ. Technol..

[21]  Sanjay Misra,et al.  Learning management systems and cloud file hosting services: A study on students' acceptance , 2014, Comput. Hum. Behav..

[22]  Erik Duval,et al.  The Ariadne Infrastructure for Managing and Storing Metadata , 2009, IEEE Internet Computing.

[23]  L. Bermúdez.  Cómo implantar y certificar un sistema de gestión de la calidad en la Universidad , 2008 .

[24]  Jennifer B. Bowen,et al.  Moving Library Metadata Toward Linked Data: Opportunities Provided by the eXtensible Catalog , 2010, Dublin Core Conference.

[25]  Ana María Fernández-Pampillón Cesteros,et al.  Herramienta para la revisión de la Calidad de Objetos de Aprendizaje Universitarios (COdA): guía del usuario. v.1.1 , 2011 .

[26]  Elena García Barriocanal,et al.  Complete metadata records in learning object repositories: some evidence and requirements , 2005, Int. J. Learn. Technol..

[27]  Juan Manuel Dodero,et al.  Metrics-based evaluation of learning object reusability , 2011, Software Quality Journal.

[28]  Erik Duval,et al.  Bridging Repositories to form the MACE Experience , 2008 .

[29]  Francisco J. García-Peñalvo,et al.  Improving LO Quality through Instructional Design Based on an Ontological Model and Metadata , 2007, J. Univers. Comput. Sci..

[30]  Tamara Sumner,et al.  Using Machine Learning to Support Quality Judgments , 2005, D Lib Mag..

[31]  Lorna M. Campbell,et al.  Metadata for learning materials: an overview of existing standards and current developments , 2010 .

[32]  Jan M. Pawlowski,et al.  Handbook on Quality and Standardisation in E-Learning , 2006 .

[33]  Antonia Stefani,et al.  On the quality assessment of advanced e-learning services , 2006, Interact. Technol. Smart Educ..

[34]  Jan M. Pawlowski,et al.  The Quality Adaptation Model: Adaptation and Adoption of the Quality Standard ISO/IEC 19796-1 for Learning, Education, and Training , 2007, J. Educ. Technol. Soc..

[35]  John C. Nesbit,et al.  A Framework for Evaluating the Quality of Multimedia Learning Resources , 2007, J. Educ. Technol. Soc..

[36]  Robin Kay,et al.  A Multi-Component Model for Assessing Learning Objects: The Learning Object Evaluation Metric (LOEM) , 2008 .

[37]  Juan Manuel Dodero,et al.  Ranking Learning Objects through Integration of Different Quality Indicators , 2010, IEEE Transactions on Learning Technologies.

[38]  Achilles Kameas,et al.  Creating a LO Metadata Profile for Distance Learning: An Ontological Approach , 2012, MTSR.

[39]  Margaret Ross,et al.  A quality management based on the Quality Model life cycle , 2012, Comput. Stand. Interfaces.

[40]  Erik Duval,et al.  Relevance Ranking Metrics for Learning Objects , 2007, IEEE Transactions on Learning Technologies.

[41]  Stavros Christodoulakis,et al.  Metadata Management and Sharing in Multimedia Open Learning Environment (MOLE) , 2011, MTSR.

[42]  Michael E. Ward,et al.  Student and Faculty Perceptions of the Quality of Online Learning Experiences , 2010 .

[43]  Luis E. Anido-Rifón,et al.  Educational metadata and brokerage for learning resources , 2002, Comput. Educ..

[44]  Jan Richards,et al.  Authoring Tool Accessibility Guidelines , 1999 .

[45]  Christian M. Stracke,et al.  The Benefits and Future of Standards: Metadata and Beyond , 2010, MTSR.

[46]  Robin Kay,et al.  Evaluating the learning in learning objects , 2007 .

[47]  Mohammad Dastbaz,et al.  Designing metadata for learning and assessment objects , 2010 .

[48]  Mohamed Gamal Aboelmaged,et al.  Six Sigma quality: a structured review and implications for future research , 2010 .

[49]  Norm Friesen,et al.  CanCore: Metadata for Learning Objects , 2002 .