Metrics-based evaluation of learning object reusability

This paper aims to help in the selection of reusable educational materials from repositories on the web, developing an indicator of the reusability of learning objects. For this purpose, our research will be carried out in three stages. The first, based on previous studies in this area, will determine those aspects that influence reusability. The second will define a set of metrics that measure those aspects using metadata. The third will propose different methods of aggregation in order to obtain a single resulting value and evaluate the efficiency of the model by analyzing a significant set of learning objects obtained from the eLera and Merlot repositories. The results obtained suggest that the proposed indicator could provide useful information when searching for learning objects in repositories. This reusability measurement could constitute an indicator of quality, which would allow search results to be ordered, with those with the greatest possibility of being reused taking priority. Furthermore, the proposed reusability indicator could be calculated automatically or in an assisted way if metadata elements satisfy the minimum quality requisites identified.

[1]  David Preston,et al.  A framework for culture influence Virtual Learning Environments trust , 2008, 2008 Third International Conference on Digital Information Management.

[2]  Frank Benneker.  A quick scan on possibilities for automatic metadata generation , 2006 .

[3]  Ralph Cafolla,et al.  Project MERLOT: Bringing Peer Review to Web-Based Educational Resources , 2006 .

[4]  Ralf Steinmetz,et al.  Improving Retrieval of Reusable Learning Resources by Estimating Adaptation Effort , 2007, LODE.

[5]  Erik Duval,et al.  Relevance Ranking Metrics for Learning Objects , 2007, IEEE Transactions on Learning Technologies.

[6]  Lorna M. Campbell,et al.  Evaluating learning resources for reusability: the "dner & learning objects" study , 2002, ASCILITE.

[7]  Robert L. Glass,et al.  A structure-based critique of contemporary computing research , 1995, J. Syst. Softw..

[8]  John C. Nesbit,et al.  Learning Object Evaluation: Computer-Mediated Collaboration And Inter-Rater Reliability , 2003 .

[9]  Norm Friesen,et al.  Open Educational Resources: New Possibilities for Change and Sustainability , 2009 .

[10]  Erik Duval,et al.  Learning technology standardization: Making sense of it all , 2004, Comput. Sci. Inf. Syst..

[11]  Pithamber R. Polsani,et al.  Use and Abuse of Reusable Learning Objects , 2006, J. Digit. Inf..

[12]  Mike Sosteric,et al.  When is a Learning Object not an Object: A first step towards a theory of learning objects , 2002 .

[13]  Carmel McNaught,et al.  Learning object evaluation and reuse: A Hong Kong experience , 2011 .

[14]  Dehua Yang,et al.  Customizable distance learning: criteria for developing learning objects and learning model templates , 2005, ICEC '05.

[15]  Ana Isabel Jiménez-Zarco,et al.  Improving hypermedia teaching resources – new designs for e-learning environments , 2009 .

[16]  Miguel-Angel Sicilia,et al.  On the Concepts of Usability and Reusability of Learning Objects , 2003 .

[17]  Jeffrey S. Poulin,et al.  Measuring software reuse - principles, practices, and economic models , 1996 .

[18]  David Wiley,et al.  Connecting learning objects to instructional design theory: A definition, a metaphor, and a taxonomy , 2000 .

[19]  Rob Koper,et al.  Combining reusable learning resources and services to pedagogical purposeful units of learning , 2003 .

[20]  Richard G. Baraniuk,et al.  Peer Review Anew: Three Principles and a Case Study in Postpublication Quality Assurance , 2008, Proceedings of the IEEE.

[21]  Letha H. Etzkorn,et al.  Automated reusability quality analysis of OO legacy software , 2001, Inf. Softw. Technol..

[22]  Erik Duval,et al.  The Ariadne knowledge pool system , 2001, CACM.

[23]  John Huddlestone,et al.  Learning object reuse - a four tier model , 2005 .

[24]  John C. Nesbit,et al.  Collaborative evaluation of learning objects , 2012 .

[25]  Allison Littlejohn,et al.  Reusing Online Resources: A Sustainable Approach to E-Learning , 2003 .

[26]  Stephen Downes.  Learning Objects: Resources For Distance Education Worldwide , 2001 .

[27]  Shari Lawrence Pfleeger,et al.  Software Metrics , 1991 .

[28]  Erik Duval,et al.  Measuring Learning Object Reuse , 2008, EC-TEL.

[29]  Salvador Sánchez Alonso,et al.  Quality Metrics in Learning Objects , 2007, MTSR.

[30]  Tom Boyle,et al.  Design principles for authoring dynamic, reusable learning objects , 2003, ASCILITE.

[31]  Riina Vuorikari,et al.  An Overview of Learning Object Repositories , 2009, Database Technologies: Concepts, Methodologies, Tools, and Applications.

[32]  Vive Kumar,et al.  Rating learning object quality with distributed Bayesian belief networks: the why and the how , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[33]  Pamela Taylor Northrup,et al.  Learning Objects for Instruction: Design and Evaluation , 2007 .

[34]  Steve Vinoski.  Old Measures for New Services , 2005, IEEE Internet Comput..

[35]  Griff Richards.  Writing to be read - Readability Indices for Open Educational Resources , 2007, LODE.

[36]  Kevin Palmer,et al.  Learning Object Reusability - Motivation, Production and Use , 2004 .

[37]  Athanasios Manitsaris,et al.  A Fine-Grained Metric System for the Completeness of Metadata , 2009, MTSR.

[38]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[39]  Elena García Barriocanal,et al.  Preliminary Explorations on the Statistical Profiles of Highly-Rated Learning Objects , 2009, MTSR.

[40]  Judith Barnard,et al.  A new reusability metric for object-oriented software , 1998, Software Quality Journal.

[41]  Erik Duval,et al.  Quantitative Analysis of Learning Object Repositories , 2008, IEEE Transactions on Learning Technologies.

[42]  Jean-Luc Marichal,et al.  An axiomatic approach of the discrete Choquet integral as a tool to aggregate interacting criteria , 2000, IEEE Trans. Fuzzy Syst..

[43]  J. Barzilai.  Deriving weights from pairwise comparison matrices , 1997 .

[44]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[45]  Pasi Silander,et al.  Criteria for pedagogical reusability of learning objects enabling adaptation and individualised learning processes , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[46]  Permanand Mohan,et al.  A model for evaluating learning objects , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[47]  Rory McGreal.  Online Education Using Learning Objects , 2004 .

[48]  Robin Kay,et al.  Evaluating the learning in learning objects , 2007 .

[49]  Mehwish Riaz,et al.  A systematic review of software maintainability prediction and metrics , 2009, ESEM 2009.