Implications of the Delphi method in the evaluation of sustainability open education resource repositories

To better understand the sustainable development of open educational resources (OER), this paper aimed to break through the original ‘fixed’, highly structured evaluation system and develop an open and flexible “1 + X” evaluation framework of OER by using the modified Delphi method. “1” refers to the mandatory basic criteria that the repository must reflect essential attributes and core functions, which are consist of four components: information content, learning process, system technology, and user experience. “X” refers to optional distinctive criteria that the repository shall focus on one or more developmental orientations, which may include: resource evolution, international collaboration, inclusiveness and equality, open educational practices, and value-added services. Optional “X” criteria, in line with the criteria’s diversity aims, can lead to the sustainable development of OER and globalized lifelong learning. The framework of this study provides a basis for the evaluation and optimization of existing OER repositories, and also serves as functional scaffolding for the construction of new repositories.

[1]  Sema A. Kalaian,et al.  Which Is the Best Parametric Statistical Method For Analyzing Delphi Data , 2009 .

[2]  I. Tuomi.  Open Educational Resources and the Transformation of Education , 2013 .

[3]  Hugh C. Davis,et al.  Bootstrapping a Culture of Sharing to Facilitate Open Educational Resources , 2010, IEEE Transactions on Learning Technologies.

[4]  Paul Kawachi Frsa.  Quality Assurance for OER : Current State of the Art and the TIPS Framework , 2015 .

[5]  S. Downes.  Models for Sustainable Open Educational Resources , 2007 .

[6]  Carina Bossu,et al.  Equity considerations for open educational resources in the glocalization of education , 2012 .

[7]  Ernesto Priego,et al.  Opening Teaching Landscapes: The Importance of Quality Assurance in the Delivery of Open Educational Resources , 2014, Open Praxis.

[8]  Patrick McAndrew,et al.  Learning the Lessons of Openness , 2012 .

[9]  Nikos Manouselis,et al.  Open educational resources repositories literature review - Towards a comprehensive quality approaches framework , 2015, Comput. Hum. Behav..

[10]  Javiera Atenas,et al.  Questions of quality in repositories of open educational resources: a literature review , 2014 .

[11]  Javiera Atenas,et al.  Quality assurance in the open: an evaluation of OER repositories , 2013 .

[12]  Justin Reich,et al.  The MOOC pivot , 2019, Science.

[13]  Núria Ferran-Ferrer,et al.  Repositories of Open Educational Resources: An Assessment of Reuse and Educational Aspects , 2017 .

[14]  David A. Wiley,et al.  Open Content and Open Educational Resources: Enabling universal education , 2008 .

[15]  David Annand.  Developing a Sustainable Financial Model in Higher Education for Open Educational Resources. , 2015 .

[16]  Jan M. Pawlowski,et al.  State of the Art Review of Quality Issues related to Open Educational Resources (OER) , 2014 .

[17]  Monica VlăźDoiu.  Towards a Quality Model for Open Courseware and Open Educational Resources , 2011, ICWL 2011.

[18]  Li Yan,et al.  Development and evaluation of a new curriculum based on the Delphi method for master of nursing programs in China , 2016 .

[19]  Asha Kanwar,et al.  Toward Sustainable Open Education Resources: A Perspective From the Global South , 2010 .

[20]  Kimmo Laakso,et al.  Using the Delphi method , 2011, 2011 Proceedings of PICMET '11: Technology Management in the Energy Smart World (PICMET).

[21]  Mercedes Gómez-Albarrán,et al.  A Semantically Enriched Context-Aware OER Recommendation Strategy and Its Application to a Computer Science OER Repository , 2014, IEEE Transactions on Education.

[22]  Suzanne D. Pawlowski,et al.  The Delphi method as a research tool: an example, design considerations and applications , 2004, Inf. Manag..

[23]  Ulf-Daniel Ehlers,et al.  Extending the Territory: From Open Educational Resources to Open Educational Practices. , 2011 .

[24]  Dory Cochran,et al.  Enhancing Teaching and Learning: Libraries and Open Educational Resources in the Classroom , 2016 .

[25]  Martin Weller,et al.  OER Evidence Report 2013-2014 , 2014 .

[26]  J. Landeta.  Current validity of the Delphi method in social sciences , 2006 .

[27]  Francisco J. García-Peñalvo,et al.  Open access to educational resources in energy and sustainability: usability evaluation prototype for repositories , 2016, TEEM.

[28]  Deborah C. Simmons,et al.  Developing Low-Income Preschoolers’ Social Studies and Science Vocabulary Knowledge Through Content-Focused Shared Book Reading , 2010 .

[29]  D. Wiley,et al.  Open Educational Resources: A Review of the Literature , 2014 .

[30]  Marshall S. Smith,et al.  The Promise of Open Educational Resources , 2006 .

[31]  Rory McGreal,et al.  Special Report on the Role of Open Educational Resources in Supporting the Sustainable Development Goal 4: Quality Education Challenges and Opportunities , 2017 .