Sustainability requirements for eLearning systems: a systematic literature review and analysis

AbstracteLearning systems have become a very important part of teaching, both as web-based systems for online education and as auxiliary tools for face-to-face study, where they provide an additional learning support for on-campus learners. To insure the sustainability of an eLearning system on both individual and social levels, we have to cover many aspects of sustainability requirements: human, technical, economic, and environmental. This paper provides a systematic literature review of the sustainability meta-requirements for eLearning systems to identify open problems and to present the state of the art of this research area. We analysed 124 papers, so we identified 18 high-level sustainability requirements for eLearning systems.

[1]  Un Desa.  Transforming our world : The 2030 Agenda for Sustainable Development , 2016 .

[2]  Allison Littlejohn,et al.  Sustainable e-Learning: Toward a Coherent Body of Knowledge , 2013, J. Educ. Technol. Soc..

[3]  Ardis Hanson,et al.  Distance learning , 2003 .

[4]  Chen-Chung Liu,et al.  Making classrooms socio-technical environments for supporting collaborative learning: the role of personal devices and boundary objects , 2009, CSCL.

[5]  Zehra Akyol,et al.  Role of instructional technology in the transformation of higher education , 2009, J. Comput. High. Educ..

[6]  D. Bourn,et al.  Global perspectives: aligning agendas? , 2009 .

[7]  Vincent P. Wade,et al.  Service-Oriented E-Learning Platforms: From Monolithic Systems to Flexible Services , 2007, IEEE Internet Computing.

[8]  Giuseppe Procaccianti,et al.  Four-Dimensional Sustainable E-Services , 2014, EnviroInfo.

[9]  Anders D. Olofsson,et al.  “Whatever Happened to the Social Dimension?” Aspects of Learning in a Distance-based Teacher Training Programme , 2005, Education and Information Technologies.

[10]  Ian N. Toppin,et al.  Virtual schools: The changing landscape of K-12 education in the U.S. , 2015, Education and Information Technologies.

[11]  Bland Tomkinson,et al.  Online PBL: a route to sustainability education? , 2012 .

[12]  Daphne Halkias,et al.  Distance education in support of lifelong learning: the case of the hellas alive web platform in building Greek language learning communities , 2008 .

[13]  P. James.  Urban Sustainability in Theory and Practice: Circles of sustainability , 2014 .

[14]  G. A. Meneses.  Design of an electronic instrumentation virtual laboratory based on free-open resources , 2011, 2011 6th Colombian Computing Congress (CCC).

[15]  Jared Keengwe,et al.  Factors influencing technology planning in developing countries: A literature review , 2013, Education and Information Technologies.

[16]  Giuseppina Passiante,et al.  Industry-University Learning Network to create competences for intelligent and sustainable manufacturing: A case study , 2012, 2012 International Conference on Information Technology Based Higher Education and Training (ITHET).

[17]  Coral Calero,et al.  Sustainability and Quality: Icing on the Cake , 2013, RE4SuSy@RE.

[18]  Dowming Yeh,et al.  What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction , 2008, Comput. Educ..

[19]  Patricia Lago,et al.  Creating Environmental Awareness in Service Oriented Software Engineering , 2010, ICSOC Workshops.

[20]  Iwona Miliszewska,et al.  Critical Success Attributes of Transnational IT Education Programmes: The Client Perspective , 2011, J. Inf. Technol. Educ. Res..

[21]  Michael Goul,et al.  A Reference Model for Sustainable E-Learning Service Systems:Experiences With the Joint University/Teradata Consortium , 2010 .

[22]  Laurel Evelyn Dyson,et al.  Advancing the m-learning research agenda for active, experiential learning: Four case studies , 2009 .

[23]  Alberto L. Sangiovanni-Vincentelli,et al.  Education and training challenges in the era of Cyber-Physical Systems: beyond traditional engineering , 2015, WESE.

[24]  Rita C. Richey.  Reflections on the 2008 AECT Definitions of the Field , 2008 .

[25]  Vladimir Trajkovik,et al.  Establishing videoconferencing infrastructure in R. Macedonia , 2010, 2010 9th International Conference on Information Technology Based Higher Education and Training (ITHET).

[26]  Nikolaos Pellas,et al.  Bolstering the quality and integrity of online collaborative university- level courses via an open Sim standalone server in conjunction with sloodle , 2016, Education and Information Technologies.

[27]  Rebecca Gould,et al.  K-State's Distributed Learning Commons: Achieving Long-Term Sustainability Through Strategic Partnerships , 2010 .

[28]  Giuseppina Passiante,et al.  Developing the next generation of engineers for intelligentand sustainable manufacturing: A case study , 2013 .

[29]  Saad A. Mahdi,et al.  E-learning and its Impact to the Educational System in the Arab World , 2009, 2009 International Conference on Information Management and Engineering.

[30]  Miladin Stefanovic,et al.  The objectives, architectures and effects of distance learning laboratories for industrial engineering education , 2013, Comput. Educ..

[31]  C. Guetl,et al.  E-Learning Ecosystem (ELES) - A Holistic Approach for the Development of more Effective Learning Environment for Small-and-Medium Sized Enterprises (SMEs) , 2007, 2007 Inaugural IEEE-IES Digital EcoSystems and Technologies Conference.

[32]  Tomi Winfree,et al.  Learning for Low Carbon Living: The Potential of Mobile Learning Applications for Built Environment Trades and Professionals in Australia , 2017 .

[33]  Martin Memmel.  Interoperability Requirements for a Sustainable Component to Support Management and Sharing of Digital Resources , 2011 .

[34]  Yigit Kazancoglu,et al.  A Fuzzy Logic-Based Qfd To Identify Key Factors Of E-Learning Design , 2011 .

[35]  Hui-Min Ko.  Soft Power: A Critical Factor for the Effectiveness and Development of a School , 2012, NPC.

[36]  Jose Jesus Castro-Schez,et al.  Designing and developing software for educative virtual laboratories with language processing techniques: Lessons learned in practical experiments , 2012 .

[37]  D. Dinevski.  Open educational resources and lifelong learning , 2008, ITI 2008 - 30th International Conference on Information Technology Interfaces.

[38]  M. M. Konting,et al.  Leadership Development for Sustainability of E-Learning , 2012 .

[39]  Vasudeva Varma,et al.  Systemic Requirements of a Software Engineering Learning Environment , 2015, ISEC.

[40]  Anshuman Khare,et al.  Athabasca University Reduces ICT Carbon Footprint , 2014 .

[41]  Irene Y. L. Chen,et al.  The factors influencing members' continuance intentions in professional virtual communities — a longitudinal study , 2007, J. Inf. Sci..

[42]  Graham Attwell,et al.  Personal Learning Environments - the future of eLearning? , 2007 .

[43]  Paul Kim,et al.  Pocket School: Exploring mobile technology as a sustainable literacy education option for underserved indigenous children in Latin America , 2008 .

[44]  Gilly Salmon,et al.  Flying Not Flapping: A Strategic Framework for E-Learning and Pedagogical Innovation in Higher Education Institutions , 2005 .

[45]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[46]  Winnie O'Grady,et al.  Repurposing learning objects: a sustainable alternative? , 2005 .

[47]  Tore Dybå,et al.  Evidence-based software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[48]  Qinghua Zheng,et al.  An E-learning Ecosystem Based on Cloud Computing Infrastructure , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[49]  M. B. Srinivas,et al.  E-learning for empowering the rural people in Bangladesh opportunities and challenges , 2013, 2013 Second International Conference on E-Learning and E-Technologies in Education (ICEEE).

[50]  E. Damiani,et al.  The future of E-learning: E-learning ecosystem , 2007, 2007 Inaugural IEEE-IES Digital EcoSystems and Technologies Conference.

[51]  R. Buyya,et al.  Green Cloud Computing and Environmental Sustainability , 2012 .

[52]  Hao Jiang,et al.  Four requirements for digital case study libraries , 2010, Education and Information Technologies.

[53]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2012, Springer Berlin Heidelberg.

[54]  Ayse Basar Bener,et al.  Integrating Environmental Sustainability in Software Product Quality , 2015, RE4SuSy@RE.

[55]  Wendy Bell,et al.  It's installed ... now get on with it! Looking beyond the software to the cultural change , 2005, Br. J. Educ. Technol..

[56]  A. P. Rovai,et al.  Why some distance education programs fail while others succeed in a global environment , 2010, Internet High. Educ..

[57]  Venkatesh Choppella,et al.  A Crowdsourcing Approach for Quality Enhancement of eLearning Systems , 2017, ISEC.

[58]  Cristiano Maciel,et al.  Mobile serious game proposal for environmental awareness of children , 2016, 2016 IEEE Frontiers in Education Conference (FIE).

[59]  Zoltan Balogh,et al.  Analysis of students' behaviour in e-learning system , 2011, 2011 Proceedings of the 22nd EAEEIE Annual Conference (EAEEIE).

[60]  Grazia Scoppio,et al.  Mind the gap: Enabling online faculty and instructional designers in mapping new models for quality online courses , 2017, Education and Information Technologies.

[61]  Sun Yongjie,et al.  The Function of the University Libraries in Constructing Lifelong Education System , 2011 .

[62]  Dr. Jan Hylén.  Open Educational Resources: Opportunities and Challenges , 2008 .

[63]  Birgit Penzenstadler,et al.  A generic model for sustainability with process- and product-specific instances , 2013, GIBSE@AOSD.

[64]  Philippe Kruchten.  Lifelong Learning for Lifelong Employment , 2015, IEEE Softw..

[65]  Stephen Potter,et al.  Designing low carbon higher education systems: Environmental impacts of campus and distance learning systems , 2008 .

[66]  Elli Georgiadou,et al.  Distance Learning: Technologies; Enabling Learning at Own Place, Own Pace, Own Time , 2006 .

[67]  A. Fred O'Neil,et al.  The current status of instructional design theories in relation to today's authoring systems , 2008, Br. J. Educ. Technol..

[68]  Mark Nichols,et al.  Institutional perspectives: The challenges of e-learning diffusion , 2008, Br. J. Educ. Technol..

[69]  Zane L. Berge,et al.  Implementing and Sustaining E-Learning in the Workplace , 2006, Int. J. Inf. Commun. Technol. Educ..

[70]  Veikko Louhevaara,et al.  Towards sustainable well-being in SMEs through the web-based learning program of ergonomics , 2011, Education and Information Technologies.

[71]  S. Halimi,et al.  Lifelong Learning for Equity and Social Cohesion: A New Challenge for Higher Education , 2001 .

[72]  F. Amador,et al.  Integrating Sustainability into the University: Past, Present, and Future , 2013 .

[73]  Janet Buchan,et al.  Putting Ourselves in the Big Picture: A Sustainable Approach to Project Management for e-Learning. , 2010 .

[74]  Mario Piattini,et al.  Green in Software Engineering , 2015, Springer International Publishing.

[75]  Joël Fisler,et al.  Creating , Handling and Implementing E-learning Courses Using the Open Source Tools OLAT and eLML at the University of Zurich , 2009 .

[76]  Birgit Penzenstadler,et al.  Infusing Green: Requirements Engineering for Green In and Through Software Systems , 2014, RE4SuSy@RE.

[77]  Stefania Manca,et al.  Implications of social network sites for teaching and learning. Where we are and where we want to go , 2017, Education and Information Technologies.

[78]  Mario Piattini,et al.  Puzzling out Software Sustainability , 2017, Sustain. Comput. Informatics Syst..

[79]  Meg Colasante,et al.  Sustainability of a university designed and developed media annotation tool to prepare learners with skills needed for future employment , 2012 .

[80]  Luvai Motiwalla,et al.  Mobile learning: A framework and evaluation , 2007, Comput. Educ..

[81]  Debra J. Richardson,et al.  Sustainability requirement patterns , 2013, 2013 3rd International Workshop on Requirements Patterns (RePa).

[82]  Monica W. Tracey,et al.  Real World Projects in an Advanced Instructional Design Course , 2008 .

[83]  Ian Robertson,et al.  Sustainable e-learning, activity theory and professional development , 2008 .

[84]  Richard Messnarz,et al.  Using social media as a tool for business improvement and certification of knowledge workers , 2014, J. Softw. Evol. Process..

[85]  Declan Dagger,et al.  Fundamental Requirements of Personalised eLearning Development Environments , 2005 .

[86]  Karma Sherif,et al.  Social capital, knowledge management, and sustained superior performance , 2005, J. Knowl. Manag..

[87]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[88]  Stefanie Betz,et al.  Sustainable Software System Engineering , 2014, 2014 IEEE Fourth International Conference on Big Data and Cloud Computing.

[89]  Murat Ince,et al.  Web-based learning object selection software using analytical hierarchy process , 2014, IET Softw..

[90]  Marcelo Milrad,et al.  Mobile Inquiry Learning in Sweden: Development Insights on Interoperability, Extensibility and Sustainability of the LETS GO Software System , 2014, J. Educ. Technol. Soc..

[91]  Bernd Siebenhüner,et al.  Policy instruments for sustainability-oriented organizational learning , 2007 .

[92]  Daniela Tuparova,et al.  Approaches for competencies assessment in open source e-learning environments , 2014, 2014 IEEE Global Engineering Education Conference (EDUCON).

[93]  Siobhan Corrigan,et al.  A Learning, Training & Mentoring Framework (LTM) & the Role of Serious Games to Facilitate Sustainable Change in the Aviation Industry , 2012 .

[94]  R. Goodland.  The Concept of Environmental Sustainability , 1995 .

[95]  Zane L. Berge,et al.  Strategic Planning for E-Learning in the Workplace , 2008 .

[96]  Imtiaz Ahmad,et al.  A Green Model for Sustainable Software Engineering , 2013 .

[97]  Cathy Gunn,et al.  Sustainability factors for e-learning initiatives , 2010 .

[98]  David E. Pritchard,et al.  Studying Learning in the Worldwide Classroom Research into edX's First MOOC. , 2013 .

[99]  Eric T. G. Wang,et al.  Understanding knowledge sharing in virtual communities: An integration of social capital and social cognitive theories , 2006, Decis. Support Syst..

[100]  Allison Littlejohn,et al.  Supporting sustainable e-learning , 2003 .

[101]  D. Laurillard.  Modelling benefits-oriented costs for technology enhanced learning , 2007 .

[102]  Nikolaos Pellas,et al.  The influence of computer self-efficacy, metacognitive self-regulation and self-esteem on student engagement in online learning programs: Evidence from the virtual world of Second Life , 2014, Comput. Hum. Behav..

[103]  Jose L.R. Sousa,et al.  Information systems architecture modeling based on loosely coupled structures: An e-learning use case , 2011, 2011 9th International Conference on Emerging eLearning Technologies and Applications (ICETA).

[104]  Umer Farooq,et al.  Sustaining a Community Computing Infrastructure for Online Teacher Professional Development: A Case Study of Designing Tapped In , 2007, Computer Supported Cooperative Work (CSCW).

[105]  Jennifer Yorke,et al.  Technology supported learning Tensions between innovation, and control and organisational and professional cultures , 2007 .

[106]  Ingvar Gustavsson,et al.  On Objectives of Instructional Laboratories, Individual Assessment, and Use of Collaborative Remote Laboratories , 2009, IEEE Transactions on Learning Technologies.

[107]  Ingrid Schoenwald.  Sustainable implementation of E-Learning as a change process at universities , 2003 .

[108]  Alex Koohang,et al.  Advancing Sustainability of Open Educational Resources , 2007 .

[109]  Carlos Delgado Kloos,et al.  A Distributed Collaborative System for Flexible Learning Content Production and Management , 2012, J. Res. Pract. Inf. Technol..

[110]  Matthew K. O. Lee,et al.  Understanding the sustainability of a virtual community: model development and empirical test , 2009, J. Inf. Sci..

[111]  Neila Rjaibi,et al.  Deploying Suitable Countermeasures to Solve the Security Problems within an E-learning Environment , 2014, SIN.

[112]  Torbjorn Sund,et al.  Standardization work on personalized eHealth systems , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[113]  Georg Weichhart,et al.  Supporting the evolution and interoperability of organisational models with e-learning technologies , 2015, Annu. Rev. Control..

[114]  Meg Colasante.  Future-focused learning via online anchored discussion, connecting learners with digital artefacts, other learners, and teachers , 2010 .

[115]  Bahtijar Vogel,et al.  Reusability and Interoperability in Mobile Learning: A Study of Current Practices , 2012, 2012 IEEE Seventh International Conference on Wireless, Mobile and Ubiquitous Technology in Education.

[116]  Cathy Urquhart,et al.  Tapping the educational potential of Facebook: Guidelines for use in higher education , 2014, Education and Information Technologies.

[117]  Ivica Crnkovic,et al.  Framing sustainability as a property of software quality , 2015, Commun. ACM.

[118]  Norm Friesen,et al.  Open Educational Resources: New Possibilities for Change and Sustainability , 2009 .

[119]  Utpal M. Dholakia,et al.  What Makes an Open Education Program Sustainable? The Case of Connexions , 2006 .

[120]  Qinghua Zheng,et al.  Big Log Analysis for E-Learning Ecosystem , 2014, 2014 IEEE 11th International Conference on e-Business Engineering.

[121]  Koji Zettsu,et al.  A model for creating and sustaining information services platform communities: Lessons learnt from open source software , 2013, 2013 Proceedings of ITU Kaleidoscope: Building Sustainable Communities.

[122]  Manuel Benito,et al.  iPLE Network: an integrated eLearning 2.0 architecture from a university's perspective , 2010, Interact. Learn. Environ..

[123]  Jyoti S.A. Bhat.  Technological ambidexterity in the management of national infrastructure programmes , 2011 .

[124]  Jon Dron,et al.  Learning Technology through Three Generations of Technology Enhanced Distance Education Pedagogy. , 2012 .

[125]  Manoj Manuja,et al.  Industry academia collaboration model: The design challenges , 2011, 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T).

[126]  Hahn-Ming Lee,et al.  Personalized e-learning system using Item Response Theory , 2005, Comput. Educ..

[127]  Claes Wohlin,et al.  Guidelines for snowballing in systematic literature studies and a replication in software engineering , 2014, EASE '14.

[128]  Mike Kendall,et al.  Lifelong Learning Really Matters for Elementary Education in the 21st Century , 2005, Education and Information Technologies.

[129]  Jennifer Demski.  Rebuilding the LMS for the 21st Century. , 2012 .

[130]  Hoon Choi,et al.  Adaptive open mobile learning device for the underserved , 2009, 2009 Digest of Technical Papers International Conference on Consumer Electronics.

[131]  Stefan Bensch,et al.  Cloud-Based Online Learning Platforms , 2012, BIS.

[132]  Allison Littlejohn,et al.  Reusing Online Resources: A Sustainable Approach to E-Learning , 2003 .

[133]  Hepu Deng,et al.  Critical success factors in e-learning ecosystems: a qualitative study , 2010, J. Syst. Inf. Technol..

[134]  Lalita Rajasingham,et al.  Will Mobile Learning Bring a Paradigm Shift in Higher Education , 2011 .

[135]  Robert A. Ellis.  Students’ approaches to groupwork in a blended course, associations with perceptions of the online environment and academic achievement – when is learning engaged? , 2014, Education and Information Technologies.

[136]  Andrey Petrovich Koshkin,et al.  Monitoring social media: Students satisfaction with university administration activities , 2017, Education and Information Technologies.

[137]  Yianna Vovides,et al.  A Systems Approach to Implementation of eLearning in Medical Education: Five MEPI Schools’ Journeys , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[138]  Lifang Shih,et al.  Use of Sustainable and Systematic Plan to Assess Student Learning Outcomes for Non-Traditional IT Students , 2013 .

[139]  David Hinds,et al.  Engaging E-Learning in Virtual Worlds: Supporting Group Collaboration , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[140]  Mark J. W. Lee,et al.  Pervasive, lifestyle‐integrated mobile learning for distance learners: an analysis and unexpected results from a podcasting study , 2007 .

[141]  Erkki Sutinen,et al.  The Four Pillar Model -Analysing The Sustainability Of Online Doctoral Programmes , 2014 .

[142]  S. Downes.  Models for Sustainable Open Educational Resources , 2007 .

[143]  J. Mark Pullen,et al.  Integrating synchronous and asynchronous internet distributed education for maximum effectiveness , 2006, Education and Information Technologies.

[144]  Rondalynne McClintock,et al.  Educational Edifices Need a Mobile Strategy to Fully Engage in Learning Activities , 2016 .

[145]  Ali Kashif Bashir,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2013, ICIRA 2013.

[146]  Xavier Giró,et al.  The socio-economic dimensions of ICT-driven educational change , 2007, Comput. Educ..

[147]  Dennis Mocigemba,et al.  Sustainable Computing , 2006, Poiesis Prax..

[148]  Khalid Hafeez,et al.  Performance assessment of an e‐learning software system for sustainability , 2013 .

[149]  Chris J Willmore,et al.  Transformative Approaches to Sustainable Development at Universities , 2015 .

[150]  Abdulaziz Alrashidi.  An Exploration of E-Learning Benefits for Saudi Arabia: Toward Policy Reform. , 2013 .

[151]  Elli Georgiadou,et al.  Towards relating delivery methods and examination success: lessons learned from the VALO LLP project case study , 2015, J. Softw. Evol. Process..

[152]  Rosa Maria Bottino.  On-line learning networks: Framework and scenarios , 2007, Education and Information Technologies.

[153]  Rhona Sharpe,et al.  Implementing a university e-learning strategy: levers for change within academic schools , 2006 .

[154]  Susanne Bleisch,et al.  ELML, the E-Lesson Markup Language - Developing Sustainable E-Learning Content Using an Open Source XML Framework , 2006, WEBIST.

[155]  M. Mason.  What Is Complexity Theory and What Are Its Implications for Educational Change? , 2008 .

[156]  Axel van Lamsweerde,et al.  Requirements engineering: from craft to discipline , 2008, SIGSOFT '08/FSE-16.

[157]  Austin A. Nwokediuko.  Advancing e-learning in African native communities: The language factor , 2012, International Conference on Education and e-Learning Innovations.

[158]  Timo Johann,et al.  The GREENSOFT Model: A reference model for green and sustainable software and its engineering , 2011, Sustain. Comput. Informatics Syst..

[159]  Peer Stechert.  Informatics system comprehension: A learner-centred cognitive approach to networked thinking , 2006, Education and Information Technologies.

[160]  Anshuman Khare,et al.  eLearning and the Sustainable Campus , 2015 .

[161]  Ebba Ossiannilsson,et al.  Quality in e-learning - a conceptual framework based on experiences from three international benchmarking projects , 2012, J. Comput. Assist. Learn..