A Framework for the Impact of Human Factors on the Effectiveness of Learning Management Systems

Higher education institutions (HEI) have realized the advantages of implementing a blended learning environment by using learning management systems (LMSs) to provide effective ways of learning and teaching. However, recent literature has revealed that developing countries’ educational institutions fail when they adopt LMS technologies because they ignore the human factors related to these technologies. This study investigated the impact of human factors on the effectiveness of LMS in a blended learning environment at Kuwait’s HEIs (KHEIs). In this paper, a pragmatic approach consisting of quantitative and qualitative methods is used. User characteristics traits from the literature review were organized into three main indicators of human impact on the effectiveness of LMS: technological characteristics, psychological characteristics, and student-instructor interaction characteristics. After these indicators were identified, a conceptual model was developed to study the characteristics. A deductive approach was used, and the model was tested for significance through receiving feedback from the universities’ students and faculty members. In addition, an inductive approach was implemented through conducting interviews to explore more factors related to the effectiveness of LMS. The inductive approach’s results revealed the relevant factors for the usage of the LMS, such as training, needs, expectations, and branding. The human factors that positively affect the success and effectiveness of LMS included attitude, enjoyment, experience, self-efficacy, and promptness, which had the most substantial impacts on user satisfaction. The modified conceptual model that this paper presents includes these impacting factors and provides an acceptable fit to the data. This research has developed an updated framework for demonstrating the effectiveness of LMS as it pertains to human factors, and its findings can be used to enhance user experience in a blended learning environment, thus improving the quality of Kuwaiti education.

[1]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[2]  Jan Noyes,et al.  An assessment of the influence of perceived enjoyment and attitude on the intention to use technology among pre-service teachers: A structural equation modeling approach , 2011, Comput. Educ..

[3]  D. Altman,et al.  Statistics notes: Cronbach's alpha , 1997 .

[4]  Ahmad Assaf Alfadly,et al.  The Efficiency of the "Learning Management System (LMS)" in AOU, Kuwait, as a Communication Tool in an E-Learning System. , 2013 .

[5]  J. Arbaugh,et al.  A Structural Equation Model of Predictors for Effective Online Learning , 2005 .

[6]  Nava Pliskin,et al.  Student satisfaction with learning management systems: a lens of critical success factors , 2012 .

[7]  D. Halfer,et al.  The Impact of a Blended Learning Approach on Instructor and Learner Satisfaction With Preceptor Education , 2007, Journal for nurses in staff development : JNSD : official journal of the National Nursing Staff Development Organization.

[8]  Sevgi Özkan,et al.  A Structural Model for Students' Adoption of Learning Management Systems: An Empirical Investigation in the Higher Education Context , 2018, J. Educ. Technol. Soc..

[9]  Princely Ifinedo,et al.  Business undergraduates' perceived use outcomes of Moodle in a blended learning environment: The roles of usability factors and external support , 2018, Telematics Informatics.

[10]  D. Garrison,et al.  Institutional change and leadership associated with blended learning innovation: Two case studies , 2013, Internet High. Educ..

[11]  Priyanka Surendran,et al.  Technology Acceptance Model: A Survey of Literature , 2012 .

[12]  Hanan Aldowah,et al.  Acceptance and Satisfaction of Learning Management System Enabled Blended Learning Based on a Modified DeLone-McLean Information System Success Model , 2018, Int. J. Inf. Technol. Proj. Manag..

[13]  Aikaterini Lalatsa,et al.  Technology‐enhanced learning in higher education: How to enhance student engagement through blended learning , 2019, European Journal of Education.

[14]  Rianne Conijn,et al.  Predicting Student Performance from LMS Data: A Comparison of 17 Blended Courses Using Moodle LMS , 2017, IEEE Transactions on Learning Technologies.

[15]  M. A. Al Gamdi,et al.  Perceived Barriers towards e-Learning by Faculty Members at a Recently Established University in Saudi Arabia , 2016 .

[16]  Naim Ahmad,et al.  Relationship Modeling of Critical Success Factors for Enhancing Sustainability and Performance in E-Learning , 2018, Sustainability.

[17]  Marlia Mohd Puteh,et al.  Blended Learning or E-Learning? , 2013, ArXiv.

[18]  J. Kostiner.  Kuwait , 1977, Permanent Missions to the United Nations, No. 309.

[19]  Susan Ko,et al.  Teaching Online: A Practical Guide , 2000 .

[20]  R. Bagozzi,et al.  On the evaluation of structural equation models , 1988 .

[21]  Karsten Lundqvist,et al.  Investigating the effect of learning styles in a blended e-learning system: An extension of the technology acceptance model (TAM) , 2016 .

[22]  David F. Larcker,et al.  Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics: , 1981 .

[23]  Chun Meng Tang,et al.  What Makes Learning Management Systems Effective for Learning? , 2018, Journal of Educational Technology Systems.

[24]  Jerry Craig,et al.  An examination of the impacts of a Learning Management System: A Case from Jamaica , 2015, AMCIS.

[25]  Eduardo Gómez-Sánchez,et al.  From face‐to‐face to distance LMS‐mediated collaborative learning situations with GLUE! , 2015, Comput. Appl. Eng. Educ..

[26]  M. C. Sáiz Manzanares,et al.  How Do B-Learning and Learning Patterns Influence Learning Outcomes? , 2017, Front. Psychol..

[27]  J. Mtebe,et al.  Key factors in learners’ satisfaction with the e-learning system at the University of Dar es Salaam, Tanzania , 2018, Australasian Journal of Educational Technology.

[28]  Gary Cheng,et al.  Exploring the relationships between learning styles, online participation, learning achievement and course satisfaction: An empirical study of a blended learning course , 2016, Br. J. Educ. Technol..

[29]  Priyavahani Subramanian,et al.  A Study of Comparison between Moodle and Blackboard based on Case Studies for Better LMS , 2014 .

[30]  Julio Cabero-Almenara,et al.  Technical and Didactic Knowledge of the Moodle LMS in Higher Education. Beyond Functional Use , 2019, Journal of New Approaches in Educational Research.

[31]  Sofia B. Dias,et al.  Towards an Enhanced Learning Management System for Blended Learning in Higher Education Incorporating Distinct Learners' Profiles , 2014, J. Educ. Technol. Soc..

[32]  Samir N. Hamade.  Student Perceptions of Learning Management Systems in a University Environment: Yahoo Groups vs Blackboard , 2012, 2012 Ninth International Conference on Information Technology - New Generations.

[33]  John A. Schibrowsky,et al.  The Interdependence of the Factors Influencing the Perceived Quality of the Online Learning Experience: A Causal Model , 2007 .

[34]  Bahram Fadaiyan,et al.  Surveying the Six Effective Dimensions on E-learners’ Satisfaction (Case Study: Bushehr Legal Medicine Organization) , 2014 .

[35]  Josh McCarthy,et al.  Enhancing feedback in higher education: Students’ attitudes towards online and in-class formative assessment feedback models , 2017 .

[36]  Charles R. Graham,et al.  A framework for institutional adoption and implementation of blended learning in higher education , 2013, Internet High. Educ..

[37]  M'hammed Abdous,et al.  Influence of satisfaction and preparedness on online students' feelings of anxiety , 2019, Internet High. Educ..

[38]  Dalibor Petković,et al.  Appraisal and review of e-learning and ICT systems in teaching process , 2019, Physica A: Statistical Mechanics and its Applications.

[39]  Francisco J. García-Peñalvo,et al.  Teachers' attitude regarding the use of ICT. A factor reliability and validity study , 2014, Comput. Hum. Behav..

[40]  Emad Abu-Shanab,et al.  Exploring Factors Affecting Users' Satisfaction Toward E-Learning Systems , 2018, Int. J. Inf. Commun. Technol. Educ..

[41]  Wahyu Nur Hidayat,et al.  The Effectiveness of Learning Management System (LMS) on Computer Assisted Learning Course for Informatics Engineering Education Students , 2018 .

[42]  Manimala Puri,et al.  A Comparison and Evaluation of Administration and Security Tool of Open Source Learning Management Systems , 2017 .

[43]  Chan Du,et al.  The Effect of Human Interactions on Student Performance and Satisfaction of Blended Learning , 2013 .

[44]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[45]  Jennifer Dickfos,et al.  Blended learning: making an impact on assessment and self-reflection in accounting education , 2014 .

[46]  Charles R. Graham,et al.  Blended learning in higher education: Institutional adoption and implementation , 2014, Comput. Educ..

[47]  Yingqin Zheng,et al.  Conceptualizing development in information and communication technology for development (ICT4D) , 2018, Inf. Technol. Dev..

[48]  R. Rahmawati.  Self-Efficacy and Use of E-learning: A Theoretical Review Technology Acceptance Model (TAM) , 2019 .

[49]  Nian-Shing Chen,et al.  Evolution Is not enough: Revolutionizing Current Learning Environments to Smart Learning Environments , 2016, International Journal of Artificial Intelligence in Education.

[50]  Asadullah Shah,et al.  Barriers Effecting Successful Implementation of E-Learning in Saudi Arabian Universities , 2017, Int. J. Emerg. Technol. Learn..

[51]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[52]  H. Kaiser.  An index of factorial simplicity , 1974 .

[53]  Randall E. Schumacker,et al.  Confirmatory Factor Analysis With Different Correlation Types and Estimation Methods , 2000 .

[54]  Shivraj Kanungo,et al.  Appropriate media choice for e-learning effectiveness: Role of learning domain and learning style , 2014, Comput. Educ..

[55]  P. Shayan,et al.  An Assessment of Students’ Satisfaction Level from Learning Management Systems: Case Study of Payamnoor and Farhangian Universities , 2017 .

[56]  Fariza Khalid,et al.  Choosing the Right Learning Management System (LMS) for the Higher Education Institution Context: A Systematic Review , 2016, Int. J. Emerg. Technol. Learn..

[57]  Sofia B. Dias,et al.  Fuzzy cognitive mapping of LMS users' Quality of Interaction within higher education blended-learning environment , 2015, Expert Syst. Appl..

[58]  Rafael Anaya-Sánchez,et al.  Exploring the impacts of interactions, social presence and emotional engagement on active collaborative learning in a social web-based environment , 2018, Comput. Educ..

[60]  Tatiana Krasnova,et al.  A Paradigm Shift: Blended Learning Integration in Russian Higher Education , 2015 .

[61]  Kevin Oliver,et al.  Preparing Teachers for Emerging Blended Learning Environments. , 2014 .

[62]  Ephraim R. McLean,et al.  Information Systems Success Measurement , 2016, Found. Trends Inf. Syst..

[63]  H. Beetham,et al.  Understanding students' uses of technology for learning: Towards creative appropriation , 2010 .

[64]  Nurkaliza Khalid.  THE ROLE OF PERCEIVED USEFULNESS AND PERCEIVED ENJOYMENT IN ASSESSING STUDENTS ’ INTENTION TO USE LMS USING 3-TUM , 2014 .

[65]  Ke Zhang,et al.  An Investigation of Faculty’s Perceptions and Experiences when Transitioning to a New Learning Management System , 2010 .

[66]  John W. Creswell,et al.  A Concise Introduction to Mixed Methods Research , 2014 .

[67]  Helail Almutairi,et al.  An Empirical Application of the Delone and Mclean Model in the Kuwaiti Private Sector , 2005, J. Comput. Inf. Syst..

[68]  Chang Zhu,et al.  Who or what contributes to student satisfaction in different blended learning modalities? , 2017, Br. J. Educ. Technol..

[69]  P. A. Ratna,et al.  Exploring the acceptance for e-learning using technology acceptance model among university students in India , 2015 .

[70]  Said S. Al-Gahtani,et al.  Empirical investigation of e-learning acceptance and assimilation: A structural equation model , 2016 .

[71]  Sofia B. Dias,et al.  Towards an Intelligent Learning Management System Under Blended Learning - Trends, Profiles and Modeling Perspectives , 2013, Intelligent Systems Reference Library.

[72]  Alev Ates Çobanoglu,et al.  Student teachers’ satisfaction for blended learning via Edmodo learning management system , 2017, Behav. Inf. Technol..

[73]  Sotiris Kotsiantis,et al.  Using learning analytics to identify successful learners in a blended learning course , 2013 .

[74]  Sofia B. Dias,et al.  Fuzzy Logic-Based Modeling in Collaborative and Blended Learning , 2015 .

[75]  Jo Tondeur,et al.  Clustering university teaching staff through UTAUT: Implications for the acceptance of a new learning management system , 2019, Br. J. Educ. Technol..

[76]  Hakan Dündar,et al.  Learning management system implementation: a case study in the Kyrgyz Republic , 2018, Interact. Learn. Environ..

[77]  Richard Boateng,et al.  Determinants of e-learning adoption among students of developing countries , 2016 .

[78]  M.-P. Huguet,et al.  Designing for the changing role of the instructor in blended learning , 2004, IEEE Transactions on Professional Communication.

[79]  Kamla Ali Al-Busaidi,et al.  Learners' Perspective on Critical Factors to LMS Success in Blended Learning: An Empirical Investigation , 2012, Commun. Assoc. Inf. Syst..

[80]  Sean B. Eom,et al.  Effects of LMS, self‐efficacy, and self‐regulated learning on LMS effectiveness in business education , 2012 .

[81]  Azzedine Lansari,et al.  Using a Learning Management System to Foster Independent Learning in an Outcome-Based University: A Gulf Perspective , 2010 .

[82]  A. Mitchell,et al.  Criteria for successful blended learning , 2007 .

[83]  E-LEARNING IN THE MIDDLE EAST AND NORTH AFRICA (MENA) REGION: REVIEW OF TRENDS FROM THE FIRST COMPREHENSIVE REGIONAL HANDBOOK , 2019, EDULEARN19 Proceedings.

[84]  Jianfeng Wang,et al.  The impact of organisational support, technical support, and self-efficacy on faculty perceived benefits of using learning management system , 2018, Behav. Inf. Technol..

[85]  R. Tamim.  Blended Learning for Learner Empowerment: Voices from the Middle East , 2018 .

[86]  Gwo-Dong Chen,et al.  Surveying instructor and learner attitudes toward e-learning , 2007, Comput. Educ..

[87]  Sung Youl Park,et al.  An Analysis of the Technology Acceptance Model in Understanding University Students' Behavioral Intention to Use e-Learning , 2009, J. Educ. Technol. Soc..

[88]  Alhuseen Omar Alsayed,et al.  Evaluating and Ranking Cloud-Based E-Learning Critical Success Factors (CSFs) Using Combinatorial Approach , 2019, IEEE Access.

[89]  Sofia B. Dias,et al.  Exploring B-Learning Scenarios Using Fuzzy Logic-Based Modeling of Users' LMS Quality of Interaction in Ergonomics and Psychomotor Rehabilitation Academic Courses , 2014, HCI.

[90]  Dowming Yeh,et al.  What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction , 2008, Comput. Educ..

[91]  Noriko Hara,et al.  Students’ Distress with a Web-based Distance Education Course: An Ethnographic Study of Participants' Experiences , 2003 .

[92]  Hassan Sharafuddin,et al.  Measuring Students' Satisfaction in Blended Learning at the Arab Open University - Kuwait , 2011, ICDIPC.

[93]  Daniel A. Gagnon,et al.  Perceptions of Blended Learning: A Case Study on Student Experiences in an Advanced Placement Macroeconomics Course , 2014 .

[94]  Blake Ives,et al.  Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effectiveness in Basic It Skills Training Author(s): Piccoli Et Al./web-based Virtual Learning Environments Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effe , 2022 .

[95]  Michael Tagoe.  Students’ perceptions on incorporating e-learning into teaching and learning at the University of Ghana , 2012 .

[96]  Methods of Correlation and Regression Analysis, Linear and Curvilinear , 1959 .

[97]  George T. Milkovich,et al.  The Effective Use of Multimedia Distance Learning Technology: The Role of Technology Self-Efficacy, Attitudes, Reliability, Use and Distance in a Global Multimedia Distance Learning Classroom , 2000 .

[98]  M. F. Rashida,et al.  Undergraduates’ use behavior of learning management systems: a Sri Lankan perspective , 2018 .

[99]  Nurbiha A. Shukor,et al.  A managerial perspective on institutions' administration readiness to diffuse blended learning in higher education: Concept and evidence , 2020, Journal of Research on Technology in Education.

[100]  R. Saadé,et al.  Understanding Online Learning Based on Different Age Categories , 2019, Proceedings of the 2019 InSITE Conference.

[101]  Steven Hornik,et al.  An empirical examination of factors contributing to the creation of successful e-learning environments , 2008, Int. J. Hum. Comput. Stud..

[102]  Amna Shifia Nisafani,et al.  Factors Affecting Teacher's Intention to use E-Learning , 2017 .

[103]  Guan-Yu Lin,et al.  Anonymous versus identified peer assessment via a Facebook-based learning application: Effects on quality of peer feedback, perceived learning, perceived fairness, and attitude toward the system , 2018, Comput. Educ..

[104]  Salah Al-Fadhli.  Factors Influencing the Acceptance of Distance Learning: A Case Study of Arab Open University in Kuwait , 2009 .

[105]  D. Prasad.  Data Collection Strategies in Mixed Method Research , 2012 .

[106]  Fuad A. Trayek,et al.  Attitude Towards The Use Of Learning Management System Among University Students: A Case Study , 2013 .

[107]  Curtis J. Bonk,et al.  The Handbook of Blended Learning: Global Perspectives, Local Designs , 2005 .

[108]  John K. Tarus,et al.  Challenges of implementing e-learning in Kenya: A case of Kenyan public universities , 2015 .

[109]  Marina Keiko Nakayama,et al.  LEARNING MANAGEMENT SYSTEMS (LMS) AND E-LEARNING MANAGEMENT: AN INTEGRATIVE REVIEW AND RESEARCH AGENDA , 2015 .

[110]  Christine Mulhern,et al.  Adopting MOOCs on Campus: A Collaborative Effort to Test MOOCs on Campuses of the University System of Maryland , 2014 .

[111]  G. Nowell.  Student Course Evaluations in Traditional and Blended Courses: A Case Study. , 2011 .

[112]  Stephen G. West,et al.  Structural equation models with non-normal variables: Problems and remedies , 1995 .

[113]  Hussein Suleman,et al.  Issues of adoption: have e-learning management systems fulfilled their potential in developing countries? , 2011, SAICSIT '11.

[114]  Patrick Parslow,et al.  Barriers and opportunities of e-learning implementation in Iraq: a case of public universities , 2016 .

[115]  Florence Martin,et al.  Influence of Learning Management Systems Self-Efficacy on E-Learning Performance , 2010 .

[116]  H Vu.  Students' expectations and experiences of blended learning: a case study at Hanoi Open University, Vietnam , 2014 .

[117]  Adeline Ng Ling Ying,et al.  Academics and Learners’ Perceptions on Blended Learning as a Strategic Initiative to Improve Student Learning Experience , 2016 .

[118]  Tiago Oliveira,et al.  E-learning success determinants: Brazilian empirical study , 2018, Comput. Educ..

[119]  Mara Nikolaidou,et al.  The Blended Learning Ecosystem of an Academic Institution in Greece , 2010, Int. J. Web Based Learn. Teach. Technol..

[120]  Wagner A. Kamakura,et al.  Statistical Data Fusion for Cross-Tabulation , 1997 .

[121]  Farshad Mahnegar,et al.  Learning Management System , 2012 .

[122]  J. Morse.  Designing funded qualitative research. , 1994 .

[123]  S. A. Becker,et al.  NMC Horizon Report: 2016 Higher Education Edition , 2015 .

[124]  Ahmad Althunibat,et al.  Determining the factors influencing students' intention to use m-learning in Jordan higher education , 2015, Comput. Hum. Behav..

[125]  Sofia J. Hadjileontiadou,et al.  Towards an Intelligent Learning Management System: The A/B/C-TEACH Approach , 2018, Communications in Computer and Information Science.

[126]  Thomas G. Ryan,et al.  Learning Management System Migration: An Analysis of Stakeholder Perspectives , 2012 .

[127]  Félix Hernández-del-Olmo,et al.  Enhancing E-Learning Through Teacher Support: Two Experiences , 2009, IEEE Transactions on Education.

[128]  Valentina Arkorful,et al.  The role of e-learning, the advantages and disadvantages of its adoption in Higher Education. , 2014 .

[129]  Anass Bayaga,et al.  Use and Attitude towards Learning Management Systems (LMS) in Saudi Arabian Universities , 2016 .

[130]  John Fungulupembe Kalolo,et al.  Digital revolution and its impact on education systems in developing countries , 2018, Education and Information Technologies.

[132]  Tzanetos Pomonis,et al.  Evaluating a learning management system for blended learning in Greek higher education , 2016, SpringerPlus.

[133]  Khadijah Abdul Rahman,et al.  The Effectiveness of Learning Management System (LMS) Case Study at Open University Malaysia (OUM), Kota Bharu Campus , 2010 .

[134]  Nurbiha A. Shukor,et al.  Exploring the role of blended learning for teaching and learning effectiveness in institutions of higher learning: An empirical investigation , 2019, Education and Information Technologies.

[135]  Sevgi Özkan,et al.  Multi-dimensional students' evaluation of e-learning systems in the higher education context: An empirical investigation , 2009, Comput. Educ..