Structural Equation Modeling for Evaluating the User Perceptions of E-Learning Effectiveness in Higher Education

A crucial prerequisite for sustainable e-learning is the understanding of learners' preferences for various pedagogical strategies, technologies, and the management of learning resources. This paper presents an empirical study aiming to empirically test the theoretical (pedagogies, technologies and management) (PTM) model on the preference of learners and on the perceived impact of the effectiveness of e-learning. This study uses structural equation modelling (SEM) to identify the critical dimensions in the PTM model for augmenting the effectiveness of e-learning. This leads to the development of a PTM model with the path coefficients showing weak to strong relationships ranging from 0.15 to 0.42 with acceptable significance levels. The results support the hypothesis that management, technology, resources and metadata ontology dimensions affect the effectiveness of elearning both directly and indirectly through enhancing the management effectiveness of learning resources. However, the result does not support positive influence of pedagogical strategy per se on e-learning effectiveness. The implications of this study indicate the criticality of effective management of learning resources to enhance e-learning effectiveness.

[1]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[2]  Jörg Rech,et al.  Using Wikis to support the Net Generation in improving knowledge acquisition in capstone projects , 2009, J. Syst. Softw..

[3]  Ikujiro Nonaka,et al.  The knowledge-creating theory revisited: knowledge creation as a synthesizing process , 2003 .

[4]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[5]  Joseph J. Stevens,et al.  Exploratory and Confirmatory Factor Analysis of the School Level Environment Questionnaire (SLEQ) , 2001 .

[6]  James W. Peltier,et al.  Course content or the instructor: which is more important in on‐line teaching? , 2002 .

[7]  Alain Mille,et al.  ConKMeL: a contextual knowledge management framework to support multimedia e-Learning , 2006, Multimedia Tools and Applications.

[8]  B. Fraser,et al.  Development and Validation of an Instrument for Assessing Distance Education Learning Environments in Higher Education: The Distance Education Learning Environments Survey (DELES) , 2005 .

[9]  Donald F. Dansereau,et al.  Enhancing the recall of text: Knowledge mapping training promotes implicit transfer. , 1998 .

[10]  Robert Sommer,et al.  Experience and Education. , 1974 .

[11]  A. Adam Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[12]  Marek Hatala,et al.  Ontology mappings to improve learning resource search , 2006, Br. J. Educ. Technol..

[13]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[14]  Gary L. May,et al.  Gardening in Cyberspace: A Metaphor to Enhance Online Teaching and Learning , 2003 .

[15]  Cheng-Zen Yang,et al.  RDF/XTM Ontology Construction Based on a Topic Maps-Driven Framework , 2006, ICADL.

[16]  Rachel Or-Bach,et al.  Educational benefits of metadata creation by students , 2005, SGCS.

[17]  James W. Peltier,et al.  Reflective learning and on‐line management education: a comparison of traditional and on‐line MBA students , 2004 .

[18]  Anol Bhattacherjee,et al.  Understanding Changes in Belief and Attitude Toward Information Technology Usage: A Theoretical Model and Longitudinal Test , 2004, MIS Q..

[19]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[20]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[21]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[22]  U. Ehlers Quality in e-Learning from a Learner’s Perspective , 2004, Distances et médiations des savoirs.

[23]  Hepu Deng,et al.  Evaluating the intertwined critical success factors for sustainable e-learning , 2008 .

[24]  Dorothy E. Leidner,et al.  Research Commentary: Technology-Mediated Learning - A Call for Greater Depth and Breadth of Research , 2001, Inf. Syst. Res..

[25]  Gwo-Hshiung Tzeng,et al.  Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL , 2007, Expert Syst. Appl..

[26]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[27]  Yao-Ting Sung,et al.  Learning through computer-based concept mapping with scaffolding aid , 2001, J. Comput. Assist. Learn..

[28]  Wynne W. Chin,et al.  On the use, usefulness, and ease of use of structural equation modeling in MIS research: a note of caution , 1995 .

[29]  John A. Schibrowsky,et al.  The Interdependence of the Factors Influencing the Perceived Quality of the Online Learning Experience: A Causal Model , 2007 .

[30]  Robert A. Wisher,et al.  The Effectiveness of Web-Based Instruction: An Initial Inquiry. , 2002 .

[31]  J. Arbaugh,et al.  A Structural Equation Model of Predictors for Effective Online Learning , 2005 .

[32]  Erik Duval,et al.  Integration of Heterogeneous Information Sources into a Knowledge Resource Management System for Lifelong Learning , 2007 .

[33]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[34]  Albert H. Segars,et al.  Re-examining perceived ease of use and usefulness , 1993 .

[35]  Hui-Tzu Min,et al.  The impact of media on collaborative learning in virtual settings: The perspective of social construction , 2009, Comput. Educ..

[36]  J. B. Arbaugh,et al.  Virtual Classroom versus Physical Classroom: An Exploratory Study of Class Discussion Patterns and Student Learning in an Asynchronous Internet-Based MBA Course , 2000 .

[37]  Judy Drennan,et al.  Factors Affecting Student Attitudes Toward Flexible Online Learning in Management Education , 2005 .

[38]  Mark A. Fuller,et al.  Aligning What We Do and What We Measure in Business Schools: Incorporating Active Learning and Effective Media Use in the Assessment of Instruction——— , 2004 .

[39]  Susan M. Land,et al.  Student-Centered Learning and Interactive Multimedia: Status, Issues, and Implications , 1997 .

[40]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .

[41]  Gráinne Conole Using Compendium as a Tool to Support the Design of Learning Activities , 2008 .