Evaluating the E-Learning Platform from the Perspective of Knowledge Management: The AHP Approach

A growing number of higher education institutions have adopted asynchronous and synchronous Web-based learning platforms to improve students' learning efficiency and increase learning satisfaction in the past decade. Unlike traditional face-to-face learning methods, e-learning platforms allow teachers to communicate with students and discuss course content anytime or anywhere. In addition, the teaching material can be reused via the e-learning platforms. To understand how students use e-learning platforms and what the implications are, we conducted an empirical study of the iCAN e-learning platform, which has been widely used in Fu-Jen Catholic University since 2005. We use the Analytic Hierarchy Process (AHP), a well-known multi-criteria evaluation approach, to compare five practices, i.e. the functions of the iCAN teaching platform. We adopted a brainstorming approach to design a questionnaire to measure learners' perception of the e-learning platform based on the theory of knowledge transforming process in knowledge management. Accordingly, the model considers functioning and objectivity in terms of the following three attributes of learning effectiveness: individual learning, group sharing and learning performance. Twelve criteria with twelve evaluation items were used to investigate the effectiveness of the five practices. We also evaluated the strengths and weaknesses of the functions based on the types of courses in the iCan platform. We expect that the empirical evaluation results will provide teachers with suggestions and guidelines for using the e-learning platform effectively to facilitate their teaching activities and promote students' learning efficiency and satisfaction.

[1]  Rosemary J. Redfield,et al.  Does the medium change the message? The impact of a web-based genetics course on university students' perspectives on learning and teaching , 2002, Comput. Educ..

[2]  Duen-Ren Liu,et al.  Task-based K-Support system: disseminating and sharing task-relevant knowledge , 2005, Expert Syst. Appl..

[3]  Qiong Liu,et al.  E-Learning Platform Evaluation Using Fuzzy AHP , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[4]  Peter H. Gray,et al.  A problem-solving perspective on knowledge management practices , 2001, Decis. Support Syst..

[5]  Elliot Soloway,et al.  Examining 25 years of technology in U.S. education , 2002, Commun. ACM.

[6]  Thomas L. Saaty,et al.  On polynomials and crossing numbers of complete graphs , 1971 .

[7]  Hsiu-Fen Lin,et al.  An application of fuzzy AHP for evaluating course website quality , 2010, Comput. Educ..

[8]  Yolande E. Chan,et al.  Integrating Knowledge Management Practices Through a Problem Solving Framework , 2000, Commun. Assoc. Inf. Syst..

[9]  I. Nonaka A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[10]  Thomas H. Davenport,et al.  Book review:Working knowledge: How organizations manage what they know. Thomas H. Davenport and Laurence Prusak. Harvard Business School Press, 1998. $29.95US. ISBN 0‐87584‐655‐6 , 1998 .

[11]  David W. Johnson,et al.  Cooperative learning : increasing college faculty instructional productivity , 1991 .

[12]  E. Lee,et al.  Comparison of fuzzy numbers based on the probability measure of fuzzy events , 1988 .

[13]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[14]  Nian-Shing Chen,et al.  Cyber Schooling framework: improving mobility and situated learning , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[15]  Samuel Riffell,et al.  Using web-based instruction to improve large undergraduate biology courses: An evaluation of a hybrid course format , 2005, Comput. Educ..

[16]  T. L. Saaty A Scaling Method for Priorities in Hierarchical Structures , 1977 .

[17]  S. Fuller Knowledge Management Foundations , 2001 .

[18]  Maria Beckman Collaborative Learning: Preparation for the Workplace and Democracy?. , 1990 .

[19]  Andrina Granic,et al.  Usability Testing and Expert Inspections Complemented by Educational Evaluation: A Case Study of an e-Learning Platform , 2011, J. Educ. Technol. Soc..

[20]  Thomas L. Saaty,et al.  Priority setting in complex problems , 1983, IEEE Transactions on Engineering Management.

[21]  Alfonso Quarati,et al.  ICT Driven Individual Learning: New Opportunities and Perspectives , 2000, J. Educ. Technol. Soc..

[22]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[23]  Rajit Gadh,et al.  Internet-based collaborative product design with assembly features and virtual design spaces , 2001, Comput. Aided Des..

[24]  Samuel K. Riffell,et al.  Learning Online: Student Perceptions of a Hybrid Learning Format. , 2003 .

[25]  Yuji Sato QUESTIONNAIRE DESIGN FOR SURVEY RESEARCH: EMPLOYING WEIGHTING METHOD , 2005 .

[26]  D. Dubois,et al.  Operations on fuzzy numbers , 1978 .

[27]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[28]  Ru-Jen Chao,et al.  Evaluation of the criteria and effectiveness of distance e-learning with consistent fuzzy preference relations , 2009, Expert Syst. Appl..