Learning Evaluation Effectiveness Through Dashboard of Knowledge Using Dimensions of Multi-Criteria of WELS

A Discussion Forum is one component of the learning media in a Learning Management System. There is much information and knowledge that are discussed among a lecturer and students in forums as a part of the learning process. The motivation of this study is to evaluate the learning process in a discussion forum through a dashboard, namely, the Dashboard of Knowledge (DoK). The DoK is formed using an Information Retrieval Architecture and Entity Relationship Diagram that is designed using four category interfaces. Furthermore, the effectiveness of the learning evaluation through the DoK is measured by a survey. The survey is conducted using three out of four dimensions of multi-criteria of the Web-based E-Learning System (WELS), namely, the Learner Interface, the System Context, and Personalization. The respondents of the survey are the heads of department that are DoK users. The results show that most respondents strongly agree that the DoK is useful for evaluating the learning in a discussion forum. This is exhibited by the survey results that show an average score of 3.53 out of 4.00 and 84.32% satisfaction. These results reveal that the DoK can effectively assist heads of department in monitoring the effectiveness of the learning process in a discussion forum.

[1]  Sebastián Dormido,et al.  A Methodology to Obtain Learning Effective Laboratories with Learning Management System Integration , 2016, IEEE Transactions on Learning Technologies.

[2]  Mostafa Langarizadeh,et al.  Evaluation of Effective Dashboards: Key Concepts and Criteria , 2017, The open medical informatics journal.

[3]  Mark Christopher Schall,et al.  Usability Evaluation and Implementation of a Health Information Technology Dashboard of Evidence-Based Quality Indicators , 2017, Computers, informatics, nursing : CIN.

[4]  Jeff Sauro,et al.  Item benchmarks for the system usability scale , 2018 .

[5]  Carolyn Penstein Rosé,et al.  Exploring the Effect of Confusion in Discussion Forums of Massive Open Online Courses , 2015, L@S.

[6]  Xiaohui Liu,et al.  Examining the moderating effect of individual-level cultural values on users’ acceptance of E-learning in developing countries: a structural equation modeling of an extended technology acceptance model , 2017, Interact. Learn. Environ..

[7]  Yi-Shun Wang,et al.  Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications , 2008, Comput. Educ..

[8]  Andrina Granic,et al.  Technology acceptance model: a literature review from 1986 to 2013 , 2014, Universal Access in the Information Society.

[9]  Rupert Ward,et al.  Developing a General Extended Technology Acceptance Model for E-Learning (GETAMEL) by analysing commonly used external factors , 2016, Comput. Hum. Behav..

[10]  Nirmala N Rege,et al.  Implementation of supplemental E-learning models for blended learning in pharmacology , 2017 .

[11]  Rafael Morales-Gamboa,et al.  Usability Evaluation by Experts of a Learning Management System , 2015, IEEE Revista Iberoamericana de Tecnologias del Aprendizaje.

[12]  Nelson Pacheco da Rocha,et al.  European Portuguese Validation of the System Usability Scale (SUS) , 2015, DSAI.

[13]  Jens Myrup Pedersen,et al.  Learning Management Systems on Blended Learning Courses: An Experience-Based Observation , 2017, IP&C.

[14]  Harry Budi Santoso,et al.  An Indonesian adaptation of the System Usability Scale (SUS) , 2016, 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[15]  Christos Katsanos,et al.  Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale , 2015 .

[16]  Widodo Budiharto,et al.  Finding model through latent semantic approach to reveal the topic of discussion in discussion forum , 2019, Education and Information Technologies.

[17]  Abdelkamel Tari,et al.  Exploring user satisfaction for e-learning systems via usage-based metrics and system usability scale analysis , 2016, Comput. Hum. Behav..

[18]  D. Garrison,et al.  Blended learning: Uncovering its transformative potential in higher education , 2004, Internet High. Educ..