Closing the Loop in Feedback Driven Learning Environments Using Trust Decision Making and Utility Theory

Contemporary learning systems are an integration of learning resources with human interactions. To close the loop in feedback driven learning environments, the utility of learning objectives needs to be measured. To this end, a comprehensive trust evaluation model for decision making is required to utilize feedback ratings along with other key parameters such as previous course result percentage, active participation and reputation of learners. This paper proposes a novel utility theory based trust evaluation model, wherein the utility of a learning objective is computed in terms of trust applicable to big data-sets. The utility is computed by allowing users to weigh the course related attributes according to their preferences. The utility value facilitates learners to select trustworthy learning objectives and enables instructors to improve different aspects of learning objectives. In addition, a satisfaction index is proposed for the assessment of the usefulness of the computed utility value. The performance of the model is evaluated on a big data-set, which is collected from learners enrolled in different courses of a postgraduate degree program for the purposes of decision making. The results indicate that the proposed unique intelligent model is effective for dynamic and user-specified trust evaluations of learning objectives for the purposes of decision making.

[1]  Brigitte Maier,et al.  Students' expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction , 2010, Comput. Educ..

[2]  Deren Chen,et al.  A trustworthy e-learning based on trust and quality evaluation , 2011, 2011 International Conference on E-Business and E-Government (ICEE).

[3]  Evangelos Grigoroudis,et al.  Measuring Customer Satisfaction Using a Collective Preference Disaggregation Model , 1998, J. Glob. Optim..

[4]  Muhammad Usman,et al.  Dynamic trust evaluation of learning objects , 2017, 2017 International Conference on Communication Technologies (ComTech).

[5]  Giuseppina Passiante,et al.  Assessing learners' satisfaction in collaborative online courses through a big data approach , 2019, Comput. Hum. Behav..

[6]  Vincenza Carchiolo,et al.  Reliable peers and useful resources: Searching for the best personalised learning path in a trust- and recommendation-aware environment , 2010, Inf. Sci..

[7]  Yingchun Liu,et al.  A Survey on Trust and Trustworthy E-learning System , 2010, 2010 International Conference on Web Information Systems and Mining.

[8]  Larry Korba,et al.  A Trust Model for Distributed E-Learning Service Control , 2002 .

[9]  Senbo Chen,et al.  A Trust Evaluation Model for E-Learning Systems , 2014 .

[10]  T. Whipple,et al.  Student Trust and its Antecedents in Higher Education , 2001 .

[11]  Guangguang Yang,et al.  Ontology-Based Personalized Course Recommendation Framework , 2019, IEEE Access.

[12]  Anthony F. Camilleri,et al.  Blockchain in education , 2017, AIP Conference Proceedings.

[13]  Yeu-Shiang Huang,et al.  A study on aggregation of group decisions , 2009 .

[14]  Nian-Shing Chen,et al.  Enhancing the Quality of e-Learning in Virtual Learning Communities by Finding Quality Learning Content and Trustworthy Collaborators , 2007, J. Educ. Technol. Soc..

[15]  Y. Wang,et al.  Building student trust in online learning environments , 2014 .

[16]  Chang Zhu,et al.  The effect of blended learning on student performance at course-level in higher education: A meta-analysis , 2017 .

[17]  Vincenza Carchiolo,et al.  Reliable Personalized Learning Paths: The Contribution of Trust to E-Learning , 2008, WSKS.

[18]  Shengquan Yu,et al.  Designing a trust evaluation model for open-knowledge communities , 2014, Br. J. Educ. Technol..

[19]  Jean-Éric Pelet,et al.  Investigating the Effect of Color on Memorization and Trust in E-Learning: The Case of KMCMS.net (Knowledge Management and Content Management System) , 2011 .

[20]  Fatos Xhafa,et al.  Security in Online Learning Assessment Towards an Effective Trustworthiness Approach to Support E-Learning Teams , 2014, 2014 IEEE 28th International Conference on Advanced Information Networking and Applications.

[21]  Jim E. Greer,et al.  Facilitating Trust in Privacy-Preserving E-Learning Environments , 2012, IEEE Transactions on Learning Technologies.

[22]  Abelardo Pardo,et al.  Analytics of Learning Strategies: Associations with Academic Performance and Feedback , 2019, LAK.

[23]  G. Wills,et al.  Towards a Trust Model in E-Learning: Antecedents of a Student's Trust. , 2013 .

[24]  Tshilidzi Marwala,et al.  Hybrid Fuzzy Recommendation System for Enhanced E-learning , 2018 .

[25]  Julita Vassileva,et al.  Toward Social Learning Environments , 2008, IEEE Transactions on Learning Technologies.

[26]  Julita Vassileva,et al.  Recommendations in Online Discussion Forums for E-Learning Systems , 2010, IEEE Transactions on Learning Technologies.

[27]  Andrew Topper,et al.  Online graduate educational technology program: An illuminative evaluation , 2016 .

[28]  Ruut Veenhoven,et al.  Homogenizing Responses to Different Survey Questions on the Same Topic: Proposal of a Scale Homogenization Method Using a Reference Distribution , 2013, Social indicators research.

[29]  Philip S. Yu,et al.  A Score Prediction Approach for Optional Course Recommendation via Cross-User-Domain Collaborative Filtering , 2019, IEEE Access.