Usability and Effectiveness Evaluation of Adaptivity in E-Learning Systems

Designing effective and usable adaptive e-learning systems represents a challenge because of the complexity which arises when meeting the needs of learners. This is compounded by the lack of well-designed experimental evaluations of adaptive e-learning systems in general, and of their usability and effectiveness in particular. This paper offers an experimental evaluation of the effect of adaptation, taking into account both the perceived usability level and learning effectiveness. A controlled experiment was conducted with 75 participants and produced significant results. They indicate that an adaptive version has a significantly higher level of perceived usability and of learning effectiveness than a non-adaptive version.

[1]  Rachid Anane,et al.  Adaptivity in E-Learning Systems , 2014, 2014 Eighth International Conference on Complex, Intelligent and Software Intensive Systems.

[2]  Stephan Weibelzahl,et al.  Evaluation of Adaptive Systems , 2001, User Modeling.

[3]  Peter Brusilovsky,et al.  Adaptive Navigation Support , 2007, The Adaptive Web.

[4]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[5]  Özcan Özyurt,et al.  Learning style based individualized adaptive e-learning environments: Content analysis of the articles published from 2005 to 2014 , 2015, Comput. Hum. Behav..

[6]  Rachid Anane,et al.  An E-Learning Investigation into Learning Style Adaptivity , 2015, 2015 48th Hawaii International Conference on System Sciences.

[7]  Rachid Anane,et al.  Design and Usability Evaluation of Adaptive e-learning Systems Based on Learner Knowledge and Learning Style , 2015, INTERACT.

[8]  John A. Self,et al.  Formal Approaches to Student Modelling , 1994 .

[9]  Rachid Anane,et al.  Students' Satisfaction in Learning Style-Based Adaptation , 2015, 2015 IEEE 15th International Conference on Advanced Learning Technologies.

[10]  Thomas S. Tullis,et al.  A Comparison of Questionnaires for Assessing Website Usability , 2004 .

[11]  Peter Brusilovsky,et al.  User Models for Adaptive Hypermedia and Adaptive Educational Systems , 2007, The Adaptive Web.

[12]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[13]  Teresa Roselli,et al.  An approach to usability evaluation of e-learning applications , 2006, Universal Access in the Information Society.

[14]  Yavuz Akbulut,et al.  Adaptive educational hypermedia accommodating learning styles: A content analysis of publications from 2000 to 2011 , 2012, Comput. Educ..

[15]  Rachid Anane,et al.  The Impact of Learning Style Adaptivity in Teaching Computer Security , 2015, ITiCSE.

[16]  Christos Katsanos,et al.  Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale , 2015 .

[17]  Behzad Bordbar,et al.  A Web services approach to learning path composition , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[18]  Kristina Höök,et al.  Steps to take before intelligent user interfaces become real , 2000, Interact. Comput..

[19]  Mohamed Jemni,et al.  A fully personalization strategy of E-learning scenarios , 2010, Comput. Hum. Behav..

[20]  Michael C. Dorneich,et al.  Towards a Characterization of Adaptive Systems: a Framework for Researchers and System Designers , 2017 .

[21]  Angeliki Poulymenakou,et al.  Developing a Usability Evaluation Method for e-Learning Applications: Beyond Functional Usability , 2009, Int. J. Hum. Comput. Interact..

[22]  David Benyon,et al.  Adaptive systems: A solution to usability problems , 1993, User Modeling and User-Adapted Interaction.

[23]  Cristina Gena,et al.  Usability Engineering for the Adaptive Web , 2007, The Adaptive Web.

[24]  Tony Fisher,et al.  Evaluating Learning Style Personalization in Adaptive Systems: Quantitative Methods and Approaches , 2009, IEEE Transactions on Learning Technologies.

[25]  R. Felder,et al.  Applications, Reliability and Validity of the Index of Learning Styles* , 2005 .