User Testing of a System Prototype for Adaptive English Learning using Perturbation Learner Model

This paper presents a study to evaluate a system prototype that supports adaptive English learning. The prototype was previously developed based on a conceptual framework using perturbation learner model but no formal evaluation was conducted. The evaluation study consists of user testing on the system’s functionality and usability aspects. The findings suggest conformity of the learning content from the teacher’s perspective. Similarly, the students viewed the system as easy to understand, easy to navigate and easy to recognize.

[1]  Stephan Weibelzahl,et al.  Evaluation of Adaptive Systems , 2001, User Modeling.

[2]  Alex Paramythis,et al.  A Decomposition Model for the Layered Evaluation of Interactive Adaptive Systems , 2005, User Modeling.

[3]  Cristina Gena,et al.  Methods and techniques for the evaluation of user-adaptive systems , 2005, The Knowledge Engineering Review.

[4]  David N. Chin Empirical Evaluation of User Models and User-Adapted Systems , 2001, User Modeling and User-Adapted Interaction.

[5]  R. Sunitha,et al.  Towards Learner Model Sharing Among Heterogeneous E-Learning Environments , 2011 .

[6]  Alexandros Paramythis,et al.  Adaptive Learning Environments and e-Learning Standards. , 2004 .

[7]  Jaime Sánchez Ilabaca,et al.  Modeling 3D interactive environments for learners with visual disabilities , 2006 .

[8]  Vincent P. Wade,et al.  The evaluation of adaptive and personalised information retrieval systems: a review , 2011, Int. J. Knowl. Web Intell..

[9]  Sibel Somyürek,et al.  Student modeling: Recognizing the individual needs of users in e-learning environments , 2009 .

[10]  Malcolm Atkinson,et al.  Heuristic Evaluation. Usability Evaluation Materials , 1996 .

[11]  Thea van der Geest,et al.  User-centered evaluation of adaptive and adaptable systems: a literature review , 2008, The Knowledge Engineering Review.

[12]  Loc Nguyen,et al.  Learner Model in Adaptive Learning , 2008 .

[13]  Judith Masthoff,et al.  Layered evaluation of interactive adaptive systems: framework and formative methods , 2010, User Modeling and User-Adapted Interaction.

[14]  Neil A. M. Maiden,et al.  Evaluating the Adaptation of a Learning System before the Prototype Is Ready: A Paper-Based Lab Study , 2009, UMAP.

[15]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[16]  Pierre Dillenbourg,et al.  A Framework for Learner Modelling , 1992, Interact. Learn. Environ..