Usability Metrics for E-learning

E-learning is a fast-growing area thanks to the potential for increased reach and decreased cost of e-learning programs. Usability is of vital importance for e-learning due to the remote nature of the e-learning activities. In order to evaluate usability of e-learning, we apply the following usability factors: 1) E-learning System Feedback, 2) Consistency, 3) Error Prevention, 4) Performance/Efficiency, 5) User like/dislike, 6) Error Recovery, 7) Cognitive load 8) Internationalization, 9) Privacy, 10) On-Line Help [14,15]. We noticed that we needed a way of representing each of these factors separately and finally to combine them into a single figure of merit expressing overall e-learning usability. Note each of the above dimensions is a relatively imprecise concept and cannot be simply represented numerically. Hence, we decided to use Fuzzy system theory as the basis for representing them and the Fuzzy-reasoning paradigm using the Takagi-Sugeno (T-S) model [15] for combining them into a single e-learning usability figure of merit. This approach has 3 components: a) identification of the usability issues in e-learning, b) a testing aspect for the Fuzzy based usability approach, c) combining the results of these tests and turning them into a usability measure and the validation of the Fuzzy model. This paper discusses the use of fuzzy systems to model each of these usability factors and to reflect how each affects the overall value of e-learning usability.

[1]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[3]  Jakob Nielsen,et al.  Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared , 1993, INTERCHI.

[4]  Andrew Dillon,et al.  Usability measurement: its practical value to the computer industry , 1993, CHI '93.

[5]  Siegfried Treu Stress and User Satisfaction , 1994 .

[6]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[7]  Siegfried Treu,et al.  User Interface Evaluation , 2012, Languages and Information Systems.

[8]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[9]  Harold Thimbleby,et al.  Formulating usability , 1994, SGCH.

[10]  Siegfried Treu User Interface Evaluation: A Structured Approach , 1994 .

[11]  Tharam S. Dillon,et al.  Automated Usability Testing , 1997, INTERACT.

[12]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[13]  Jakob Nielsen,et al.  Designing web usability , 1999 .

[14]  Allison Rossett The ASTD e-Learning Handbook: Best Practices, Strategies and Case Studies for an Emerging Field , 2001 .

[15]  Michael Feldstein E-learning basics: essay: developing your e-learning for your learners , 2002, ELERN.

[16]  Paulo Machado,et al.  E-Learning Basics: Essay: E-learning, online learning, web-based learning, or distance learning: unveiling the ambiguity in current terminology , 2002, ELERN.

[17]  Charles A. Shoniregun,et al.  Is E-learning really the future or a risk? , 2003, UBIQ.

[18]  Karl M. Kapp Five Technological Considerations When Choosing an E-Learning Solution , 2003, ELERN.

[19]  Tim Chapman,et al.  A structured approach , 2003, Nature.