User sensitive research in e-learning: exploring the role of individual user characteristics

The increasing need for active and accessible learning in the inclusive knowledge society drives the demand for e-learning that engages users much more effectively than ever before. In this context, it is crucial to conduct research that embraces innovation in user sensitive design, or else influential individual user differences may be overlooked. The objective of this paper is to explore the creation of successful e-learning systems that are able to increase users’ learning performance and enhance their personal learning experiences. The paper reports two converging and complimentary approaches, namely case studies and experimentation. First, case studies are used to explore the extent to which effective e-learning systems comply with eight specific factors. Of the eight, accessibility, individual differences and student modeling turn out to be the weakest points in current practice. Second, an empirical study investigates the influences of user individual user differences on users’ learning outcomes in an e-learning environment. The experiment found that individual differences in motivation to learn and expectations about e-learning significantly impacted users’ learning achievements. Third, based on these studies, improvements in research methodology are identified towards greater consideration of user sensitive research issues, thus enabling us to outline improved experimental procedures. Further experiment results should provide us with better insights into the arguments needed to carefully assess benefits of developing and involving a user model in an e-learning application. Consequently, evaluation and justification could now encompass both system performance as well as user performance.

[1]  Constantine Stephanidis,et al.  User Interfaces for All: Concepts, Methods, and Tools , 2009 .

[2]  Otman A. Basir,et al.  Adaptive User Interfaces for Intelligent E-Learning: Issues and Trends , 2004, ICEB.

[3]  George Kerscher The Essential Role of Libraries Serving Persons Who Are Blind and Print Disabled in the Information Age , 2006, ICCHP.

[4]  Ashok Patel,et al.  Intelligent and Adaptive Systems , 2002 .

[5]  Constantine Stephanidis,et al.  Towards a Walkthrough Method for Universal Access Evaluation , 2007, HCI.

[6]  Elaine Rich Users are individuals: individualizing user models , 1999, Int. J. Hum. Comput. Stud..

[7]  Karl Schweizer,et al.  An Overview of Research into the Cognitive Basis of Intelligence , 2005 .

[8]  Jennifer Preece,et al.  Usability and learning: Evaluating the potential of educational software , 1996, Comput. Educ..

[9]  Supporting user interfaces for all through user modeling , 1995 .

[10]  A Min Tjoa,et al.  Towards the Use of Ontologies for Improving User Interaction for People with Special Needs , 2006, ICCHP.

[11]  Nigel Ford,et al.  Individual differences, hypermedia navigation, and learning: an empirical study , 2000 .

[12]  Joy Egbert,et al.  CALL environments : research, practice, and critical issues , 1999 .

[13]  V. Shute,et al.  Adaptive E-Learning , 2003, Educational Psychologist.

[14]  Ann Blair,et al.  Too much information , 2007, Nature.

[15]  Douglas S. Bell,et al.  Self-Study from Web-Based and Printed Guideline Material , 2001 .

[16]  Ion Juvina,et al.  Individual differences and behavioral metrics involved in modeling web navigation , 2006, Universal Access in the Information Society.

[17]  Andrina Granic,et al.  Designing Intelligent Interfaces for e-Learning Systems: The Role of User Individual Characteristics , 2007, HCI.

[18]  Chaomei Chen,et al.  Individual differences in virtual environments-introduction and overview , 2000 .

[19]  Andrina Granic,et al.  Designing Intelligent Tutors to Adapt Individual Interaction , 2006, Universal Access in Ambient Intelligence Environments.

[20]  Peter Brusilovsky,et al.  KnowledgeTree: a distributed architecture for adaptive e-learning , 2004, WWW Alt. '04.

[21]  Susan Smith Nash,et al.  Learning Objects, Learning Object Repositories, and Learning Theory: Preliminary Best Practices for Online Courses , 2005 .

[22]  Peter Brusilovsky,et al.  User Models for Adaptive Hypermedia and Adaptive Educational Systems , 2007, The Adaptive Web.

[23]  Andrina Granic,et al.  Experience with usability evaluation of e-learning systems , 2008, Universal Access in the Information Society.

[24]  Allen Avner,et al.  Interacting with computer users: Design considerations , 1980 .

[25]  Panagiotis Zaharias E-Learning Design Quality , 2005 .

[26]  Harold F. O'Neil,et al.  Technology Applications in Education: A Learning View , 2002 .

[27]  David J. Ayersman,et al.  Individual differences, computers, and instruction , 1995 .

[28]  Peter Gregor,et al.  “User sensitive inclusive design”— in search of a new paradigm , 2000, CUU '00.

[29]  David Benyon,et al.  Special issue on intelligent interface technology: editor's introduction , 2000, Interacting with computers.

[30]  Kristina Höök,et al.  Steps to take before intelligent user interfaces become real , 2000, Interact. Comput..

[31]  J. Michael Spector,et al.  Integrated and Holistic Perspectives on Learning, Instruction and Technology , 2000 .

[32]  G. D. Magoulas,et al.  Integrating Layered and Heuristic Evaluation for Adaptive Learning Environments , 2003 .

[33]  Shu Ching Yang,et al.  Technology-enhanced language learning: A case study , 2007, Comput. Hum. Behav..

[34]  Ivan Marsic,et al.  Launching an E-Learning System in a School - Cross-European e-/m-Learning System UNITE: A Case Study , 2008, WEBIST.

[35]  Alan F. Newell,et al.  Focussing on Extra-Ordinary Users , 2007, HCI.

[36]  Michael F. McTear,et al.  Intelligent interface technology: from theory to reality? , 2000, Interact. Comput..

[37]  Matthias Schneider-Hufschmidt,et al.  Adaptive User Interfaces: Principles and Practice , 1993 .

[38]  M. Norman,et al.  Why Build Adaptive Systems , 1990 .

[39]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Five Years of Evaluations , 2005, AIED.

[40]  DillonAndrew,et al.  User analysis in HCIthe historical lessons from individual differences research , 1996 .

[41]  Markus A. Thies Adaptive User Interfaces , 1994, IFIP Congress.

[42]  Heimo H. Adelsberger,et al.  Handbook on information technologies for education and training: with 34 tables , 2008, International handbooks on information systems.

[43]  Saskia Brand-Gruwel,et al.  Students' experiences with collaborative learning in asynchronous Computer-Supported Collaborative Learning environments , 2004, Comput. Hum. Behav..

[44]  David N. Chin Empirical Evaluation of User Models and User-Adapted Systems , 2001, User Modeling and User-Adapted Interaction.

[45]  D. Bell,et al.  Self-Study from Web-Based and Printed Guideline Materials , 2000, Annals of Internal Medicine.

[46]  Andrew Dillon,et al.  User analysis in HCI - the historical lessons from individual differences research , 1996, Int. J. Hum. Comput. Stud..

[47]  David Benyon,et al.  Developing adaptive systems to fit individual aptitudes , 1993, IUI '93.

[48]  Dianne M. Murray,et al.  Adapting systems to differences between individuals , 1991 .

[49]  Ray Adams Universal Access Through Client-Centred Cognitive Assessment and Personality Profiling , 2004, User Interfaces for All.

[50]  Vincent Aleven,et al.  The Cognitive Tutor Authoring Tools (CTAT): Preliminary Evaluation of Efficiency Gains , 2006, Intelligent Tutoring Systems.

[51]  Ray Adams User Modeling for Intelligent Interfaces in e-Learning , 2007, HCI.

[52]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[53]  Elliot Soloway,et al.  Learning theory in practice: case studies of learner-centered design , 1996, CHI.

[54]  Notes from e-learning Special Interest Group (SIG) discussion at CHI 2001: Seattle, Washington, April 3, 2001 , 2001, ELERN.

[55]  Mark Guzdial,et al.  Learner-centered design: the next challenge for hci , 1994 .

[56]  Tsvi Kuflik,et al.  Mediation of user models for enhanced personalization in recommender systems , 2007, User Modeling and User-Adapted Interaction.

[57]  Kenneth R. Koedinger,et al.  Toward a Rapid Development Environment for Cognitive Tutors , 2003 .

[58]  Thomas P. Moran,et al.  New Perspectives on Human-Computer Interaction. , 1985 .

[59]  Peter Gregor,et al.  Designing for dynamic diversity: interfaces for older people , 2002, Assets '02.

[60]  Stephen J. Westerman,et al.  Individual differences in human-computer interaction , 1993 .

[61]  Ray Adams,et al.  Decision and stress: cognition and e-accessibility in the information workplace , 2007, Universal Access in the Information Society.

[62]  Jens Liegle,et al.  The effect of learning styles on the navigation needs of Web-based learners , 2006, Comput. Hum. Behav..

[63]  Beverly Park Woolf,et al.  Building a Community Memory for Intelligent Tutoring Systems , 1987, AAAI.

[64]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[65]  L. Cronbach,et al.  Aptitudes and instructional methods: A handbook for research on interactions , 1977 .

[66]  David Benyon,et al.  Individual differences and inclusive design. , 2001 .

[67]  Jenny Preece,et al.  Distance learning: a CHI 97 special interest group , 1997, SGCH.

[68]  S. Floyd,et al.  Adaptive Web , 1997 .