A Methodology for the Evaluation of Online Learning Resources.

Novel and innovative modes of interacting with website information, which necessitate methods and tools for their evaluation have arisen. However, it is essential to develop such methods from contexts of use at a macro (i.e. cultural) and micro (individual use contexts) level. Activity theory has been used extensively in systems evaluation as it bridges these two levels. This article will extend activity theory by the development of a method, Analytical Activity Method (AAM). The purpose of this method is to act as a tool to enable web designers and usability engineers to conduct usability evaluations of web interfaces, particularly the mobile web. Based on the theoretical underpinnings of activity theory, AAM seeks to extend the activity checklist (Kaptelinin, Nardi, and Macaulay, 1999) for evaluation of websites on computers or mobile devices. The application of this method contains the possibility to make visible that which was not obviously apparent from the theoretical tropes of Activity theory at system, historical and cultural level. Finally, this paper concludes that the AAM has provided a comprehensive framework within which to conduct website evaluations and informs future designs. It proposes some exciting new applications based on the AAM which not only extend activity theory but also provide a framework for understanding new methods of information access.

[1]  Cindy E. Hmelo-Silver,et al.  Problem-based learning online: multiple perspectives on collaborative knowledge construction , 2005, CSCL.

[2]  Andreas Paepcke,et al.  Seeing the whole in parts: text summarization for web browsing on handheld devices , 2001, WWW '01.

[3]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[4]  Ruven Brooks.  Comparative task analysis: an alternative direction for Human-computer interaction science , 1991 .

[5]  S. Jeff Cold.  Using Really Simple Syndication (RSS) to enhance student research , 2006, SITE.

[6]  Clay Spinuzzi,et al.  Context and consciousness: Activity theory and human-computer interaction , 1997 .

[7]  K. Kuutti.  Activity theory as a potential framework for human-computer interaction research , 1995 .

[8]  Klaus B. Bærentsen,et al.  An activity theory approach to affordance , 2002, NordiCHI '02.

[9]  Peter C. Wright,et al.  Observations and Inventions: New Approaches to the Study of Human-Computer Interaction , 1991, Interact. Comput..

[10]  Gisli Thorsteinsson,et al.  The web-orientation agent (WOA) for simulated learning in technology education , 2006, Int. J. Learn. Technol..

[11]  B. Nardi.  Studying context: a comparison of activity theory, situated action models, and distributed cognition , 1995 .

[12]  David Wasserman.  The Activity Checklist : A Tool for Representing the “ Space ” of Context , 1999 .

[13]  Susanne Bødker,et al.  Through the Interface: A Human Activity Approach To User Interface Design , 1990 .

[14]  Hanifa Shah,et al.  The Activity Theoretical Iterative Evaluation Method , 2004 .

[15]  Donald A. Norman,et al.  Words matter. talk about people: not customers, not consumers, not users , 2006, INTR.

[16]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[17]  Morten Hertzum,et al.  The Evaluator Effect: A Chilling Fact About Usability Evaluation Methods , 2001, Int. J. Hum. Comput. Interact..

[18]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[19]  Victor Kaptelinin,et al.  Computer-mediated activity: functional organs in social and developmental contexts , 1995 .

[20]  Y. Engeström,et al.  Activity theory and individual and social transformation. , 1999 .

[21]  John Millar Carroll.  HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science , 2003 .