Design issues related to the evaluation of learner – computer interaction in a web-based environment: Activities v. Tasks

If web-based technology is increasingly becoming the central plank of contemporary teaching and learning processes, there is still too little evidence to suggest that it is delivering purposeful learning activities beyond its widely perceived potential as a learning resource providing content and learning objects. This is due in part to the ‘bandwagon’ effect created by the ubiquity and popularity of the web but also because e-learning is being institutionally managed and pedagogically harnessed without serious design considerations being given to its interactive specificity, which only seem to manifest themselves through sporadic and mainly inconsequential evaluation. On this premise, this paper attempts to identify some of the main design issues involved at both conceptual and implementation levels whilst making the case for the necessary collection and subsequent analysis of valid data. Therefore, it will re-examine the role, value and means of exploitation of existing evaluative data within the design process in order to facilitate the adoption of a more appropriate conceptual approach and to better understand web-based interaction in relation to learner requirements through the application of activity theory. The ulterior motive behind this study is to show the importance and relevance of the conceptual understanding of the web as a learning interactive construct and how the learning process it is meant to generate, can be improved through targeted and integrated evaluation.

[1]  K. Kuutti Activity theory as a potential framework for human-computer interaction research , 1995 .

[2]  Philip J. Barnard,et al.  THE HANDBOOK OF TASK ANALYSIS FOR HUMAN-COMPUTER INTERACTION , 2003 .

[3]  Victor Kaptelinin,et al.  Methods & tools: The activity checklist: a tool for representing the “space” of context , 1999, INTR.

[4]  O. Bertelsen,et al.  Activity Theory , 2003 .

[5]  James Neilsen,et al.  Multimedia and hypertext: The Internet and beyond , 1995 .

[6]  John Karat,et al.  User-Centered Software Evaluation Methodologies , 1997 .

[7]  Dominique Hémard Knowledge Representations in Hypermedia CALL Authoring: Conception and Evaluation , 1998 .

[8]  Sri Hastuti Kurniawan,et al.  Review of Interaction design , 2003 .

[9]  R. Rieber,et al.  The Instrumental Method in Psychology , 1997 .

[10]  Jakob Nielsen,et al.  Hypertext and hypermedia , 1990 .

[11]  Dominique Hémard Enhancing online CALL design: The case for evaluation , 2004 .

[12]  Ray McAleese,et al.  Hypertext: State of the Art , 1990 .

[13]  Steve Cushion,et al.  From Access to Acceptability: Exploiting the Web to Design a New CALL Environment , 2000 .

[14]  Ushi Felix,et al.  Language Learning Online: Towards Best Practice , 2003 .

[15]  David Kieras,et al.  GOMS Models for Task Analysis , 2003 .

[16]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[17]  Dominique Hémard,et al.  Evaluating hypermedia structures as a means of improving language learning strategies and motivation , 2006, ReCALL.

[18]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[19]  Jakob Nielsen,et al.  Designing web usability , 1999 .

[20]  David Wasserman The Activity Checklist : A Tool for Representing the “ Space ” of Context , 1999 .

[21]  Heinz Mandl,et al.  Designing Hypermedia for Learning , 2011, NATO ASI Series.

[22]  Mike Levy,et al.  Computer-Assisted Language Learning: Context and Conceptualization , 1997 .

[23]  Keith Duncan,et al.  Cognitive Engineering , 2017, Encyclopedia of GIS.

[24]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[25]  Clay Spinuzzi,et al.  Context and consciousness: Activity theory and human-computer interaction , 1997 .

[26]  John Millar Carroll HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science , 2003 .

[27]  Ray McAleese Hypertext: Theory into Practice , 1998 .

[28]  Jay David Bolter,et al.  : Hypertext: The Convergence of Contemporary Critical Theory and Technology , 1993 .

[29]  Jeffrey Veen The Art and Science of Web Design , 2000 .

[30]  Victor Kaptelinin,et al.  Computer-mediated activity: functional organs in social and developmental contexts , 1995 .

[31]  John Long,et al.  Towards a conception for an engineering discipline of human factors. , 1989, Ergonomics.

[32]  M. Cole A cultural-historical approach to distributed cognition , 1993 .

[33]  Cliff McKnight,et al.  HyperText: A Psychological Perspective , 1992 .

[34]  D. P. Hemard,et al.  Design principles and guidelines for authoring hypermedia language learning applications , 1997 .

[35]  Lisanne Bainbridge,et al.  Verbal protocol analysis. , 1990 .

[36]  Susanne Bødker,et al.  CHAPTER 11 – Activity Theory , 2003 .

[37]  E. N. Corlett,et al.  Evaluation of human work : a practical ergonomics methodology , 1991 .

[38]  Phil Turner,et al.  Activity theory: another perspective on task analysis. , 2003 .

[39]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[40]  Robert B. Allen,et al.  Mental Models and User Models , 1997 .

[41]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[42]  Steve Cushion,et al.  Evaluation of a Web-based language learning environment: the importance of a user-centred design approach for CALL , 2001, ReCALL.

[43]  Leo J. Gugerty,et al.  The Use of Analytical Models in Human-Computer-Interface Design , 1993, Int. J. Man Mach. Stud..

[44]  A.,et al.  Cognitive Engineering , 2008, Encyclopedia of GIS.

[45]  A. N. Leont’ev,et al.  Activity, consciousness, and personality , 1978 .

[46]  B. Nardi Context and consciousness: activity theory and human-computer interaction , 1995 .