Reflecting on the think-aloud method for evaluating e-learning

E-learning is increasingly being used in higher education settings, yet research examining how students use e-resources is frequently limited. Some previous studies have used the think-aloud method (an approach with origins in cognitive psychology) as an alternative to the more usual questionnaire or focus groups, but there is little discussion in the educational literature about the advantages and disadvantages of this approach. In this paper, we discuss our experience of using the think-aloud method in a recent study, and we reflect on its potential contribution as a research method. A number of concerns about the method arose during our study, including the level of guidance given to participants, observer influence, and the complexity of data analysis. We conclude, however, that the richness of the data collected outweighs these constraints, and that the think-aloud method has the potential to enhance research in this field.

[1]  K. Gresty,et al.  Supporting biosciences in the nursing curriculum: development and evaluation of an online resource. , 2003, Journal of advanced nursing.

[2]  Synnöve Kekkonen-Moneta,et al.  E-Learning in Hong Kong: comparing learning outcomes in online multimedia and lecture versions of an introductory computing course , 2002, Br. J. Educ. Technol..

[3]  Audrey M Adams,et al.  Pedagogical underpinnings of computer-based learning. , 2004, Journal of advanced nursing.

[4]  Diana Laurillard,et al.  Rethinking University Teaching 2nd Edition: A conversational framework for the effective use of learning technologies , 2002 .

[5]  Jen Harvey,et al.  Using a toolkit to support the evaluation of learning , 2002, J. Comput. Assist. Learn..

[6]  D. Silverman Interpreting Qualitative Data: Methods for Analysing Talk, Text and Interaction , 1994 .

[7]  Robert J. Yinger,et al.  Examining thought in action: A theoretical and methodological critique of research on interactive teaching , 1986 .

[8]  Vanessa Pittard,et al.  Evidence for e-learning policy , 2004 .

[9]  John Milton,et al.  Evaluate to Improve Learning: Reflecting on the role of teaching and learning models , 2003 .

[10]  Maarten van Someren,et al.  The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes , 1994 .

[11]  Gregory L. Waddoups,et al.  Improving the quality and effectiveness of computer-mediated instruction through usability evaluations , 2004, Br. J. Educ. Technol..

[12]  Andrew McDonald,et al.  Accounting Education Through an Online-Supported Virtual Learning Environment , 2004 .