Examining Information Processing on the World Wide Web Using Think Aloud Protocols

Some theorists argue that the node-link design of the Web mimics human information storage and that Web use encourages individuals to process information efficiently and effectively, potentially increasing meaningful learning. However, critics claim that Web navigation increases cognitive load and often produces disorientation. This reduces the processing devoted to meaningful learning, and, thus the Web may potentially inhibit learning. In an examination of information processing on the Web using a quantitative analysis of think aloud protocols, we found that users spend a substantial proportion of their cognitive effort orienting to the content and structure of the Web, and this effort comes at the expense of elaborative and evaluative processing. Additional findings suggest that, at least during a single relatively short session, time spent in a given site does not reduce the processing devoted to orientation. Finally, this paper offers a theoretically informed strategy for analyzing information processing activities that may be of use to other scholars.

[1]  Mark A. Horney.  Uses of hypertext , 1991, J. Comput. High. Educ..

[2]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[3]  D. Kahneman.  Attention and Effort , 1973 .

[4]  Wilhelmina C. Savenye,et al.  Effects of learner control, advisement, and prior knowledge on young students' learning in a hypertext environment , 1994 .

[5]  Robert L. Greene,et al.  Human Memory: Paradigms and Paradoxes , 1992 .

[6]  Rosemary J. Stevenson,et al.  Effects of Text Structure and Prior Knowledge of the Learner on Navigation in Hypertext , 1998, Hum. Factors.

[7]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[8]  M. McDaniel,et al.  Generation and precision of elaboration: Effects on intentional and incidental learning. , 1987 .

[9]  David Watkins,et al.  The Internal Structure and Predictive Validity of the Inventory of Learning Processes: Some Australian and Filipino Data , 1981 .

[10]  Sigmar-Olaf Tergan,et al.  Misleading theoretical assumptions in hypertext/hypermedia research , 1997 .

[11]  Jörg M. Haake,et al.  Hypermedia and cognition: designing for comprehension , 1995, CACM.

[12]  Richard E. Mayer,et al.  Elaboration techniques that increase the meaningfulness of technical text: An experimental test of the learning strategy hypothesis. , 1980 .

[13]  E. Perse.  Media involvement and local news effects , 1990 .

[14]  G. Salomon.  The differential investment of mental effort in learning from different sources , 1983 .

[15]  Eliot R. Smith,et al.  Limits on perception of cognitive processes: A reply to Nisbett and Wilson. , 1978 .

[16]  Claire E. Weinstein,et al.  ASSESSING LEARNING STRATEGIES: THE DESIGN AND DEVELOPMENT OF THE LASSI , 1988 .

[17]  Wayne A. Wickel.  HUMAN LEARNING AND MEMORY , 1981 .

[18]  Dale J. Prediger,et al.  Coefficient Kappa: Some Uses, Misuses, and Alternatives , 1981 .

[19]  William P. Eveland,et al.  Applying Research on the Uses and Cognitive Effects of Hypermedia to the Study of the World Wide Web , 2001 .

[20]  A. Dillon,et al.  Hypermedia as an Educational Technology: A Review of the Quantitative Research Literature on Learner Comprehension, Control, and Style , 1998 .

[21]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[22]  Ann F. Bevilacqua.  Hypertext: Behind the Hype. , 1989 .

[23]  Gary Marchionini,et al.  Hypermedia and learning: freedom and chaos , 1988 .

[24]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[25]  K. Krippendorff.  Bivariate Agreement Coefficients for Reliability of Data , 1970 .

[26]  Harri Oinas-Kukkonen,et al.  Fourth generation hypermedia: some missing links for the World Wide Web , 1997, Int. J. Hum. Comput. Stud..

[27]  R. Rust,et al.  Reliability Measures for Qualitative Data: Theory and Implications , 1994 .

[28]  Rudy Darken,et al.  Navigating large virtual spaces , 1996, Int. J. Hum. Comput. Interact..

[29]  Ronald R. Schmeck,et al.  Academic Achievement and Individual Differences in Learning Processes , 1979 .

[30]  Paulo Dias,et al.  Understanding navigation and disorientation in hypermedia learning environments , 1997 .

[31]  Hamilton.  Effects of Three Types of Elaboration on Learning Concepts from Text , 1997, Contemporary educational psychology.

[32]  Philippe C. Duchastel,et al.  Examining Cognitive Processing in Hypermedia Usage , 1990, Hypermedia.

[33]  Frederick X. Gibbons,et al.  Motivational Biases in Causal Attributions of Arousal , 1981 .

[34]  C. Kardash,et al.  Self-reported learning strategies and learning from expository text , 1991 .

[35]  Richard J. Hamilton,et al.  The Effects of Learner-Generated Elaborations on Concept Learning from Prose , 1989 .

[36]  Roy Rada,et al.  Interacting With Hypertext: A Meta-Analysis of Experimental Studies , 1996, Hum. Comput. Interact..

[37]  W. D. Perreault,et al.  Reliability of Nominal Data Based on Qualitative Judgments , 1989 .

[38]  Ronald R. Schmeck,et al.  RELATIONSHIPS BETWEEN MEASURES OF LEARNING STYLE AND READING COMPREHENSION , 1980 .

[39]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[40]  Jeff Conklin,et al.  Hypertext: An Introduction and Survey , 1987, Computer.

[41]  S McDonald,et al.  Disorientation in hypertext: the effects of three text structures on navigation performance. , 1996, Applied ergonomics.

[42]  Eileen Wood,et al.  Elaborative Interrogation Facilitates Adult Learning of Factual Paragraphs , 1990 .

[43]  R. T. Kellogg,et al.  When can we introspect accurately about mental processes? , 1982, Memory & cognition.

[44]  David H. Jonassen,et al.  Designing structured hypertext and structuring access to hypertext , 1988 .

[45]  Michael Pressley,et al.  Use of elaborative interrogation to help students acquire information consistent with prior knowledge and information inconsistent with prior knowledge , 1994 .

[46]  Rachelle S. Heller,et al.  The Role of Hypermedia in Education: A Look at the Research Issues. , 1990 .

[47]  Hanhwe Kim,et al.  Spatial metaphors and disorientation in hypertext browsing , 1995, Behav. Inf. Technol..

[48]  Gavriel Salomon,et al.  Introducing AIME: The assessment of children's mental involvement with television , 1981 .

[49]  P. R. Churcher,et al.  A Common Notation for Knowledge Representation, Cognitive Models, Learning and Hypertext , 1989, Hypermedia.

[50]  Detlev Leutner,et al.  Learning Strategies for Unstructured Hypermedia—A Framework for Theory, Research, and Practice , 1995 .

[51]  Jeremy W. Crampton,et al.  A Cognitive Analysis of Wayfinding Expertise , 1992 .

[52]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[53]  Dario Lucarella,et al.  Browsing and searching in hypertext systems , 1993, J. Comput. High. Educ..

[54]  Licia Calvi.  Navigation and disorientation: a case study , 1997 .

[55]  David Watkins,et al.  THE LEARNING PROCESSES OF AUSTRALIAN UNIVERSITY STUDENTS: INVESTIGATIONS OF CONTEXTUAL AND PERSONOLOGICAL FACTORS , 1981 .

[56]  Patricia A. Alexander,et al.  Learning and study strategies : issues in assessment, instruction, and evaluation , 1988 .

[57]  M. Hannafin,et al.  Cognitive strategies and learning from the world wide web , 1997 .

[58]  Peter Wright,et al.  Retrospective reports on the causes of decisions. , 1981 .

[59]  David H. Jonassen,et al.  Acquiring Structural Knowledge from Semantically Structured Hypertext. , 1992 .

[60]  Chia-jer Tsai,et al.  Hypertext: Technology, Applications, and Research Issues , 1988 .

[61]  R. Dixon,et al.  Adult age differences in elaborations produced during prose recall. , 1991, Psychology and aging.

[62]  Robert B. Kozma,et al.  The Implications of Cognitive Psychology for Computer-Based Learning Tools , 1987 .

[63]  Hsinchun Chen,et al.  Browsing in hypertext: a cognitive study , 1992, IEEE Trans. Syst. Man Cybern..

[64]  R. Schmeck,et al.  Development of a Self-Report Inventory for Assessing Individual Differences in Learning Processes , 1977 .

[65]  Gary R. Morrison,et al.  Using elaboration strategies training in computer-based instruction to promote generative learning , 1992 .

[66]  William P. Eveland,et al.  Users and navigation patterns of a science World Wide Web site for the public , 1998 .

[67]  Wayne A. Nelson,et al.  Learning, Instruction, and Hypermedia. , 1992 .

[68]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[69]  Charles K. Turner.  Don't Blame Memory for People's Faulty Reports on What Influences their Judgments , 1988 .