Assessing Cognitive Load on Web Search Tasks

Assessing cognitive load on web search is useful for characterizing search system features and search tasks with respect to their demands on the searcher's mental effort. It is also helpful for examining how individual differences among searchers (e.g. cognitive abilities) affect the search process. We examined cognitive load from the perspective of primary and secondary task performance. A controlled web search study was conducted with 48 participants. The primary task performance components were found to be significantly related to both the objective and the subjective task difficulty. However, the relationship between objective and subjective task difficulty and the secondary task performance measures was weaker than expected. The results indicate that the dual-task approach needs to be used with caution.

[1]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[2]  Ben Shneiderman,et al.  Structural analysis of hypertexts: identifying hierarchies and useful metrics , 1992, TOIS.

[3]  K. McGraw,et al.  A Computer Program for Conducting Mental Rotation Experiments , 1993 .

[4]  Kalervo Järvelin,et al.  Task Complexity Affects Information Seeking and Use , 1995, Inf. Process. Manag..

[5]  Kalervo Järvelin,et al.  Task complexity affects information seeking and use , 1995 .

[6]  Saul Greenberg,et al.  How people revisit web pages: empirical findings and implications for the design of history systems , 1997, Int. J. Hum. Comput. Stud..

[7]  Peter Bruza,et al.  Searching the World Wide Web made easy? the cognitive load imposed by query refinement mechanisms , 1998 .

[8]  Mark D. Tew,et al.  PsychExps: A Web-based Cognitive Psychology Laboratory , 1999, WebNet.

[9]  Pertti Vakkari,et al.  Task complexity, problem structure and information actions - Integrating studies on information seeking and retrieval , 1999, Inf. Process. Manag..

[10]  Mary Czerwinski,et al.  Individual differences in virtual environments - Introduction and overview , 2000, J. Am. Soc. Inf. Sci..

[11]  Kyung-Sun Kim,et al.  Implications of User Characteristics in Information Seeking on the World Wide Web , 2001, Int. J. Hum. Comput. Interact..

[12]  Charles Oppenheim,et al.  A model of cognitive load for IR: implications for user relevance feedback interaction , 2001 .

[13]  John E. McEneaney.  Graphic and numerical methods to assess navigation in hypertext , 2001, Int. J. Hum. Comput. Stud..

[14]  J. Ridley.  Studies of Interference in Serial Verbal Reactions , 2001 .

[15]  Preben Hansen,et al.  Work tasks as units for analysis in information seeking and retrieval studies , 2002 .

[16]  Peter Bruza,et al.  Web searching: A process-oriented experimental study of three interactive search paradigms , 2002, J. Assoc. Inf. Sci. Technol..

[17]  Katriina Byström,et al.  Information and information sources in tasks of varying complexity , 2002, J. Assoc. Inf. Sci. Technol..

[18]  George D. Magoulas,et al.  Cognitive styles and users’ responses to structured information representation , 2004, International Journal on Digital Libraries.

[19]  I. Neath,et al.  CogLab on a CD , 2003 .

[20]  Jacek Gwizdka,et al.  Individual differences and task-based user interface evaluation: a case study of pending tasks in email , 2004, Interact. Comput..

[21]  Wray L. Buntine,et al.  ALVIS: Superpeer Semantic Search Engine , 2004, EWIMT.

[22]  Ion Juvina,et al.  Individual Differences and Behavioral Aspects Involved in Modeling Web Navigation , 2004, User Interfaces for All.

[23]  Wray L. Buntine,et al.  The ALVIS Document Model for a Semantic Search Engine , 2005 .

[24]  Mika Käki,et al.  Findex: search result categories help users when document ranking fails , 2005, CHI.

[25]  Dagobert Soergel,et al.  Selecting and measuring task characteristics as independent variables , 2006, ASIST.

[26]  Martha E. Crosby,et al.  Assessing Cognitive Load with Physiological Sensors , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[27]  Jacek Gwizdka,et al.  Indirect assessment of web navigation success , 2005, CHI EA '05.

[28]  Jacek Gwizdka,et al.  What Can Searching Behavior Tell Us About the Difficulty of Information Tasks? A Study of Web Navigation , 2007, ASIST.

[29]  Elaine Toms,et al.  Task Effects on Interactive Search: The Query Factor , 2008, INEX.

[30]  Jacek Gwizdka,et al.  Implicit measures of lostness and success in web navigation , 2007, Interact. Comput..

[31]  Nicholas J. Belkin,et al.  A faceted approach to conceptualizing tasks in information seeking , 2008, Inf. Process. Manag..

[32]  Gabriella Kazai.  Initiative for the Evaluation of XML Retrieval , 2009 .

[33]  Jeonghyun Kim.  Describing and predicting information-seeking behavior on the Web , 2009 .

[34]  Mari Carmen Puerta Melguizo,et al.  The effects of the number of links and navigation support on cognitive load and learning with hypertext: The mediating role of reading order , 2009, Comput. Hum. Behav..