Searching as Learning: Exploring Search Behavior and Learning Outcomes in Learning-related Tasks

In this paper, we investigate the relationship between searching and learning, by conceptualizing information seeking as a learning process, and learning as an outcome of the information seeking process. We present the participants with four search tasks, each of them designed to represent different cognitive levels of learning. Through quantitative analysis of the participants» Web search logs, we examine how individual search behavior is influenced by different task complexity levels as we present the tasks in a hierarchical order. We also explore how the perceived learning outcomes and processes, and the different learning actions, are related to the levels of cognitive complexity. By analyzing the search logs, self-reports, interview data, and the reports, both quantitatively and qualitatively, we infer that searching and learning are not isolated but co-existing processes. Distinct search patterns and learning outcomes were observed in tasks of different cognitive complexities, and overlapping learning actions were observed for the different tasks.

[1]  Preben Hansen.  Recent advances on searching as learning : An introduction to the special issue , 2016 .

[2]  Pia Borlund,et al.  The concept of relevance in IR , 2003, J. Assoc. Inf. Sci. Technol..

[3]  Bernard J. Jansen,et al.  Using the taxonomy of cognitive learning to model online searching , 2009, Inf. Process. Manag..

[4]  Chirag Shah,et al.  Coagmento- A Collaborative Information Seeking, Synthesis and Sense-Making Framework (an integrated , 2009 .

[5]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[6]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part II. Results of a Design Study , 1982, J. Documentation.

[7]  Gerry Stahl,et al.  A Model of Collaborative Knowledge Building , 2006 .

[8]  Pertti Vakkari,et al.  Searching as learning: A systematization based on literature , 2016, J. Inf. Sci..

[9]  Kevyn Collins-Thompson,et al.  Towards searching as a learning process: A review of current perspectives and future directions , 2016, J. Inf. Sci..

[10]  M. Bloor.  The Structures of the Life-World , 1975 .

[11]  Jean Piaget.  Piaget’s Theory , 1976 .

[12]  Thomas D. Wilson,et al.  Human Information Behavior , 2000, Informing Sci. Int. J. an Emerg. Transdiscipl..

[13]  Jaime Arguello,et al.  Grannies, tanning beds, tattoos and NASCAR: evaluation of search tasks with varying levels of cognitive complexity , 2012, IIiX.

[14]  Daniel M. Russell.  What does it mean to be literate in the age of Google? , 2012, IIiX.

[15]  B. Bloom.  Taxonomy of educational objectives , 1956 .

[16]  Jaime Arguello,et al.  Development and Evaluation of Search Tasks for IIR Experiments using a Cognitive Complexity Framework , 2015, ICTIR.

[17]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part I. Background and Theory , 1997, J. Documentation.

[18]  E. List.  The Structures of the Life-World , 1977 .

[19]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[20]  Donald A. Norman,et al.  Analogical Processes in Learning , 1980 .

[21]  Terry Ryan,et al.  Enhancing student knowledge acquisition from online learning conversations , 2013, International Journal of Computer-Supported Collaborative Learning.

[22]  James Waters,et al.  Social Engagement In An Online Community Of Inquiry , 2006, ICIS.

[23]  Alice F. Artz,et al.  Development of a Cognitive-Metacognitive Framework for Protocol Analysis of Mathematical Problem Solving in Small Groups , 1992 .

[24]  Preben Hansen,et al.  Editorial: Recent advances on searching as learning: An introduction to the special issue , 2016, J. Inf. Sci..

[25]  Luanne Freund,et al.  On Measuring Learning in Search: A Position Paper , 2016, SAL@SIGIR.

[26]  Luanne Freund,et al.  Assigning search tasks designed to elicit exploratory search behaviors , 2012, HCIR '12.

[27]  B. Dervin.  AN OVERVIEW OF SENSE-MAKING RESEARCH: CONCEPTS, METHODS AND RESULTS TO DATE , 1983 .

[28]  Kevyn Collins-Thompson,et al.  Assessing Learning Outcomes in Web Search: A Comparison of Tasks and Query Strategies , 2016, CHIIR.

[29]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[30]  Peter Ingwersen,et al.  Cognitive Perspectives of Information Retrieval Interaction: Elements of a Cognitive IR Theory , 1996, J. Documentation.

[31]  Chirag Shah,et al.  Information seeking in learning‐oriented search , 2017, ASIST.

[32]  T. D. Wilson,et al.  On user studies and information needs , 2006, J. Documentation.

[33]  Chirag Shah,et al.  Coagmento: A system for supporting collaborative information seeking , 2011, ASIST.

[34]  Rebecca Reynolds,et al.  Defining, designing for, and measuring “social constructivist digital literacy” development in learners: a proposed framework , 2016 .