Development of Task Understanding and Monitoring in Information Retrieval Environments: Demystifying Metacognitive and Self-Regulatory Mechanisms in Graduate Learners Using Topic Maps Indexing Technologies to Improve Essay-Writing Skills

The empirical research reported in this chapter explores learner metacognition and self-regulation in information retrieval environments equipped with a powerful indexing technology called Topic Maps. The theoretical foundation for our work lies in the nexus of theories of self-regulation and those of cognitive information retrieval. Through a series of mixed-method studies conducted at the Topic Maps laboratory at Concordia University, we describe academic self-regulatory processes associated with graduate learners’ understandings of ill-structured academic writing tasks and attempt to relate them to learners’ metacognitive ability to judge their own performance on iterations of these writing tasks. The thirty-eight participants in the studies described in this chapter used the Topic Maps ­technology throughout a semester to navigate a repository of instructor-annotated essays. The repository was designed not only to help learners complete their own writing assignments, but also to improve their task understanding and better calibrate their performance from one instantiation of the writing assignment to the next. Results are discussed in light of the novel intra-sample statistical analyses used to uncover relationships between academic performance, metacognition and task understanding.

[1]  Li Cao,et al.  The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy , 2006 .

[2]  Richard Andrews,et al.  The End of the Essay? , 2003 .

[3]  Ricardo A. Baeza-Yates,et al.  Information retrieval in the Web: beyond current search engines , 2003, Int. J. Approx. Reason..

[4]  Christian D. Schunn,et al.  Peer-based computer-supported knowledge refinement: an empirical investigation , 2008, CACM.

[5]  J. Frederiksen,et al.  Inquiry, Modeling, and Metacognition: Making Science Accessible to All Students , 1998 .

[6]  Vivek Venkatesh,et al.  The Missing Link to Enhanced Course Management Systems: Adopting Learning Content Management Systems in the Educational Sphere , 2005 .

[7]  Yusuke Hayashi,et al.  When the Domain of the Ontology is Education , 2007 .

[8]  Kevin F. Collis,et al.  Evaluating the Quality of Learning: The SOLO Taxonomy , 1977 .

[9]  Michel Crampes,et al.  Éditorial du numéro spécial "Les ontologies pour les EIAH" , 2004 .

[10]  P. Ingwersen Cognitive Information Retrieval. , 1999 .

[11]  Philip H. Winne,et al.  Students’ calibration of knowledge and learning processes: Implications for designing powerful software learning environments , 2004 .

[12]  Li Cao,et al.  Metacognitive Monitoring Accuracy and Student Performance in the Postsecondary Classroom. , 2005 .

[13]  J. Biggs Enhancing teaching through constructive alignment , 1996 .

[14]  Linda Schamber,et al.  Time-line interviews and inductive content analysis: their effectiveness for exploring cognitive behaviors , 2000 .

[15]  Vivek Venkatesh,et al.  Topic Maps as Indexing Tools in the Educational Sphere: Theoretical Foundations, Review of Empirical Research and Future Challenges , 2010 .

[16]  Ian Begg,et al.  Memory monitoring: How useful is self-knowledge about memory? , 1992 .

[17]  Vivek Venkatesh,et al.  Topic Maps: Adopting User-Centred Indexing Technologies in Course Management Systems , 2007 .

[18]  Päivi Tynjälä,et al.  Writing as a Learning Tool: Integrating Theory and Practice. Studies in Writing, Volume 7. , 2001 .

[19]  Lars Marius Garshol,et al.  Metadata? Thesauri? Taxonomies? Topic Maps! Making Sense of it all , 2004, J. Inf. Sci..

[20]  Vivek Venkatesh,et al.  Topic maps as indexing tools in e-learning: bridging theoretical and practical gaps between information retrieval and educational psychology , 2008, Int. J. Adv. Media Commun..

[21]  J. Dunlosky,et al.  Age differences in the allocation of study time account for age differences in memory performance , 1997, Memory & cognition.

[22]  Craig K. Enders,et al.  A Monte Carlo Comparison of Measures of Relative and Absolute Monitoring Accuracy , 2006 .

[23]  Jennifer Wiley,et al.  Foundational Studies 1-1-2005 Understanding the Delayed-Keyword Effect on Metacomprehension Accuracy , 2013 .

[24]  P. Cappon,et al.  Post-Secondary Education in Canada: Strategies for Success. , 2008 .

[25]  P. Tynjälä Writing, Learning And The Development Of Expertise In Higher Education , 2001 .

[26]  Understanding Knowledge Services at Natural Resources Canada , 2007 .

[27]  Gregory Schraw,et al.  The Effect of Knowledge and Strategy Training on Monitoring Accuracy , 2002 .

[28]  B. Zimmerman,et al.  Self-regulation: Where metacognition and motivation intersect. , 2009 .

[29]  John Biggs Teaching for learning : the view from cognitive psychology , 1991 .

[30]  Gregory Schraw,et al.  A Further Test of the General Monitoring Skill Hypothesis. , 1998 .

[31]  David Williamson Shaffer,et al.  What Good are Statistics that Don’t Generalize? , 2004 .

[32]  Marek Hatala,et al.  Ontology mappings to improve learning resource search , 2006, Br. J. Educ. Technol..

[33]  Z. Mevarech,et al.  The effects of IMPROVE on mathematical knowledge, mathematical reasoning and meta-cognition , 2006 .

[34]  Jacqueline Bourdeau,et al.  Development of a knowledge base as a tool for contextualized learning , 2005, AI & SOCIETY.

[35]  N. Schmajuk Cognitive maps , 1998 .

[36]  C. Carmean,et al.  Course Management Systems for Learning: Beyond Accidental Pedagogy , 2005 .

[37]  Douglas J. Hacker,et al.  Metacognition in educational theory and practice. , 1998 .

[38]  Bob J. Wielinga,et al.  The added value of task and ontology-based markup for information retrieval , 2004, J. Assoc. Inf. Sci. Technol..

[39]  Sari Lindblom-Ylänne,et al.  Can a collaborative network environment enhance essay-writing processes? , 2003, Br. J. Educ. Technol..

[40]  Gregory Schraw,et al.  Does a General Monitoring Skill Exist , 1995 .

[41]  Vivek Venkatesh,et al.  Uncovering Relationships between Task Understanding and MonitoringProficiencies in Postsecondary Learners: Comparing Work Task andLearner as Statistical Units of Analyses , 2011 .

[42]  Vivek Venkatesh,et al.  "Investigating Task Understanding in Online Repositories Equipped with Topic Map Indexes: Implications for Improving Self-Regulatory Processes in Graduate Learners" , 2008 .

[43]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[44]  V. Venkatesh,et al.  Exploring counter-theoretical instances of graduate learners’ self-regulatory processes when using an online repository , 2012 .

[45]  William R. Hersh,et al.  A task-oriented approach to information retrieval evaluation , 1996 .

[46]  M. Pressley,et al.  Introduction to Memory Development During Childhood and Adolescence , 1997 .