Learning Strategies Assessed by Journal Writing: Prediction of Learning Outcomes by Quantity, Quality, and Combinations of Learning Strategies

Recently, there have been efforts to rethink assessment. Instead of informing about (relatively stable) learner characteristics, assessment should assist instruction by looking at the learning process, facilitating feedback about what students' next step in learning could be. Similarly, new forms of strategy assessment aim at capturing self-regulated learning as it happens. One potential method for such assessment is the learning journal. We analyzed whether (a) quantity and (b) quality of learning strategies assessed by learning journals predict learning outcomes, and (c) whether differently successful combinations of strategies can be identified. In Study 1, 9th graders of medium-track high schools (N = 236) wrote learning journals in mathematics during 6 weeks. Foremost, quality and quantity of cognitive strategies predicted learning outcomes, controlling for prior knowledge. Learners who combined cognitive plus metacognitive strategies were particularly successful. Learners who mainly used 1 type of strategy performed similarly poorly as did learners who hardly used strategies. Study 2 in the domain of biology learning (N = 144) essentially replicated these findings. In summary, learning journals are a useful and innovative method for assessing learning strategies.

[1]  Joseph P. Magliano,et al.  Measuring Discourse-Level Processes With Verbal Protocols and Latent Semantic Analysis , 2006 .

[2]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[3]  D. Leutner,et al.  Self-Regulated Learning with a Text-Highlighting Strategy , 2007 .

[4]  Yuk Fai Cheong,et al.  HLM 6: Hierarchical Linear and Nonlinear Modeling , 2000 .

[5]  R. Mayer Learning strategies for making sense out of expository text: The SOI model for guiding three cognitive processes in knowledge construction , 1996 .

[6]  T. Scruggs,et al.  Learning Characteristics of Verbally Gifted Students , 1983 .

[7]  R. Almond,et al.  Focus Article: On the Structure of Educational Assessments , 2003 .

[8]  Alexander Renkl,et al.  The use of public learning diaries in blended learning , 2004 .

[9]  Ivar Bråten,et al.  Students' Strategic Use of Multiple Sources During Expository Text Reading: A Longitudinal Think-Aloud Study , 2003 .

[10]  P. Pintrich The role of goal orientation in self-regulated learning. , 2000 .

[11]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[12]  B. Zimmerman Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.

[13]  F. Marton,et al.  The Experience of Learning , 1984 .

[14]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[15]  Alexander Renkl,et al.  Activation of Learning Strategies When Writing Learning Protocols: The Specificity of Prompts Matters , 2009 .

[16]  F. Marton,et al.  Approaches to learning , 2003 .

[17]  R. Mayer,et al.  Drawing as a generative activity and drawing as a prognostic activity. , 2010 .

[18]  D. Sadler,et al.  Formative Assessment: revisiting the territory , 1998 .

[19]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[20]  Helge I. Strømsø,et al.  A longitudinal think-aloud study of spontaneous strategic processing during the reading of multiple expository texts , 2003 .

[21]  C. Palau,et al.  ASSESSMENT IN EDUCATION , 2015 .

[22]  L. Diane Miller,et al.  Writing to Learn Mathematics. , 1991 .

[23]  A.J.M. de Jong,et al.  Explorations in Learning and the Brain: On the Potential of Cognitive Neuroscience for Educational Science , 2009 .

[24]  P. Pintrich,et al.  Handbook of self-regulation , 2000 .

[25]  Bernhard Schmitz,et al.  New perspectives for the evaluation of training sessions in self-regulated learning: Time-series analyses of diary data , 2006 .

[26]  Raffaella Borasi,et al.  Journal writing and mathematics instruction , 1989 .

[27]  Philip H. Winne,et al.  Measuring Self-Regulated Learning , 2000 .

[28]  B. Zimmerman,et al.  Student Differences in Self-Regulated Learning: Relating Grade, Sex, and Giftedness to Self-Efficacy and Strategy Use. , 1990 .

[29]  Matthias Nückles,et al.  Enhancing computer-supported writing of learning protocols by adaptive prompts , 2006, Comput. Hum. Behav..

[30]  Oliver Dickhäuser,et al.  Skalen zur Erfassung der Lern- und Leistungsmotivation : SELLMO , 2002 .

[31]  Peter W. Foltz,et al.  The Measurement of Textual Coherence with Latent Semantic Analysis. , 1998 .

[32]  A. Renkl,et al.  Enhancing self-regulated learning by writing learning protocols , 2009 .

[33]  A. Renkl,et al.  Do learning protocols support learning strategies and outcomes? The role of cognitive and metacognitive prompts , 2007 .

[34]  Susan R. Goldman,et al.  Students making sense of informational text: Relations between processing and representation , 1998 .

[35]  Michael Pressley,et al.  Strategies That Improve Children's Memory and Comprehension of Text , 1989, The Elementary School Journal.

[36]  L. Shepard The Role of Assessment in a Learning Culture , 2000 .

[37]  Alexander Renkl,et al.  Learning from Worked-Out-Examples: A Study on Individual Differences , 1997, Cogn. Sci..

[38]  Kirsti Lonka,et al.  Study-strategy use in learning from text. Does gender make any difference? , 2001 .

[39]  M. Chi,et al.  Eliciting Self‐Explanations Improves Understanding , 1994 .

[40]  J. Metcalfe,et al.  Metacognition : knowing about knowing , 1994 .

[41]  Peter Afflerbach,et al.  Verbal Protocols of Reading: The Nature of Constructively Responsive Reading , 1996 .

[42]  Paul H. Connolly,et al.  Writing to learn mathematics and science , 1989 .

[43]  Nancy E. Perry Young children's self-regulated learning and contexts that support it. , 1998 .

[44]  M. Boekaerts,et al.  Self-Regulation in the Classroom: A Perspective on Assessment and Intervention , 2005 .

[45]  Cordula Artelt,et al.  Wie prädiktiv sind retrospektive Selbstberichte über den Gebrauch von Lernstrategien für strategisches Lernen , 2000 .

[46]  P. Pintrich,et al.  Beyond Cold Conceptual Change: The Role of Motivational Beliefs and Classroom Contextual Factors in the Process of Conceptual Change , 1993 .

[47]  V. Shute Focus on Formative Feedback , 2008 .

[48]  Alexander Renkl,et al.  Writing learning journals: Instructional support to overcome learning-strategy deficits , 2010 .

[49]  Andrea R. McCrindle,et al.  The impact of learning journals on metacognitive and cognitive processes and learning performance , 1995 .

[50]  Joseph P. Magliano,et al.  Assessing Reading Skill With a Think-Aloud Procedure and Latent Semantic Analysis , 2003 .

[51]  Kerri L. Johnson,et al.  Why People Fail to Recognize Their Own Incompetence , 2003 .

[52]  Lyle F. Bachman Measurement: Interdisciplinary Research and Perspectives , 2013 .

[53]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[54]  Richard E. Mayer,et al.  The Teaching of Learning Strategies. , 1983 .

[55]  R. Bangert-Drowns,et al.  The Effects of School-Based Writing-to-Learn Interventions on Academic Achievement: A Meta-Analysis , 2004 .

[56]  T. O. Nelson,et al.  Why investigate metacognition , 1994 .

[57]  Roel Bosker,et al.  Modeled Variance in Two-Level Models , 1994 .

[58]  L. Resnick,et al.  Knowing, Learning, and Instruction , 2018 .