Interplay of metacognitive experiences and performance in collaborative problem solving

Abstract Metacognitive experiences are the feelings and judgments that emerge in relation to an ongoing learning task. Much of the work on metacognitive experiences has studied these constructs piecemeal and mostly in individual learning settings. Thus, little is known about how metacognitive experiences co-occur in social learning settings. In light of this, we investigated the relationships between metacognitive experiences and their impact on perceived and objective task performance in a collaborative problem solving (CPS) simulation. Seventy-seven higher education students participated in the study. Metacognitive experiences (judgment of confidence, mental effort, task difficulty, task interest, and emotional valence) were measured with self-reports at multiple time points during CPS. A path analysis was conducted to investigate the relationship between metacognitive experiences and perceived performance. A generalized estimating equation was used to observe the relationships between metacognitive experiences and objective group CPS performance. Overall, the findings indicate complex relationships among the metacognitive experiences and performance in CPS and further highlight the social characteristics of metacognition.

[1]  A. Efklides.  Metacognition Defining : Its Facets and Levels of Functioning in Relation to Self-Regulation and Co-regulation , 2008 .

[2]  David W. Johnson,et al.  Effects of cooperative, competitive, and individualistic goal structures on achievement: A meta-analysis. , 1981 .

[3]  J. Eccles.  Who Am I and What Am I Going to Do With My Life? Personal and Collective Identities as Motivators of Action , 2009 .

[4]  Dragan Gasevic,et al.  Relevance of learning analytics to measure and support students' learning in adaptive educational technologies , 2017, LAK.

[5]  David A. Bergin,et al.  Social Influences on Interest , 2016 .

[6]  Peggy P. Chen,et al.  Self-regulation, motivation, and math achievement in middle school: variations across grade level and math context. , 2009, Journal of school psychology.

[7]  A. Koriat.  Metacognition: Decision making Processes in Self-monitoring and Self-regulation , 2015 .

[8]  J. Eccles,et al.  Motivational beliefs, values, and goals. , 2002, Annual review of psychology.

[9]  R. Cavalcanti,et al.  Am I Right When I Am Sure? Data Consistency Influences the Relationship Between Diagnostic Accuracy and Certainty , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Peggy A. Ertmer,et al.  Self-Regulation and Academic Learning , 2000 .

[11]  J. Hair.  Multivariate data analysis , 1972 .

[12]  A. Efklides,et al.  Individual differences in feelings of difficulty: The case of school mathematics , 1998 .

[13]  Kazuo Furuta,et al.  Effects of metacognition in cooperation on team behaviors , 2014, Cognition, Technology & Work.

[14]  Bennett L. Schwartz,et al.  Motivation and Affect in Self-Regulated Learning : Does Metacognition Play a Role? , 2017 .

[15]  Anne C. Frenzel,et al.  The Control-Value Theory of Achievement Emotions: An Integrative Approach to Emotions in Education , 2007 .

[16]  Reinhard Pekrun,et al.  Boredom and academic achievement: Testing a model of reciprocal causation , 2014 .

[17]  J. Sweller,et al.  Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions , 2005 .

[18]  Lauren B. Resnick,et al.  Shared cognition: Thinking as social practice , 1991, Perspectives on socially shared cognition.

[19]  Carol Forsyth,et al.  Exploring social and cognitive dimensions of collaborative problem solving in an open online simulation-based task , 2020, Comput. Hum. Behav..

[20]  M. Vauras,et al.  Socially shared metacognition of dyads of pupils in collaborative mathematical problem-solving processes , 2011 .

[21]  J. Funke,et al.  Beyond IQ: A Latent State-Trait Analysis of General Intelligence, Dynamic Decision Making, and Implicit Learning , 2011 .

[22]  Joachim Funke,et al.  Negative affective environments improve complex solving performance , 2010 .

[23]  M. Csíkszentmihályi,et al.  Beyond Boredom and Anxiety: The Experience of Play in Work and Games. , 1977 .

[24]  Michel Tuan Pham,et al.  When Do People Rely on Affective and Cognitive Feelings in Judgment? A Review , 2011, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[25]  Brigid Barron.  When Smart Groups Fail , 2003 .

[26]  Dale H. Schunk,et al.  Self-Regulated Learning and Performance : An Introduction and an Overview , 2011 .

[27]  N. B. Dohn.  Upper Secondary Students’ Situational Interest: A case study of the role of a zoo visit in a biology class , 2013 .

[28]  M. Vauras,et al.  Socially-shared metacognition in peer learning? , 2004 .

[29]  Cindy E. Hmelo-Silver,et al.  The role of regulation in medical student learning in small groups: Regulating oneself and others' learning and emotions , 2015, Comput. Hum. Behav..

[30]  Wondimu Ahmed,et al.  Emotions, Self-Regulated Learning, and Achievement in Mathematics: A Growth Curve Analysis , 2013 .

[31]  Olivia B. Newton,et al.  Macrocognition in Teams and Metacognition: Developing Instructional Strategies for Complex Collaborative Problem Solving , 2018 .

[32]  John Dunlosky,et al.  Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention , 2012 .

[33]  Günter Daniel Rey,et al.  The expertise reversal effect: cognitive load and motivational explanations. , 2011, Journal of experimental psychology. Applied.

[34]  J. Janssen,et al.  Task-related and social regulation during online collaborative learning , 2012 .

[35]  A. Efklides.  Metacognitive Experiences in Problem Solving , 2001 .

[36]  Daniel J. Brass,et al.  Efficacy-Performing Spirals: A Multilevel Perspective , 1995 .

[37]  Regina Vollmeyer,et al.  FAM: Ein Fragebogen zur Erfassung aktuller Motivation in Lern- und Leistungssituationen , 2001 .

[38]  Gregory Schraw,et al.  Situational Interest in Literary Text , 1997, Contemporary educational psychology.

[39]  Anthony J. Nyberg,et al.  Collective efficacy, group potency, and group performance: meta-analyses of their relationships, and test of a mediation model. , 2009, The Journal of applied psychology.

[40]  Jeroen Janssen,et al.  Fostering complex learning-task performance through scripting student use of computer supported representational tools , 2010, Comput. Educ..

[41]  Ana María Fernández Dobao,et al.  Collaborative writing in pairs and small groups: Learners' attitudes and perceptions , 2013 .

[42]  Miguel Nussbaum,et al.  Technology as small group face-to-face Collaborative Scaffolding , 2009, Comput. Educ..

[43]  T. Goetz,et al.  Achievement goals, emotions, learning, and performance : A process model , 2015 .

[44]  A. Efklides.  Metacognition and Affect: What Can Metacognitive Experiences Tell Us about the Learning Process?. , 2006 .

[45]  Angela Stewart,et al.  Towards a generalized competency model of collaborative problem solving , 2020, Comput. Educ..

[46]  M. Goos,et al.  Socially mediated metacognition: creating collaborative zones of proximal development in small group problem solving , 2002 .

[47]  Derek Larkin,et al.  Academic self-efficacy in study-related skills and behaviours: relations with learning-related emotions and academic success. , 2013, The British journal of educational psychology.

[48]  Sanna Järvelä,et al.  Self-Regulation, Co-Regulation, and Shared Regulation in Collaborative Learning Environments , 2017 .

[49]  P. Silvia.  Interest and Interests: The Psychology of Constructive Capriciousness , 2001 .

[50]  A. Efklides.  Interactions of Metacognition With Motivation and Affect in Self-Regulated Learning: The MASRL Model , 2011 .

[51]  Ang Chen,et al.  What constitutes situational interest? Validating a construct in physical education. , 1999 .

[52]  Slava Kalyuga.  Expertise Reversal Effect and Its Implications for Learner-Tailored Instruction , 2007 .

[53]  Ann L. Brown.  Knowing When, Where, and How to Remember: A Problem of Metacognition. Technical Report No. 47. , 1977 .

[54]  Asher Koriat,et al.  The intricate relationships between monitoring and control in metacognition: lessons for the cause-and-effect relation between subjective experience and behavior. , 2006, Journal of experimental psychology. General.

[55]  Jean-Marc Odobez,et al.  Theories and Models of Teams and Groups , 2017 .

[56]  Angela Stewart,et al.  Connecting the Dots Towards Collaborative AIED: Linking Group Makeup to Process to Learning , 2018, AIED.

[57]  S. Narciss,et al.  Regulation During Cooperative and Collaborative Learning: A Theory-Based Review of Terms and Concepts , 2015 .

[58]  Muhterem Dindar,et al.  What does physiological synchrony reveal about metacognitive experiences and group performance? , 2020, Br. J. Educ. Technol..

[59]  LuJingyan,et al.  The role of regulation in medical student learning in small groups , 2015 .

[60]  Sigal G. Barsade,et al.  Group Affect , 2012 .

[61]  Z. Özcan,et al.  A modeling study to explain mathematical problem-solving performance through metacognition, self-efficacy, motivation, and anxiety , 2019, Australian Journal of Education.

[62]  M. Croon,et al.  Predicting group-level outcome variables from variables measured at the individual level: a latent variable multilevel model. , 2007, Psychological methods.

[63]  Friedrich W. Hesse,et al.  A Framework for Teachable Collaborative Problem Solving Skills , 2015 .

[64]  Sanna Järvelä,et al.  Examining shared monitoring in collaborative learning: A case of a recurrence quantification analysis approach , 2019, Comput. Hum. Behav..

[65]  John Hattie,et al.  Calibration and confidence: Where to next? , 2013 .

[66]  Fred Paas,et al.  Effects of performance feedback valence on perceptions of invested mental effort , 2017 .

[67]  J. Flavell.  Metacognition and Cognitive Monitoring: A New Area of Cognitive-Developmental Inquiry. , 1979 .

[68]  Moffat Mathews,et al.  The Effects of Domain and Collaboration Feedback on Learning in a Collaborative Intelligent Tutoring System , 2011, AIED.

[69]  T. O. Nelson.  Metamemory: A Theoretical Framework and New Findings , 1990 .

[70]  T. Garavan,et al.  Team Learning and Metacognition: A Neglected Area of HRD Research and Practice , 2008 .

[71]  A. Koriat,et al.  Judgments of learning depend on how learners interpret study effort. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[72]  Arthur C. Graesser,et al.  Building Intelligent Conversational Tutors and Mentors for Team Collaborative Problem Solving: Guidance from the 2015 Program for International Student Assessment , 2018, Research on Managing Groups and Teams.

[73]  Daniel L. Dinsmore,et al.  Focusing the Conceptual Lens on Metacognition, Self-regulation, and Self-regulated Learning , 2008 .

[74]  Nikolai Olavi Czajkowski,et al.  Children's emotions in math problem solving situations: Contributions of self-concept, metacognitive experiences, and performance , 2015 .

[75]  Allyson F. Hadwin,et al.  Emotions and emotion regulation in undergraduate studying: examining students’ reports from a self-regulated learning perspective , 2015 .

[76]  Asher Koriat,et al.  Metacognition and consciousness. , 2007 .

[77]  Rakefet Ackerman,et al.  Metacognitive regulation of text learning: on screen versus on paper. , 2011, Journal of experimental psychology. Applied.

[78]  A. Koriat,et al.  Conscious and Unconscious Metacognition: A Rejoinder , 2000, Consciousness and Cognition.

[79]  J. Hattie,et al.  The Power of Feedback , 2007 .

[80]  Amber Chauncey Strain,et al.  Interest-based text preference moderates the effect of text difficulty on engagement and learning , 2015 .

[81]  James C. Lester,et al.  Beyond cold technology: A systematic review and meta-analysis on emotions in technology-based learning environments , 2018, Learning and Instruction.

[82]  Anastasia Efklides,et al.  Effects of mood on students' metacognitive experiences , 2005 .

[83]  M. Tulis,et al.  Changes in interest and affect during a difficult reading task: Relationships with perceived difficulty and reading fluency , 2013 .

[84]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[85]  Samuel Greiff,et al.  The assessment of collaborative problem solving in PISA 2015: Can computer agents replace humans? , 2020, Comput. Hum. Behav..

[86]  M. Vauras,et al.  Social Interaction - What Can It Tell Us about Metacognition and Coregulation in Learning? , 2005 .

[87]  A. Efklides.  The role of metacognitive experiences in the learning process. , 2009, Psicothema.

[88]  Anique B. H. de Bruin,et al.  Monitoring and regulation of learning in medical education: the need for predictive cues , 2017, Medical education.

[89]  Heng-Yu Ku,et al.  Collaboration factors, teamwork satisfaction, and student attitudes toward online collaborative learning , 2013, Comput. Hum. Behav..

[90]  Jonna Malmberg,et al.  How do types of interaction and phases of self-regulated learning set a stage for collaborative engagement? , 2016 .

[91]  J. Twisk,et al.  Applied Longitudinal Data Analysis for Epidemiology: A Practical Guide , 2003 .

[92]  P. Griffin,et al.  Assessment of Collaborative Problem Solving in Education Environments , 2016 .

[93]  Richard E. Clark,et al.  Yin and Yang Cognitive Motivational Processes Operating in Multimedia Learning Environments , 2004 .

[94]  Robert M. Klassen,et al.  A Question of Calibration: A Review of the Self-Efficacy Beliefs of Students with Learning Disabilities , 2002 .

[95]  F. Paas.  Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[96]  Markku Niemivirta,et al.  Predictors and outcomes of situational interest during a science learning task , 2013 .

[97]  Erich C. Dierdorff,et al.  Members Matter in Team Training: Multilevel and Longitudinal Relationships Between Goal Orientation, Self‐Regulation, and Team Outcomes , 2012 .

[98]  J. Eccles,et al.  Expectancy-Value Theory of Achievement Motivation. , 2000, Contemporary educational psychology.

[99]  John Dunlosky,et al.  Agenda-based regulation of study-time allocation: when agendas override item-based monitoring. , 2009, Journal of experimental psychology. General.

[100]  S. Branje,et al.  Internalizing and externalizing problems in immigrant boys and girls , 2014 .

[101]  N. Hall,et al.  Emotion and achievement in the classroom , 2019, Visible Learning Guide to Student Achievement.

[102]  Carl Gutwin,et al.  Heuristic Evaluation of Groupware Based on the Mechanics of Collaboration , 2001, EHCI.

[103]  Anastasia Efklides,et al.  Metacognitive knowledge of effort, personality factors, and mood state: their relationships with effort-related metacognitive experiences , 2006 .

[104]  M. Boekaerts,et al.  Using Multiple Calibration Indices in Order to Capture the Complex Picture of What Affects Students' Accuracy of Feeling of Confidence. , 2010 .

[105]  D. Kahneman.  Attention and Effort , 1973 .

[106]  M. Vauras,et al.  Individual contributions in student-led collaborative learning: Insights from two analytical approaches to explain the quality of group outcome , 2017 .

[107]  Slava Kalyuga,et al.  Instruction-first and problem-solving-first approaches: alternative pathways to learning complex tasks , 2017 .

[108]  Michael D. McNeese,et al.  Skilled and Unaware: The Interactive Effects of Team Cognition, Team Metacognition, and Task Confidence on Team Performance , 2017 .

[109]  P. Paoloni,et al.  Hope and anxiety in physics class: Exploring their motivational antecedents and influence on metacognition and performance , 2017 .

[110]  Mary Ainley,et al.  Students, tasks and emotions: Identifying the contribution of emotions to students' reading of popular culture and popular science texts , 2005 .

[111]  A. Koriat.  Monitoring one's own knowledge during study : A cue-utilization approach to judgments of learning , 1997 .

[112]  Allyson Hadwin,et al.  The learning kit project: Software tools for supporting and researching regulation of collaborative learning , 2010, Comput. Hum. Behav..

[113]  Phillip M. Mangos,et al.  The Role of Subjective Task Complexity in Goal Orientation, Self-Efficacy, and Performance Relations , 2001 .

[114]  S. Järvelä,et al.  Convergences of Joint, Positive Interactions and Regulation in Collaborative Learning , 2019, Small Group Research.

[115]  Carolyn M. Jagacinski,et al.  Confronting task difficulty in ego involvement: Change in performance goals , 2011 .

[116]  Ellen Kok,et al.  Optimizing self-regulation of performance: is mental effort a cue? , 2018, Advances in health sciences education : theory and practice.

[117]  Muhterem Dindar,et al.  Matching self-reports with electrodermal activity data: Investigating temporal changes in self-regulated learning , 2019, Education and Information Technologies.

[118]  Reinhard Pekrun,et al.  Beyond test anxiety: Development and validation of the test emotions questionnaire (TEQ) , 2004 .

[119]  Suzanne Hidi,et al.  Interest: A unique motivational variable , 2006 .

[120]  Po-Yao Chao,et al.  An analysis of student collaborative problem solving activities mediated by collaborative simulations , 2017, Comput. Educ..

[121]  T. Collins,et al.  Increasing Research Productivity in Undergraduate Research Experiences: Exploring Predictors of Collaborative Faculty–Student Publications , 2017, CBE life sciences education.

[122]  C. Hmelo‐Silver,et al.  Facilitating Collaborative Knowledge Building , 2008 .

[123]  Samuel Greiff,et al.  Collaborative Problem Solving Measures in the Programme for International Student Assessment (PISA) , 2017 .

[124]  K. Ann Renninger,et al.  Studying Triggers for Interest and Engagement Using Observational Methods , 2015 .

[125]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[126]  A. Hadwin,et al.  Regulation and socio-emotional interactions in a positive and a negative group climate , 2018 .

[127]  Allyson F. Hadwin,et al.  Calibration in goal setting: Examining the nature of judgments of confidence , 2013 .

[128]  David F. Feldon,et al.  Self-efficacy change associated with a cognitive load-based intervention in an undergraduate biology course , 2018, Learning and Instruction.

[129]  Tamara van Gog,et al.  Improving self-monitoring and self-regulation: From cognitive psychology to the classroom , 2012 .

[130]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .