Promoting learning in online, ill-structured problem solving: The effects of scaffolding type and metacognition level

Abstract This study aims to identify the effects of scaffolding type (supportive or reflective) and metacognition level (low or high) on presence, problem-solving performance, and achievement in online ill-structured problem solving. One hundred forty-eight students who enrolled in a college-level course on instructional design participated in this study in South Korea. The course was delivered as eight sessions led by the same instructor using the same content, and four of them were provided with supportive scaffolding, while the other four with reflective scaffolding. All of them were given an ill-structured problem of designing a lesson plan for a three-week project in a web-based learning environment without any face-to-face classes or meetings, and were asked to go through five stages of problem-solving. Metacognition and presence were measured using survey instruments, while problem-solving performance and achievement were measured using a rubric and quiz items, respectively. Data were analyzed using two-way MANOVA and ANCOVA, using pretest scores as a covariate. The results indicated that the reflective scaffolding group scored higher on cognitive and social presence, and also on problem representation, monitoring and evaluation in problem-solving performance than the supportive scaffolding group. The reflective scaffolding group also showed higher achievement than did the supportive scaffolding group. There was a significant interaction effect between scaffolding types and metacognition level on teaching presence and achievement. The results provide implications on the design of scaffolding for online ill-structured problem solving activities in association with learner characteristics.

[1]  D. Jonassen.  Learning to Solve Problems: An Instructional Design Guide , 2009 .

[2]  Kathryn S. Lee,et al.  Inquiry of pre-service teachers’ concern about integrating Web 2.0 into instruction , 2017 .

[3]  Sam Wineburg,et al.  Reading Abraham Lincoln: An Expert/Expert Study in the Interpretation of Historical Texts , 1998, Cogn. Sci..

[4]  Daniel C. Moos,et al.  Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? , 2008 .

[5]  이철희,et al.  The Design and Development of a Web-based Learning Environment for Problem-Solving Applying Cognitive Apprenticeship , 2005 .

[6]  Peter Shea,et al.  Learning presence: Towards a theory of self-efficacy, self-regulation, and the development of a communities of inquiry in online and blended learning environments , 2010, Comput. Educ..

[7]  Alan H. Schoenfeld,et al.  Mathematical Problem Solving , 1985 .

[8]  D. Garrison,et al.  Researching the community of inquiry framework: Review, issues, and future directions , 2007, Internet High. Educ..

[9]  David H. Jonassen,et al.  Learning to Solve Problems with Technology: A Constructivist Perspective , 2002 .

[10]  R. L. Dominowski,et al.  Metacognition and problem solving : A process-oriented approach. , 1995 .

[11]  P. Pintrich.  A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ). , 1991 .

[12]  C. Gunawardena,et al.  Social presence as a predictor of satisfaction within a computer‐mediated conferencing environment , 1997 .

[13]  Karen M. Zabrucky,et al.  METACOMPREHENSION AND COMPREHENSION PERFORMANCE IN YOUNGER AND OLDER ADULTS , 1997 .

[14]  Susan M. Land,et al.  Supporting College Students' Ill-Structured Problem Solving in a Web-Based Learning Environment , 2010 .

[15]  Ching-Huei Chen,et al.  Effectiveness and Impact of Technology-Enabled Project-Based Learning with the Use of Process Prompts in Teacher Education. , 2011 .

[16]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[17]  Kyu Yon Lim,et al.  A Qualitative Analysis of a Web-based Collaborative Problem Solving Process: Scaffolding Types and Communication Patterns , 2016 .

[18]  Mel Slater,et al.  Presence in immersive virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[19]  R. Mayer.  Cognitive, metacognitive, and motivational aspects of problem solving , 1998 .

[20]  Marcel S. Kerr,et al.  Metacognition and Freshman Academic Performance. , 2000 .

[21]  Thomas Brush,et al.  The Use of Embedded Scaffolds with Hypermedia-Supported Student-Centered Learning , 2001 .

[22]  Michael J. Hannafin,et al.  Scaffolding problem solving in technology-enhanced learning environments (TELEs): Bridging research and theory with practice , 2011, Comput. Educ..

[23]  James D. Klein,et al.  The Impact of Scaffolding and Student Achievement Levels in a Problem-based Learning Environment , 2007 .

[24]  David H. Jonassen,et al.  Toward a design theory of problem solving , 2000 .

[25]  H. Barrows.  Problem‐based learning in medicine and beyond: A brief overview , 1996 .

[26]  A. Brown.  Metacognition, executive control, self-regulation, and other more mysterious mechanisms , 1987 .

[27]  Annelies Raes,et al.  Scaffolding information problem solving in web-based collaborative inquiry learning , 2012, Comput. Educ..

[28]  Esther Kapa,et al.  A Metacognitive Support during the Process of Problem Solving in a Computerized Environment , 2001 .

[29]  Susan Pedersen,et al.  Scaffolding middle school students’ content knowledge and ill-structured problem solving in a problem-based hypermedia learning environment , 2010 .

[30]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[31]  Minjeong Kim.  Identifying types of peer feedback improving learners’ ill-structured task performance & Developing their instructional strategies , 2011 .

[32]  Elizabeth A. Davis,et al.  Scaffolding students' knowledge integration: prompts for reflection in KIE , 2000 .

[33]  Stephen G. Powell,et al.  How novices formulate models. Part I: qualitative insights and implications for teaching , 2007, J. Oper. Res. Soc..

[34]  Michael J. Hannafin,et al.  Teaching and learning in digital environments: The resurgence of resource-based learning , 2001 .

[35]  J. Flavell.  Metacognition and Cognitive Monitoring: A New Area of Cognitive-Developmental Inquiry. , 1979 .

[36]  Arthur L. Costa.  Mediating the Metacognitive. , 1984 .

[37]  Patricia M. King,et al.  Reflective judgment: Concepts of justification and their relationship to age and education☆ , 1981 .

[38]  Zehra Akyol,et al.  Understanding cognitive presence in an online and blended community of inquiry: Assessing outcomes and processes for deep approaches to learning , 2011, Br. J. Educ. Technol..

[39]  Susan M. Land,et al.  Open learning environments: Foundations, methods, and models , 2013 .

[40]  Allyson F. Hadwin,et al.  CoNoteS2: A Software Tool for Promoting Self-Regulation , 2001 .

[41]  F. Fischer,et al.  Epistemic and social scripts in computer–supported collaborative learning , 2005 .

[42]  J. Sinnott.  A model for solution of ill-structured problems: Implications for everyday and abstract problem solving. , 1989 .

[43]  Joseph Krajcik,et al.  A Framework for Supporting Metacognitive Aspects of Online Inquiry Through Software-Based Scaffolding , 2005 .

[44]  Douglas Archibald,et al.  Fostering the development of cognitive presence: Initial findings using the community of inquiry survey instrument , 2010, Internet High. Educ..

[45]  Seon-young Jang.  The Effects of Scaffolding Types on the Problem-Solving Phases in an online learning environment , 2008 .

[46]  Minjuan Wang,et al.  Cybergogy for Engaged Learning: A Framework for Creating Learner Engagement through Information and Communication Technology , 2006 .

[47]  Krista Glazewski,et al.  A scaffolding framework to support the construction of evidence-based arguments among middle school students , 2008 .

[48]  D. Garrison,et al.  Critical thinking, cognitive presence, and computer conferencing in distance education , 2001 .

[49]  Hae Deok Song,et al.  Instructional Design Principles for Scaffolding Problem-based Learning in a Multimedia-based Learning Environment , 2010 .

[50]  Heather Kanuka,et al.  The influence of instructional methods on the quality of online discussion , 2006, Br. J. Educ. Technol..

[51]  M. Chi,et al.  Problem-Solving Ability. , 1985 .

[52]  David H. Jonassen,et al.  Instructional design models for well-structured and III-structured problem-solving learning outcomes , 1997 .

[53]  Min Liu,et al.  The Effects of Modeling Expert Cognitive Strategies during Problem-Based Learning , 2002 .

[54]  David H. Jonassen,et al.  Handbook of Individual Differences, Learning, and Instruction , 1993 .

[55]  David H. Jonassen,et al.  The effects of argumentation scaffolds on argumentation and problem solving , 2002 .

[56]  D. Randy Garrison,et al.  Cognitive presence in online learning , 2004, J. Comput. High. Educ..

[57]  K. Schwab.  The Fourth Industrial Revolution , 2013 .

[58]  Terri E. Varnado.  The Effects of a Technological Problem Solving Activity on FIRST™ LEGO™ League Participants' Problem Solving Style and Performance , 2005 .

[59]  Peter Shea,et al.  Learning presence as a moderator in the community of inquiry model , 2012, Comput. Educ..

[60]  K. Hew,et al.  Use of Web 2.0 Technologies in K-12 and Higher Education: The Search for Evidence-Based Practice. , 2013 .

[61]  Dragan Gasevic,et al.  Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions , 2015, Internet High. Educ..

[62]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[63]  Kursat Cagiltay,et al.  Scaffolding strategies in electronic performance support systems: types and challenges , 2006 .

[64]  D. Randy Garrison,et al.  Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education , 1999, Internet High. Educ..

[65]  Nian-Shing Chen,et al.  A creative thinking approach to enhancing the web-based problem solving performance of university students , 2014, Comput. Educ..

[66]  Joseph Krajcik,et al.  Scaffolding Design Guidelines for Learner-Centered Software Environments , 2002 .

[67]  Effects of Sportscasting and Scaffolding Types on Problem Solving Abilities and Achievement , 2015 .

[68]  Carrie Heeter,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[69]  D. Garrison,et al.  Toward the development of a metacognition construct for communities of inquiry , 2013, Internet High. Educ..

[70]  Yun-Jo An,et al.  Examining the Effects of Metacognitive Scaffolding on Students' Design Problem Solving and Metacognitive Skills in an Online Environment , 2014 .

[71]  M. E. Gredler,et al.  Learning and Instruction: Theory into Practice , 1986 .

[72]  Susan M. Land,et al.  A conceptual framework for scaffolding III-structured problem-solving processes using question prompts and peer interactions , 2004 .

[73]  Susan M. Land,et al.  Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions , 2003 .

[74]  D. Randy Garrison,et al.  A Theory Of Critical Inquiry In Online Distance Education , 2003 .

[75]  Thomas Brush,et al.  Scaffolding critical reasoning about history and social issues in multimedia-supported learning environments , 2002 .

[76]  Stephen M. Fiore,et al.  Scaffolding cognitive and metacognitive processes in low verbal ability learners: Use of diagrams in computer-based training environments , 2002 .

[77]  Walter Wager,et al.  Presenting questions, processing responses, and providing feedback in CAI , 1985 .

[78]  Jeong-Im Choi.  A study on the problem design principle for Problem-Based Learning through the case analysis , 2004 .

[79]  Timothy A. Post,et al.  On the solving of ill-structured problems. , 1988 .