Developing metadiscourse through reflective assessment in knowledge building environments

Abstract This study examined how reflective assessment supported by principles facilitated metadiscourse for knowledge advances mediated by Knowledge Forum ® (KF). Participants were 60 tertiary students in two classes engaging in knowledge building and reflecting on their collaborative knowledge building using e-portfolios; one class was a principle-based knowledge-building environment (KBP, n = 30), and the other a regular knowledge-building environment (KBR, n = 30). The KF embedded assessment tools, the Analytical Toolkit and Applet, showed increased KF participation and connectedness during the year. Regression analysis showed that KF participation predicted conceptual understanding for both classes. Analyses of e-portfolios revealed that the students adopted nine reflective strategies in knowledge building, and that reflective metadiscourse strategies involving metacognitive and collective processes were related with deeper conceptual understanding. Analyses of online discourse threads further showed that metadiscourse involving collective processes was associated with higher levels of knowledge advances. Both classes showed improvement and the KBP class outperformed the KBR class on KF participation, metadiscourse processes and conceptual understanding. This study has theoretical implications advancing the idea of metadiscourse, discourse about discourse , for enriching research on knowledge building and computer-supported collaborative learning (CSCL). There are also design implications for using principle-based e-portfolios to facilitate collective reflection and metadiscourse to address issues of fragmented online discussion, and for promoting sustained inquiry.

[1]  Huang-Yao Hong,et al.  Exploring the development of college students' epistemic views during their knowledge building activities , 2016, Comput. Educ..

[2]  Gerry Stahl,et al.  CSCL in Asia , 2011, Int. J. Comput. Support. Collab. Learn..

[3]  S. Murthy,et al.  Using action research to improve learning and formative assessment to conduct research , 2009 .

[4]  Huei-Tse Hou.  A case study of online instructional collaborative discussion activities for problem-solving using situated scenarios: An examination of content and behavior cluster analysis , 2011, Comput. Educ..

[5]  Ming Lai,et al.  Peer Scaffolding of Knowledge Building Through Collaborative Groups with Differential Learning Experiences , 2006 .

[6]  Marlene Scardamalia,et al.  Group-level formative feedback and metadiscourse , 2015, Int. J. Comput. Support. Collab. Learn..

[7]  Ckk Chan,et al.  Collaborative knowledge building: Towards a knowledge-creation perspective , 2012 .

[8]  L. Shepard.  Formative assessment: Caveat emptor , 2005 .

[9]  Carol K. K. Chan,et al.  Student-Directed Assessment of Knowledge Building Using Electronic Portfolios , 2007 .

[10]  W. Sandoval.  Understanding Students' Practical Epistemologies and Their Influence on Learning Through Inquiry , 2005 .

[11]  Peter Goodyear,et al.  Computer-Supported Collaborative Learning: Instructional Approaches, Group Processes and Educational Designs , 2014 .

[12]  Tzu-Hua Wang,et al.  Web-based dynamic assessment: Taking assessment as teaching and learning strategy for improving students' e-Learning effectiveness , 2010, Comput. Educ..

[13]  Jianwei Zhang,et al.  Co-Organizing the Collective Journey of Inquiry With Idea Thread Mapper , 2018 .

[14]  C. Chai,et al.  Fostering a collaborative and creative climate in a college class through idea-centered knowledge-building , 2014 .

[15]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[16]  K. Hakkarainen.  Pursuit of explanation within a computer‐supported classroom , 2004 .

[17]  M. Scardamalia,et al.  Designs for Collective Cognitive Responsibility in Knowledge-Building Communities , 2009 .

[18]  D. Suthers,et al.  “Mapping to know”: The effects of representational guidance and reflective assessment on scientific inquiry , 2002 .

[19]  Gijsbert Erkens,et al.  Analyzing Interactions in CSCL: Methods, Approaches and Issues , 2010 .

[20]  Jan van Aalst,et al.  Promoting Knowledge Creation Discourse in an Asian Primary Five Classroom: Results from an inquiry into life cycles , 2011 .

[21]  Chi-Cheng Chang,et al.  Reflective behaviors under a web-based portfolio assessment environment for high school students in a computer course , 2012, Comput. Educ..

[22]  Bernard P. Veldkamp,et al.  Effects of feedback in a computer-based assessment for learning , 2012, Comput. Educ..

[23]  K. Hakkarainen.  Emergence of Progressive-Inquiry Culture in Computer-Supported Collaborative Learning , 2003 .

[24]  Ig Ibert Bittencourt,et al.  Does peer assessment in on-line learning environments work? A systematic review of the literature , 2016, Computers in Human Behavior.

[25]  Jan van Aalst,et al.  Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourses , 2009, Int. J. Comput. Support. Collab. Learn..

[26]  Gi-Zen Liu,et al.  Towards the refinement of forum and asynchronous online discussion in educational contexts worldwide: Trends and investigative approaches within a dominant research paradigm , 2014, Comput. Educ..

[27]  Antonio Fini,et al.  Visualizing and monitoring effective interactions in online collaborative groups , 2010, Br. J. Educ. Technol..

[28]  Jan M. Zottmann,et al.  Collaboration Scripts in Computer-Supported Collaborative Learning , 2013 .

[29]  L. Lipponen,et al.  Patterns of participation and discourse in elementary students’ computer-supported collaborative learning , 2003 .

[30]  Huang-Yao Hong,et al.  Towards an idea-centered, principle-based design approach to support learning as knowledge creation , 2009 .

[31]  Cindy E. Hmelo-Silver,et al.  Analyzing collaborative knowledge construction: multiple methods for integrated understanding , 2003, Comput. Educ..

[32]  Marlene Scardamalia,et al.  Knowledge building and vocabulary growth over two years, Grades 3 and 4 , 2010 .

[33]  Nobuko Fujita,et al.  Role taking and knowledge building in a blended university course , 2016, Int. J. Comput. Support. Collab. Learn..

[34]  Khe Foon Hew,et al.  Student Participation in Online Discussions: Challenges, Solutions, and Future Research , 2012 .

[35]  Crina Damsa,et al.  The multi-layered nature of small-group learning: Productive interactions in object-oriented collaboration , 2014, Int. J. Comput. Support. Collab. Learn..

[36]  Tzu-Hua Wang,et al.  Implementation of Web-based dynamic assessment in facilitating junior high school students to learn mathematics , 2011, Comput. Educ..

[37]  Carol K. K. Chan,et al.  Students assessing their own collaborative knowledge building , 2006, Int. J. Comput. Support. Collab. Learn..

[38]  Shigenori Inagaki,et al.  Knowledge-building activity structures in Japanese elementary science pedagogy , 2006, Int. J. Comput. Support. Collab. Learn..

[39]  Carol K. K. Chan,et al.  Fostering collective and individual learning through knowledge building , 2014, International Journal of Computer-Supported Collaborative Learning.

[40]  John D. Bransford,et al.  New Assessments and Environments for Knowledge Building , 2012 .

[41]  Huang-Yao Hong,et al.  Sustaining Knowledge Building as a Principle-Based Innovation at an Elementary School , 2011 .

[42]  M. Scardamalia,et al.  “Good Moves” in knowledge-creating dialogue , 2016 .

[43]  Carol K. K. Chan,et al.  Reflective assessment in knowledge building by students with low academic achievement , 2016, International Journal of Computer-Supported Collaborative Learning.

[44]  M. Scardamalia.  Collective cognitive responsibility for the advancement of knowledge , 2002 .

[45]  Jim Hewitt.  Toward an Understanding of How Threads Die in Asynchronous Computer Conferences , 2005 .

[46]  G. Cizek,et al.  Handbook of Formative Assessment. , 2010 .

[47]  Yanqing Sun,et al.  Metadiscourse on Collective Knowledge Progress to Inform Sustained Knowledge-Building Discourse , 2015 .

[48]  Khe Foon Hew,et al.  Attracting student participation in asynchronous online discussions: A case study of peer facilitation , 2008, Comput. Educ..

[49]  Pierre Dillenbourg,et al.  What we know about CSCL and implementing it in higher education , 2004 .

[50]  Hyo-Jeong So,et al.  Designing collaborative knowledge building environments accessible to all learners: Impacts and design challenges , 2010, Comput. Educ..

[51]  Jan van Aalst,et al.  Fixed group and opportunistic collaboration in a CSCL environment , 2015, International Journal of Computer-Supported Collaborative Learning.

[52]  Huang-Yao Hong,et al.  Schools as Knowledge-Building Organizations: Thirty Years of Design Research , 2016 .

[53]  M. Scardamalia,et al.  Socio-cognitive dynamics of knowledge building in the work of 9- and 10-year-olds , 2007 .

[54]  Gerry Stahl,et al.  Group Cognition: Computer Support for Building Collaborative Knowledge (Acting with Technology) , 2006 .

[55]  Michelene T. H. Chi,et al.  Theoretical Perspectives, Methodological Approaches, and Trends in the Study of Expertise , 2011 .

[56]  Paul A. Kirschner,et al.  Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research , 2003, Comput. Hum. Behav..