Learners’ use of SNA-based discourse analysis as a self-assessment tool for collaboration

In this paper, we examine a methodology for assessing ‘21st century skills’ in the classroom. We have developed a tool named the knowledge building discourse explorer (KBDeX) to facilitate social network analysis-based analysis of collaborative learning discourses. A purpose of this study is to assess the capability of KBDeX as a self-assessment tool for learners. An experimental study was conducted with seven university students, and the results were qualitatively evaluated. This paper presents four cases of students using the tool, and analyses the following: 1 the semantic relationship of words 2 trend analysis using degree centrality charts 3 analysis of pivotal points, phases, and characteristics of the discussion 4 analysis of a social network by using semantics. We confirmed satisfactory results that student findings fit within the theoretical framework of the network analysis and were grounded by discourse data.

[1]  Igarashi Ryo,et al.  Development and Application of a Method for the Analysis of Classroom Discussions : Visualizing Mutual Links between Utterances in Transcripts , 2008 .

[2]  M. Scardamalia,et al.  Designs for Collective Cognitive Responsibility in Knowledge-Building Communities , 2009 .

[3]  Vic Lally,et al.  Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for Social Network Analysis , 2007, Int. J. Comput. Support. Collab. Learn..

[4]  Carol K. K. Chan,et al.  Student-Directed Assessment of Knowledge Building Using Electronic Portfolios , 2007 .

[5]  A. Sfard.  On Two Metaphors for Learning and the Dangers of Choosing Just One , 1998 .

[6]  John D. Bransford,et al.  New Assessments and Environments for Knowledge Building , 2012 .

[7]  R. Bennett,et al.  Transforming K–12 Assessment: Integrating Accountability Testing, Formative Assessment and Professional Support , 2009 .

[8]  M. Scriven.  The methodology of evaluation , 1966 .

[9]  Eva L. Baker,et al.  Differential Improvement in Student Understanding of Mathematical Principles Following Formative Assessment Intervention , 2011 .

[10]  Jan van Aalst,et al.  Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourses , 2009, Int. J. Comput. Support. Collab. Learn..

[11]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[12]  Yan Zhao,et al.  Analyzing Actors and Their Discussion Topics by Semantic Social Network Analysis , 2006, Tenth International Conference on Information Visualisation (IV'06).

[13]  Jan-Willem Strijbos,et al.  Assessment of (Computer-Supported) Collaborative Learning , 2011, IEEE Transactions on Learning Technologies.

[14]  Carol K. K. Chan,et al.  Students assessing their own collaborative knowledge building , 2006, Int. J. Comput. Support. Collab. Learn..

[15]  J. Herman,et al.  Defining Twenty-First Century Skills , 2012 .

[16]  Christopher Teplovs.  Visualization of Knowledge Spaces to Enable Concurrent, Embedded and Transformative Input to Knowledge Building Processes , 2010 .

[17]  Sanshiro Sakai,et al.  KBDeX: A Platform for Exploring Discourse in Collaborative Learning , 2011, Procedia - Social and Behavioral Sciences.

[18]  Daniel D. Suthers,et al.  A framework for conceptualizing, representing, and analyzing distributed interaction , 2010, Int. J. Comput. Support. Collab. Learn..

[19]  A. Strauss,et al.  The Discovery of Grounded Theory , 1967 .

[20]  Detlef Schoder,et al.  Correlating Performance With Social Network Structure Through Teaching Social Network Analysis , 2006, PRO-VE.

[21]  L. Lipponen,et al.  Models of Innovative Knowledge Communities and Three Metaphors of Learning , 2004 .

[22]  Elizabeth Bagley,et al.  Epistemic network analysis : a Prototype for 21 st Century assessment of Learning , 2009 .

[23]  M. Scardamalia.  Collective cognitive responsibility for the advancement of knowledge , 2002 .

[24]  Carl Bereiter,et al.  Education and Mind in the Knowledge Age , 2002 .

[25]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[26]  Peter A. Gloor,et al.  Coolhunting: Chasing Down the Next Big Thing , 2007 .

[27]  Susan A. Yoon.  Using Social Network Graphs as Visualization Tools to Influence Peer Selection Decision-Making Strategies to Access Information About Complex Socioscientific Issues , 2011 .

[28]  U. Wilensky,et al.  Complex Systems in Education: Scientific and Educational Importance and Implications for the Learning Sciences , 2006 .

[29]  I. Nonaka,et al.  How Japanese Companies Create the Dynamics of Innovation , 1995 .

[30]  Yoshiaki Matsuzawa,et al.  Knowledge Building Discourse Explorer: a social network analysis application for knowledge building discourse , 2012 .

[31]  Detlef Schoder,et al.  Web Science 2.0: Identifying Trends through Semantic Social Network Analysis , 2008, 2009 International Conference on Computational Science and Engineering.

[32]  Peter A. Gloor,et al.  Adding Taxonomies Obtained by Content Clustering to Semantic Social Network Analysis , 2010 .

[33]  M. Taras,et al.  ASSESSMENT – SUMMATIVE AND FORMATIVE – SOME THEORETICAL REFLECTIONS , 2005 .