Applying multilevel modelling on content analysis data : Methodological issues in the study of the impact of role assignment in asynchronous discussion groups

This study focuses on the process, output, and interpretation of multilevel analyses on quantitative content analysis data derived from asynchronous discussion group transcripts. The impact of role assignments on the level of knowledge construction reflected in students’ contributions and the relation between message characteristics and these levels of knowledge construction is studied. Results show that summarisers’ contributions and contributions focussing on theory, content moderating, or summaries result in significantly higher levels of knowledge construction. Multilevel modelling handles the hierarchical nesting, interdependency, and unit of analysis problem and is presented as a suitable technique for studying content analysis data from CSCL-environments.

[1]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[2]  W. Jochems,et al.  The Effect of Functional Roles on Group Efficiency , 2004 .

[3]  M. Valcke,et al.  The Impact of Role Assignment on Knowledge Construction in Asynchronous Discussion Groups , 2005 .

[4]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[5]  D. Garrison,et al.  Methodological Issues in the Content Analysis of Computer Conference Transcripts , 2007 .

[6]  Tammy Schellens,et al.  Collaborative learning in asynchronous discussion groups: What about the impact on cognitive processing? , 2005, Comput. Hum. Behav..

[7]  Allan C. Tagg.  Leadership from Within: Student Moderation of Computer Conferences. , 1994 .

[8]  Tammy Schellens,et al.  Learning in asynchronous discussion groups: a multilevel approach to study the influence of student, group and task characteristics , 2007, Behav. Inf. Technol..

[9]  Joop J. Hox,et al.  Multilevel modeling: When and why , 1998 .

[10]  Judith B. Pena-Shaff,et al.  Analyzing student interactions and meaning construction in computer bulletin board discussions , 2004, Comput. Educ..

[11]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[12]  J. Hox,et al.  Sample sizes for multilevel modeling , 2002 .

[13]  J. J. Hox,et al.  Hierarchical Regression Models for Interviewer and Respondent Effects , 1994 .

[14]  Curtis J. Bonk,et al.  Content analysis of online discussion in an applied educational psychology course , 2000 .

[15]  Bryan W. Griffin,et al.  Review of Multilevel Modeling and Multilevel Studies in The Journal of Educational Research (1992-2002) , 2004 .

[16]  Elizabeth G. Cohen,et al.  Designing Groupwork: Strategies for the Heterogeneous Classroom , 1986 .

[17]  Andrew J. Flanagin,et al.  Group performance and collaborative technology: a longitudinal and multilevel analysis of information quality, contribution equity, and members' satisfaction in computer‐mediated groups , 2004 .

[18]  Rose M. Marra,et al.  Content analysis of online discussion forums: A comparative analysis of protocols , 2004 .

[19]  H. Goldstein.  Multilevel Statistical Models , 2006 .

[20]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[21]  M. Chiu,et al.  A New Method for Analyzing Sequential Processes , 2005 .