Looking for evidence of learning: Assessment and analysis methods for online discourse

Discussion is a required component of many Web-based classes, but do we really know its value or contribution to learning? Students may be graded for participation, and number and length of posts may be counted by those evaluating or researching online classes, but all too often the assessment and analysis methods that we use fail to provide us with data that indicate learning took place through participation in online discussion. This paper explores what can be learned by currently popular assessment practices and analytic methods, as well as the limitations of these methods when used to measure learning, using two samples of discussion threads from online classes.

[1]  R. Stake.  The art of case study research , 1995 .

[2]  Tim Hand,et al.  Enhancing Quality in Online Learning: Scaffolding Planning and Design Through Proactive Evaluation , 2002 .

[3]  Marie-Noëlle Lamy,et al.  ’Reflective conversation’ in the virtual language classroom , 2005 .

[4]  Frances Slack,et al.  Assessment and Learning Outcomes: The Evaluation of Deep Learning in an On-line Course , 2003, J. Inf. Technol. Educ..

[5]  Rose M. Marra,et al.  Content analysis of online discussion forums: A comparative analysis of protocols , 2004 .

[6]  Terry Anderson,et al.  Exploring Social Communication in Computer Conferencing , 2002 .

[7]  A. P. Rovai.  Development of an instrument to measure classroom community , 2002, Internet High. Educ..

[8]  C. Gunawardena.  Social Presence Theory and Implications for Interaction and Collaborative Learning in Computer Conferences , 1995 .

[9]  Vanessa P. Dennen,et al.  From Message Posting to Learning Dialogues: Factors affecting learner participation in asynchronous discussion , 2005 .

[10]  David H. Jonassen,et al.  Mapping alternative discourse structures onto computer conferences , 2002, Int. J. Knowl. Learn..

[11]  F. Fischer,et al.  A framework to analyze argumentative knowledge construction in computer-supported collaborative learning , 2006, Comput. Educ..

[12]  Martin Valcke,et al.  The problem arena of researching computer supported collaborative learning: Introduction to the special section , 2006, Comput. Educ..

[13]  James R. Layton,et al.  No Significant Difference Phenomenon , 1999, J. Educ. Technol. Soc..

[14]  Vanessa P. Dennen,et al.  Intersubjectivity: Facilitating Knowledge Construction in Online Environments , 2001 .

[15]  Linda M. Harasim,et al.  Online Education: Perspectives on a New Environment , 1990 .

[16]  I. Jung,et al.  Effects of Different Types of Interaction on Learning Achievement, Satisfaction and Participation in Web-Based Instruction , 2002 .

[17]  Robin Goodfellow,et al.  "Reflective Conversation" in the Virtual Classroom , 1999 .

[18]  James Paul Gee,et al.  话语分析入门 : 理论与方法 = An introduction to discourse analysis : theory and method , 1999 .

[19]  Karen Swan,et al.  The Role of Social Presence in Online Courses: How Does it Relate to Students’ Perceived Learning and Satisfaction? , 2001 .

[20]  Zane L. Berge,et al.  Design Guidelines for Web-Based Courses , 2000 .

[21]  Vanessa Paz Dennen,et al.  Task Structuring for On-line Problem Based Learning: A Case Study , 2000, J. Educ. Technol. Soc..

[22]  T. Russo,et al.  Prestige, Centrality, and Learning: A Social Network Analysis of an Online Class , 2005 .

[23]  Diana Laurillard,et al.  Rethinking University Teaching: A Framework for the Effective Use of Educational Technology , 1993 .

[24]  K. Holmes,et al.  Analysis of asynchronous online discussion using the SOLO Taxonomy , 2005 .

[25]  David W. Nelson,et al.  The Past, Present, and Future of Research in Distance Education , 2006 .

[26]  M. D. Roblyer,et al.  Design and Use of a Rubric to Assess and Encourage Interactive Qualities in Distance Courses , 2003 .

[27]  Trena M. Paulus,et al.  Researching "collaborative knowledge building" in formal distance learning environments , 2005, CSCL.

[28]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[29]  Eileen Scanlon,et al.  Investigating cooperation and collaboration in near synchronous computer mediated conferences , 2006, Comput. Educ..

[30]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[31]  Jim Hewitt.  Toward an Understanding of How Threads Die in Asynchronous Computer Conferences , 2005 .

[32]  David W. Nelson,et al.  The Past, Present, and Future of Research in Distance Education: Results of a Content Analysis , 2004 .

[33]  Allan Jeong.  The Sequential Analysis of Group Interaction and Critical Thinking in Online , 2003 .

[34]  Daniel V. Eastmond.  E-Moderating: The Key to Teaching and Learning Online , 2003 .

[35]  Liam Rourke,et al.  Validity in quantitative content analysis , 2004 .

[36]  G. Stahl.  Building collaborative knowing: elements of a social theory of CSCL , 2004 .

[37]  유창조.  Naturalistic Inquiry , 2022, The SAGE Encyclopedia of Research Design.

[38]  Sanna Järvelä,et al.  Analyzing CMC content for what? , 2006, Comput. Educ..

[39]  Lindsay Hewson,et al.  Social Processes and Pedagogy in Online Learning , 2005 .

[40]  Lin Muilenburg,et al.  How Do Students Participate in Synchronous and Asynchronous Online Discussions? , 2001 .

[41]  D. Garrison,et al.  Assessing Social Presence In Asynchronous Text-based Computer Conferencing , 1999 .

[42]  Beverly Abbey,et al.  网络教育 : 教学与认知发展新视角 = Instructional and Cognitive Impacts of Web -Based Education , 1999 .