An analysis of an assessment model for participation in online forums

Existing online forum software support limited assessment features. This paper presents an analysis of an assessment model which has been implemented in online discussion forum software. The assessment model is aimed to automate the assessment of students' participation in online discussion forums. The model is formulated based on four different participation indicators and educators' feedback. The model was tested by a group of students who used the online forum to complete a project. Pearson product-moment correlations were calculated using the scores (performance indicator scores) generated by the model and the actual scores given by five educators. The performance indicator scores generated using the assessment formula was highly correlated with the actual grades assigned by the educators. The results suggest that the assessment model is reliable and can be used to evaluate students' participation in online discussion forums.

[1]  P. Teutsch,et al.  LONELY OUTPOURINGS OR REASONED DIALOGUE ? AN ANALYSIS OF TEXT-BASED CONFERENCING AS A TOOL TO SUPPORT LEARNING , 2000 .

[2]  Elizabeth Murphy,et al.  Students' self analysis of contributions to online asynchronous discussions , 2005 .

[3]  Robert Williams.  Automated essay grading: an evaluation of four conceptual models , 2001 .

[4]  Sunil Hazari.  Teaching Tip: Strategy for Assessment of Online Course Discussions , 2004, J. Inf. Syst. Educ..

[5]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[6]  P. Fahy.  Addressing some Common Problems in Transcript Analysis , 2001 .

[7]  Linda Harasim,et al.  Teaching and Learning On-Line: Issues in Computer-Mediated Graduate Courses , 2009 .

[8]  Vanessa Paz Dennen,et al.  Looking for evidence of learning: Assessment and analysis methods for online discourse , 2008, Comput. Hum. Behav..

[9]  Chinmoy Sahu,et al.  An evaluation of selected pedagogical attributes of online discussion boards , 2008 .

[10]  Shirley Reushle,et al.  CRITICAL ELEMENTS: DESIGNING FOR ONLINE TEACHING , 1999 .

[11]  D. Poh.  AusWeb 2002, The Eighth Australian World Wide Web Conference, held in Twin Waters Resort, Sunshine Coast, Queensland from July 6-10, 2002 , 2002 .

[12]  L.P. Dringus,et al.  Building the SCAFFOLD for evaluating threaded discussion forum activity: describing and categorizing contributions , 2004, 34th Annual Frontiers in Education, 2004. FIE 2004..

[13]  W. Popham.  Classroom Assessment: What Teachers Need to Know , 1995 .

[14]  Ann C. Jones,et al.  Conferencing in communities of learners: examples from social history and science communication , 2000, J. Educ. Technol. Soc..

[15]  Robert L. Winkler,et al.  Multiple Experts vs. Multiple Methods: Combining Correlation Assessments , 2004, Decis. Anal..

[16]  Mee Chin Wee.  A COMPUTER MANAGED INSTRUCTION (CMI) BASED TOOL TO SUPPORT INFORMATION SYSTEMS INSTRUCTIONAL PROCESSES , 2009 .

[17]  J. Mezirow.  Transformative Dimensions of Adult Learning , 1991 .

[18]  Khe Foon Hew,et al.  Examining facilitators' habits of mind and learners' participation , 2008 .

[19]  Dave S. Knowlton.  Promoting Durable Knowledge Construction through Online Discussion , 2002 .

[20]  L.P. Dringus,et al.  Evaluating threaded discussion forum activity: faculty and student perspectives on categories of activity , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[21]  Mark Pendergast.  An analysis tool for the assessment of student participation and implementation dynamics in online discussion forums , 2006, SITE.