Evaluating quality in online asynchronous interactions between students and discussion facilitators

Online discussion forums have become an essential part of university courses, whether the course is conducted online, or face to face, or in mixed or blended mode. Discussion forums are considered to engage students better with the course content and encourage them to share and gain knowledge from each other. However, online engagement does not always happen automatically between students. Hence grading of discussion forum participation has been recommended to ensure quality student participation. Currently, a major focus has been put onto the better use of discussion forums, but the way in which the quality of participation can be evaluated has yet to be adequately investigated. Furthermore, evaluation of the instructor participation in a discussion forum and its impact on students and their contributions is lacking. In this paper, we report on our research into online discussion forum quality through analysis of discussion forum activities, along with student focus group meetings and instructor interviews. We have devised a set of criteria for evaluating discussion forum activities. Our results show that students depend highly on the instructor's feedback and the participation of the students can only be evaluated with reference to the moderation of the instructors.

[1]  Anthony Kaye,et al.  Collaborative Learning Through Computer Conferencing: The Najaden Papers , 2012 .

[2]  John Cowan,et al.  Reconceptualising moderation in asynchronous online discussions using grounded theory , 2010 .

[3]  H. Russell Bernard,et al.  Social Research Methods: Qualitative and Quantitative Approaches , 2000 .

[4]  Shijuan Liu Assessing Online Asynchronous Discussion in Online Courses: An Empirical Study , 2007 .

[5]  John Cowan,et al.  Choices of approaches in e-moderation: Conclusions from a grounded theory study , 2010 .

[6]  Ruth S. Burkett,et al.  Using an Electronic Bulletin Board in Science Teacher Education: Issues and Trade-Offs. , 2004 .

[7]  Reem Al-Mahmood,et al.  Relearning through e-learning :changing conceptions of teaching through online experience , 2004 .

[8]  Judy Sheard,et al.  Modelling learner and educator interactions in an electronic learning community , 2003 .

[9]  Diana Laurillard,et al.  Rethinking University Teaching: A Framework for the Effective Use of Educational Technology , 1993 .

[10]  Philippa Gerbic,et al.  To post or not to post : undergraduate student perceptions about participating in online discussions , 2006 .

[11]  C. Weaver,et al.  What Encourages Student Participation in Online Discussions , 2010 .

[12]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[13]  Khe Foon Hew,et al.  Examining facilitators' habits of mind in an asynchronous online discussion environment: A two cases study , 2010 .

[14]  Julie Bradshaw,et al.  Benefits of An Online Discussion List in A Traditional Distance Education Course , 2004 .

[15]  Alfred P. Rovai,et al.  Online and traditional assessments: what is the difference? , 2000, Internet High. Educ..

[16]  Mike Sharples,et al.  The design of personal mobile technologies for lifelong learning , 2000, Comput. Educ..

[17]  K. Seo Utilizing Peer Moderating in Online Discussions: Addressing the Controversy between Teacher Moderation and Nonmoderation , 2007 .

[18]  Margaret Mazzolini,et al.  Sage, guide or ghost? The effect of instructor intervention on student participation in online discussion forums , 2003, Comput. Educ..

[19]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[20]  Allison Peraya,et al.  Creating web-integrated learning environments: An analysis of WebCT authoring tools in respect to usability , 2000 .

[21]  Amy S. C. Leh Action Research on Hybrid Courses and their Online Communities , 2002 .

[22]  K. Meyer Quality in Distance Education: Focus on On-Line Learning. ASHE-ERIC Higher Education Report. Jossey-Bass Higher and Adult Education Series. , 2002 .

[23]  D. Garrison,et al.  Critical thinking, cognitive presence, and computer conferencing in distance education , 2001 .

[24]  Kel Jackson,et al.  What value assessment rubrics in shaping students' engagement in asynchronous online discussions? , 2010 .

[25]  D. Newman,et al.  A Content Analysis Method to Measure Critical Thinking in Face-to-Face and Computer Supported Group Learning , 1995 .

[26]  W. Neuman,et al.  Social Research Methods: Qualitative and Quantitative Approaches , 2002 .

[27]  A. P. Rovai Building Sense of Community at a Distance , 2002, Distances et médiations des savoirs.

[28]  Christopher Essex,et al.  Synchronous and asynchronous communication tools in distance education , 2001 .

[29]  Dorit Maor,et al.  Changing relationship: Who is the learner and who is the teacher in the online educational landscape? , 2008 .

[30]  Sandrine Balbo,et al.  A conceptual framework for assessing interaction quality in online discussion forums , 2009 .

[31]  Terry Anderson,et al.  E-Learning in the 21st Century: A Community of Inquiry Framework for Research and Practice , 2016 .

[32]  Tanya McGill,et al.  The effect of assessment on the outcomes of asynchronous online discussion as perceived by instructors , 2009 .

[33]  Diana Laurillard,et al.  Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies. 2nd Edition , 1993 .

[34]  A. Strauss,et al.  The Discovery of Grounded Theory , 1967 .

[35]  Pamela Jordan Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[36]  Brent Muirhead,et al.  E-tivities: The key to active online learning , 2002, J. Educ. Technol. Soc..

[37]  Annegret Goold,et al.  An Examination of the Role of the E-Tutor. , 2010 .

[38]  Mark Guzdial,et al.  Exploring the lack of dialogue in computer-supported collaborative learning , 2002, CSCL.

[39]  Margaret Mazzolini,et al.  When to jump in: The role of the instructor in online discussion forums , 2007, Comput. Educ..

[40]  Caroline Steel,et al.  Reconciling university teacher beliefs to create learning designs for LMS environments , 2009 .