Cognitive presence in virtual collaborative learning: Assessing and improving critical thinking in online discussion forums

Purpose The purpose of this study is to introduce a virtual collaborative learning setting called “Net Economy”, which we established as part of an international learning network of currently six universities, and present our approach to continuously improve the course in each cycle. Design/methodology/approach Using the community of inquiry framework as guidance and canonical action research (CAR) as the chosen research design, the discussion forum of the online course is assessed regarding its critical thinking value. We thereby measure critical thinking with the help of the according model provided by Newman et al. (1995), which differentiates 40 indicators of critical thinking from 10 different categories. Findings The calculated critical thinking ratios for the analyzed two discussion threads indicate a strong use of outside knowledge, intensive justification and critical assessment of posts by the students. But at the same time, there are also weak spots, like manifold repetitions. Based on these results, we derive changes for the next course cycle to improve the critical thinking of the students. Originality/value A comparison of the results after the next course cycle will then allow us to assess the effects of the implemented changes, which would not be possible without a critical thinking diagnosis approach.

[1]  Daniel V. Eastmond E-Moderating: The Key to Teaching and Learning Online , 2003 .

[2]  D. Garrison Critical Thinking and Adult Education: A Conceptual Model for Developing Critical Thinking in Adult Learners. , 1991 .

[3]  Curtis J. Bonk,et al.  Content analysis of online discussion in an applied educational psychology course , 2000 .

[4]  Terry Anderson,et al.  E-Learning in the 21st Century: A Community of Inquiry Framework for Research and Practice , 2016 .

[5]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[6]  D. Garrison,et al.  Critical thinking, cognitive presence, and computer conferencing in distance education , 2001 .

[7]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[8]  Judy McKay,et al.  The dual imperatives of action research , 2001, Inf. Technol. People.

[9]  Qiyun Wang,et al.  Using Weblog to Promote Critical Thinking – An Exploratory Study , 2009 .

[10]  Alan D. Carswell,et al.  Learner outcomes in an asynchronous distance education environment , 2002, Int. J. Hum. Comput. Stud..

[11]  Qiyun Wang,et al.  Investigating critical thinking and knowledge construction in an interactive learning environment , 2009, Interact. Learn. Environ..

[12]  D. Newman,et al.  A Content Analysis Method to Measure Critical Thinking in Face-to-Face and Computer Supported Group Learning , 1995 .

[13]  Bridget D. Arend Encouraging Critical Thinking in Online Threaded Discussions. , 2009 .

[14]  Martin A. Andresen Asynchronous Discussion Forums: Success Factors, Outcomes, Assessments, and Limitations , 2009, J. Educ. Technol. Soc..

[15]  Margaret Mazzolini,et al.  Sage, guide or ghost? The effect of instructor intervention on student participation in online discussion forums , 2003, Comput. Educ..

[16]  D. Randy Garrison,et al.  Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education , 1999, Internet High. Educ..

[17]  Steve Joordens,et al.  Assessing the effectiveness of a voluntary online discussion forum on improving students' course performance , 2011, Comput. Educ..

[18]  Robert M. Davison,et al.  Principles of canonical action research , 2004, Inf. Syst. J..

[19]  Timothy J. Newby,et al.  Using Socratic Questioning to Promote Critical Thinking Skills Through Asynchronous Discussion Forums in Distance Learning Environments , 2005 .

[20]  G. Susman,et al.  An Assessment of the Scientific Merits of Action Research. , 1978 .

[21]  David Newman,et al.  Evaluating the Quality of Learning in Computer Supported Co-Operative Learning , 1997, J. Am. Soc. Inf. Sci..

[22]  M. Bullen PARTICIPATION AND CRITICAL THINKING IN ONLINE UNIVERSITY DISTANCE EDUCATION , 1998 .

[23]  Gilly Salmon,et al.  E-moderating: the key to teaching and learning online , 2003 .

[24]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[25]  Judith C. Lapadat,et al.  Written Interaction: A Key Component in Online Learning , 2006, J. Comput. Mediat. Commun..

[26]  D. Garrison,et al.  Facilitating Cognitive Presence in Online Learning: Interaction Is Not Enough , 2005 .

[27]  Rose M. Marra,et al.  Content analysis of online discussion forums: A comparative analysis of protocols , 2004 .

[28]  Laurie P. Dringus,et al.  Using data mining as a strategy for assessing asynchronous discussion forums , 2005, Comput. Educ..

[29]  Lynn M. Hunt,et al.  Measuring Critical Thinking within Discussion Forums using a Computerised Content Analysis Tool , 2006 .

[30]  Michael F. Beaudoin Learning or lurking?: Tracking the "invisible" online student , 2002, Internet High. Educ..

[31]  Robert Heckman,et al.  A content analytic comparison of FTF and ALN case-study discussions , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[32]  Gyeoung Hee Lee he underlying study on the application of instructional systems development mode l for industrial education program , 1996 .

[33]  D. Garrison,et al.  Methodological Issues in the Content Analysis of Computer Conference Transcripts , 2007 .

[34]  Stephen Corich,et al.  Computerised Content Analysis for Measuring Critical Thinking within Discussion Forums , 2006 .

[35]  Harvey Mellar,et al.  A methodology for the analysis of patterns of participation within computer mediated communication courses , 1996 .

[36]  Paula San Millan Maurino Looking for Critical Thinking in Online Threaded Discussions , 2006 .

[37]  E. Lai,et al.  Critical Thinking: A Literature Review , 2011 .

[38]  Margaret Mazzolini,et al.  When to jump in: The role of the instructor in online discussion forums , 2007, Comput. Educ..

[39]  Robert H. Ennis Critical thinking assessment , 1993 .