Instructor versus Peer Attention Guidance in Online Learning Conversations

This paper reports a theory-driven experimental study for designing and evaluating two different forms of attention-guidance functionalities integrated into an anchored-discussion system. Using social constructivism as a motivating theory, we constructed a theoretical framework that emphasizes the importance of students’ attention allocation in online learning conversations and its influence on message quality and interaction patterns. The development of the functionalities, named faded instructor-led and peer-oriented attention guidance, aimed to direct students’ attention toward instructional materials’ central domain principles while offering them an open learning environment in which they could choose their own topics and express their own ideas. We evaluated the functionalities with heat map analysis, repeated measures general linear model analysis, and sequence analysis to assess the utility of the developed functionalities. Results show that attention guidance helped students more properly allocate their attention in online learning conversations. Furthermore, we found that the improved attention allocation led to better quality of students’ online learning conversations. We discuss implications for researchers and practitioners who wish to promote more fruitful online discussions.

[1]  F. Fischer,et al.  A framework to analyze argumentative knowledge construction in computer-supported collaborative learning , 2006, Comput. Educ..

[2]  Gellof Kanselaar,et al.  Effects of representational guidance on domain specific reasoning in CSCL , 2005, Comput. Hum. Behav..

[3]  Jim Hewitt Toward an Understanding of How Threads Die in Asynchronous Computer Conferences , 2005 .

[4]  Daniel D. Suthers,et al.  Technology affordances for intersubjective meaning making: A research agenda for CSCL , 2006, Int. J. Comput. Support. Collab. Learn..

[5]  Terry Ryan,et al.  Enhancing student knowledge acquisition from online learning conversations , 2013, International Journal of Computer-Supported Collaborative Learning.

[6]  Stuart A. Karabenick,et al.  Classroom and technology-supported help seeking: The need for converging research paradigms , 2011 .

[7]  R. Sawyer The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[8]  S. Puntambekar,et al.  Tools for Scaffolding Students in a Complex Learning Environment: What Have We Gained and What Have We Missed? , 2005 .

[9]  Cindy E. Hmelo-Silver,et al.  Productive use of learning resources in an online problem-based learning environment , 2010, Comput. Hum. Behav..

[10]  Robert F. Lorch,et al.  Effects of organizational signals on text-processing strategies. , 1995 .

[11]  F. Paas,et al.  Attention Cueing as a Means to Enhance Learning from an Animation , 2007 .

[12]  Albrecht Schmidt,et al.  Knowing the User's Every Move – User Activity Tracking for Website Usability Evaluation and Implicit Interaction , 2006 .

[13]  Joseph Krajcik,et al.  Supporting Students' Construction of Scientific Explanations by Fading Scaffolds in Instructional Materials , 2006 .

[14]  M. Volman,et al.  Scaffolding in Teacher–Student Interaction: A Decade of Research , 2010 .

[15]  Tammy Schellens,et al.  Collaborative learning in asynchronous discussion groups: What about the impact on cognitive processing? , 2005, Comput. Hum. Behav..

[16]  Chin-Chung Tsai,et al.  The effect of moderator's facilitative strategies on online synchronous discussions , 2012, Comput. Hum. Behav..

[17]  Kevin Oliver,et al.  Developing and refining mental models in open-ended learning environments: A case study , 2001 .

[18]  Judith B. Pena-Shaff,et al.  Analyzing student interactions and meaning construction in computer bulletin board discussions , 2004, Comput. Educ..

[19]  Jan-Willem Strijbos,et al.  What we know about CSCL: ...and what we do not (but need to) know about CSCL , 2004 .

[20]  Philip Race The lecturer's toolkit : a practical guide to learning, teaching & assessment , 2001 .

[21]  Carol K. K. Chan,et al.  Fostering collective and individual learning through knowledge building , 2014, International Journal of Computer-Supported Collaborative Learning.

[22]  Ming Ming Chiu,et al.  Design and evaluation of instructor-based and peer-oriented attention guidance functionalities in an open source anchored discussion system , 2014, Comput. Educ..

[23]  F. Paas,et al.  Towards a Framework for Attention Cueing in Instructional Animations: Guidelines for Research and Design , 2009 .

[24]  Michael J. Hannafin,et al.  Scaffolding problem solving in technology-enhanced learning environments (TELEs): Bridging research and theory with practice , 2011, Comput. Educ..

[25]  K. Scheiter,et al.  Learner Control in Hypermedia Environments , 2007 .

[26]  P. Kirschner,et al.  Toward a Framework for CSCL Research , 2013 .

[27]  M. Baker ARGUMENTATION AND CONSTRUCTIVE INTERACTION , 2009 .

[28]  P. Dillenbourg What do you mean by collaborative learning , 1999 .

[29]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[30]  Ulrike Cress,et al.  A systemic and cognitive view on collaborative knowledge building with wikis , 2008, Int. J. Comput. Support. Collab. Learn..

[31]  Gerry Stahl,et al.  Learning across levels , 2013, International Journal of Computer-Supported Collaborative Learning.

[32]  L. Lipponen,et al.  Practices and orientations of CSCL , 2004 .

[33]  M. Scardamalia Collective cognitive responsibility for the advancement of knowledge , 2002 .

[34]  Daniel D. Suthers,et al.  Collaborative representations: supporting face to face and online knowledge-building discourse , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[35]  Charles M. Reigeluth,et al.  Instructional-design Theories and Models : A New Paradigm of Instructional Theory, Volume II , 1999 .

[36]  Jane E Caldwell,et al.  Clickers in the large classroom: current research and best-practice tips. , 2007, CBE life sciences education.

[37]  Alyssa Friend Wise,et al.  Learning Analytics for Online Discussions: Embedded and Extracted Approaches , 2014, J. Learn. Anal..

[38]  P. Kirschner,et al.  CSCL in higher education?: a framework for designing multiple collaborative environments , 2004 .

[39]  Bertrand Schneider,et al.  Real-time mutual gaze perception enhances collaborative learning and collaboration quality , 2013, International Journal of Computer-Supported Collaborative Learning.

[40]  Justin C. Mary Toward an Understanding of the Behaviors that Affect Learning in Anchored Discussion Systems: The Role of Instructional Guidance Cues and Discourse Quality , 2014 .

[41]  Terry Ryan,et al.  International Conference on Information Systems ( ICIS ) 2010 UNDERSTANDING THE PARADOX OF MENTAL EFFORT IN ONLINE LEARNING CONVERSATIONS , 2017 .

[42]  Terry Ryan,et al.  Fostering Quality and Flow of Online Learning Conversations by Artifact-Centered Discourse Systems , 2013, J. Assoc. Inf. Syst..

[43]  Allan Jeong,et al.  How day of posting affects level of critical discourse in asynchronous discussions and computer-supported collaborative argumentation , 2008, Br. J. Educ. Technol..

[44]  P. Robert-Jan Simons,et al.  The affordance of anchored discussion for the collaborative processing of academic texts , 2006, Int. J. Comput. Support. Collab. Learn..

[45]  Alyssa Friend Wise,et al.  Analyzing temporal patterns of knowledge construction in a role-based online discussion , 2011, Int. J. Comput. Support. Collab. Learn..

[46]  Karin Baier,et al.  The Uses Of Argument , 2016 .

[47]  I. Molenaar,et al.  Attention management for self-regulated learning: AtGentSchool , 2011 .

[48]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[49]  Victor Kaptelinin,et al.  Group Cognition Computer Support for Building Collaborative Knowledge , 2007 .

[50]  Yuen-Yan Chan,et al.  Students' views of collaboration and online participation in Knowledge Forum , 2011, Comput. Educ..

[51]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[52]  Ann Majchrzak,et al.  Perceived Individual Collaboration Know-How Development Through Information Technology-Enabled Contextualization: Evidence from Distributed Teams , 2005, Inf. Syst. Res..

[53]  Nimer Alrushiedat,et al.  The Effect of Anchoring Online Discussion on Collaboration and Cognitive Load , 2009, AMCIS.

[54]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[55]  C. Hmelo‐Silver,et al.  Scaffolding and Achievement in Problem-Based and Inquiry Learning: A Response to Kirschner, Sweller, and Clark (2006) , 2007 .

[56]  Daniel Bodemer,et al.  Knowledge awareness in CSCL: A psychological perspective , 2009, Comput. Hum. Behav..

[57]  A. King Transactive Peer Tutoring: Distributing Cognition and Metacognition , 1998 .

[58]  Joanna Wolfe,et al.  Annotations and the collaborative digital library: Effects of an aligned annotation interface on student argumentation and reading strategies , 2008, Int. J. Comput. Support. Collab. Learn..

[59]  Jakko van der Pol Online Learning Conversations: Potential, Challenges and Facilitation , 2009 .

[60]  Richard C. Anderson,et al.  Frameworks for Comprehending Discourse , 1977 .

[61]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[62]  Annelies Raes,et al.  Scaffolding information problem solving in web-based collaborative inquiry learning , 2012, Comput. Educ..

[63]  Richard K. Lowe,et al.  An Eye Tracking Comparison of External Pointing Cues and Internal Continuous Cues in Learning with Complex Animations , 2010 .

[64]  Venugopal Balijepally,et al.  Are Two Heads Better than One for Software Development? The Productivity Paradox of Pair Programming , 2009, MIS Q..

[65]  Roy D. Pea,et al.  How to improve collaborative learning with video tools in the classroom? Social vs. cognitive guidance for student teams , 2012, Int. J. Comput. Support. Collab. Learn..

[66]  M. Scardamalia,et al.  Knowledge Building: Theory, Pedagogy, and Technology , 2006 .

[67]  Chia-Ching Lin,et al.  Participatory learning through behavioral and cognitive engagements in an online collective information searching activity , 2012, Int. J. Comput. Support. Collab. Learn..

[68]  Pavlo D. Antonenko,et al.  Use of signaling to integrate desktop virtual reality and online learning management systems , 2012, Comput. Educ..

[69]  Lorne Olfman,et al.  The Role of Anchoring Discussion in Mediating Effective Online Interaction for Collaborative Knowledge Construction , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[70]  Mary Hegarty,et al.  Top-down and bottom-up influences on learning from animations , 2007, Int. J. Hum. Comput. Stud..

[71]  Evren Eryilmaz,et al.  How media choice affects learner interactions in distance learning classes , 2014, Comput. Educ..

[72]  Terry Ryan,et al.  Re-design and Evaluation of an Anchored Discussion System , 2012, 2012 45th Hawaii International Conference on System Sciences.

[73]  Jean-François Rouet,et al.  Information problem solving instruction: Some cognitive and metacognitive issues , 2008, Comput. Hum. Behav..

[74]  Christof Wecker,et al.  Fading scripts in computer-supported collaborative learning: the role of distributed monitoring , 2007, CSCL.

[75]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[76]  Gerry Stahl,et al.  A Model of Collaborative Knowledge Building , 2006 .

[77]  Charles M. Reigeluth,et al.  Designing Instruction for Constructivist Learning , 2013 .