Discourse Centric Learning Analytics: Mapping the Terrain

There is an increasing interest in developing learning analytic techniques for the analysis, and support of, high-quality learning discourse. This paper maps the terrain of discourse-centric learning analytics (DCLA), outlining the distinctive contribution of DCLA and outlining a definition for the field moving forwards. It is our claim that DCLA provides the opportunity to explore the ways in which discourse of various forms both resources and evidences learning; the ways in which small and large groups, and individuals, make and share meaning together through their language use; and the particular types of language — from discipline specific, to argumentative and socio-emotional — associated with positive learning outcomes. DCLA is thus not merely a computational aid to help detect or evidence “good” and “bad” performance (the focus of many kinds of analytics), but a tool to help investigate questions of interest to researchers, practitioners, and ultimately learners. The paper ends with three core issues for DCLA researchers — the challenge of context in relation to DCLA; the various systems required for DCLA to be effective; and the means through which DCLA might be delivered for maximum impact at the micro (e.g., learner), meso (e.g., school), and macro (e.g., government) levels.

[1]  Carolyn Penstein Rosé,et al.  Finding transactive contributions in whole group classroom discussions , 2010, ICLS.

[2]  Christa S. C. Asterhan,et al.  Socializing Intelligence Through Academic Talk and Dialogue , 2015 .

[3]  F. Fischer,et al.  A framework to analyze argumentative knowledge construction in computer-supported collaborative learning , 2006, Comput. Educ..

[4]  Tara Black,et al.  The language of evaluation , 2017 .

[5]  Adam Cooper A Framework of Characteristics for Analytics , 2013 .

[6]  Issa M. Saleh,et al.  NEW SCIENCE OF LEARNING: COGNITION, COMPUTERS AND COLLABORATION IN EDUCATION , 2010 .

[7]  Carolyn Penstein Rose,et al.  What Sociolinguistics and Machine Learning Have to Say to Each Other About Interaction Analysis , 2015 .

[8]  Jeroen Janssen,et al.  Automatic coding of dialogue acts in collaboration protocols , 2008, Int. J. Comput. Support. Collab. Learn..

[9]  Pavel Král,et al.  Dialogue Act Recognition Approaches , 2010, Comput. Informatics.

[10]  J. Kaufman,et al.  The Routledge international handbook of research on teaching thinking , 2015 .

[11]  E. Salas,et al.  Theories of Team Cognition: Cross-Disciplinary Perspectives , 2013 .

[12]  Douglas B. Clark,et al.  Analytic Frameworks for Assessing Dialogic Argumentation in Online Learning Environments , 2007 .

[13]  Rebecca Ferguson,et al.  Social Learning Analytics , 2012, J. Educ. Technol. Soc..

[14]  Rebecca Ferguson,et al.  DCLA13: 1st International Workshop on Discourse-Centric Learning Analytics , 2013, LAK '13.

[15]  G. Wells Dialogic Inquiry: Towards a Socio-cultural Practice and Theory of Education , 1999 .

[16]  Joseph P Magliano,et al.  Assessing the use of multiple sources in student essays , 2012, Behavior research methods.

[17]  Maria Bannert,et al.  e-Research and learning theory: What do sequence and process mining methods contribute? , 2014, Br. J. Educ. Technol..

[18]  Dirk Ifenthaler,et al.  Development and Validation of a Learning Analytics Framework: Two Case Studies Using Support Vector Machines , 2014, Technology, Knowledge and Learning.

[19]  Pierre Dillenbourg,et al.  Over-scripting CSCL: The risks of blending collaborative learning with instructional design , 2002 .

[20]  M. Baker,et al.  Computer-Mediated Epistemic Dialogue: Explanation and Argumentation as Vehicles for Understanding Scientific Notions , 2002 .

[21]  Karen Littleton,et al.  Interthinking: Putting talk to work , 2013 .

[22]  Simon Buckingham Shum,et al.  Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine Annotation Study , 2012, Computer Supported Cooperative Work (CSCW).

[23]  Simon Buckingham Shum,et al.  Discourse-centric learning analytics , 2011, LAK.

[24]  S. Ball Labour, learning and the economy: A policy sociology perspective , 1999 .

[25]  Elizabeth Bagley,et al.  Epistemic network analysis : a Prototype for 21 st Century assessment of Learning , 2009 .

[26]  R. Alexander Towards Dialogic Teaching: Rethinking Classroom Talk , 2008 .

[27]  J. Johnson,et al.  Ethics of Data Mining and Predictive Analytics in Higher Education , 2013 .

[28]  Carolyn Penstein Rosé,et al.  Topic-Segmentation of Dialogue , 2006, HLT-NAACL 2006.

[29]  David Gibson,et al.  Psychometric Considerations for Digital Assessments , 2013 .

[30]  Christopher M. Hoadley,et al.  From dialogue to monologue and back: Middle spaces in computer-mediated learning , 2006, Int. J. Comput. Support. Collab. Learn..

[31]  L. Resnick,et al.  A framework for analyzing development of argumentation through classroom discussions , 2012 .

[32]  Neil Mercer,et al.  The Seeds of Time: Why Classroom Dialogue Needs a Temporal Analysis , 2008 .

[33]  Joonhwan Lee,et al.  A Framework for Assessment of Student Project Groups On-Line and Off-Line , 2011 .

[34]  Daniel D. Suthers,et al.  Social and semantic network analysis of chat logs , 2011, LAK.

[35]  Gerry Stahl,et al.  Group Cognition as a Foundation for the New Science of Learning , 2010 .

[36]  F. Fischer,et al.  Epistemic and social scripts in computer–supported collaborative learning , 2005 .

[37]  Daniel D. Suthers,et al.  Supporting Online Learning with an Artifact-Centered Cross-Threaded Discussion Tool. , 2003 .

[38]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[39]  M. Bakhtin,et al.  Speech genres and other late essays , 1986 .

[40]  Gordon Wells,et al.  Learning for Life in the 21st Century: sociocultural perspectives on the future of education , 2002 .

[41]  S. Hennessy,et al.  Research into teaching with whole‐class interactive technologies , 2010 .

[42]  Tim Jordan,et al.  The Ecology of Games: Connecting Youth, Games and Learning , 2009 .

[43]  Carolyn Penstein Rosé,et al.  Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning , 2008, Int. J. Comput. Support. Collab. Learn..

[44]  Caroline Haythornthwaite,et al.  Social networks and learning networks: Using social network perspectives to understand social learning , 2010 .

[45]  Daniel D. Suthers,et al.  Information Sharing and Interaction in Collaborative Convergence , 2007, ICCE.

[46]  Niels Pinkwart,et al.  Computer-Supported Collaborative Learning DOI 10.1007/s11412-009-9080-x Computer-supported argumentation: A review of the state of the art , 2009 .

[47]  Tanya Elias,et al.  Learning Analytics: Definitions, Processes and Potential , 2011 .

[48]  Daniel D. Suthers,et al.  Exposing Chat Features through Analysis of Uptake between Contributions , 2012, 2012 45th Hawaii International Conference on System Sciences.

[49]  Katrien Verbert,et al.  Learning analytics as a "middle space" , 2013, LAK '13.

[50]  Gerry Stahl,et al.  Transactive discourse in CSCL , 2013, Int. J. Comput. Support. Collab. Learn..

[51]  Carolyn Penstein Rosé,et al.  Using transactivity in conversation for summarization of educational dialogue , 2007, SLaTE.

[52]  Rebecca Ferguson,et al.  Improvable objects and attached dialogue , 2010 .

[53]  Robert J. Mislevy,et al.  Design and Discovery in Educational Assessment: Evidence-Centered Design, Psychometrics, and Educational Data Mining , 2012, EDM 2012.

[54]  R. Wegerif Towards a Dialogic Theory of How Children Learn to Think. , 2011 .

[55]  N. Law,et al.  Productive Multivocality in the Analysis of Group Interactions , 2013 .

[56]  Daniel D. Suthers,et al.  Using a Contingency Graph to Discover Representational Practices in an Online Collaborative Environment , 2009, Res. Pract. Technol. Enhanc. Learn..

[57]  J. Gee,et al.  How Computer Games Help Children Learn , 2006 .

[58]  Peter Reimann,et al.  Time is precious: Variable- and event-centred approaches to process analysis in CSCL research , 2009, Int. J. Comput. Support. Collab. Learn..

[59]  Karen Littleton,et al.  Collaborative sensemaking in learning analytics , 2013 .

[60]  Karen Littleton,et al.  Educational dialogues : understanding and promoting productive interaction , 2010 .

[61]  Yoshiaki Matsuzawa,et al.  Knowledge Building Discourse Explorer: a social network analysis application for knowledge building discourse , 2012 .

[62]  Anniken Furberg,et al.  Students' Meaning‐making of Socio‐scientific Issues in Computer Mediated Settings: Exploring learning through interaction trajectories , 2008 .

[63]  Marie-Francine Moens,et al.  Argumentation mining: the detection, classification and structure of arguments in text , 2009, ICAIL.

[64]  H. Tanner,et al.  How can we be sure that the classroom encourages talk for learning? Here is what research shows. Alexander R (2008) Towards Dialogic Teaching: rethinking classroom talk (Dialogos , 2008 .

[65]  Karina L. Cela,et al.  Social network analysis for technology-enhanced learning: review and future directions , 2012 .

[66]  Simon Knight Creating a supportive environment for classroom dialogue , 2014 .

[67]  K. Littleton,et al.  Thinking, Interthinking, and Technological Tools , 2015 .

[68]  Neil Mercer,et al.  Common Knowledge: The Development of Understanding in the Classroom , 1987 .

[69]  M. Chi Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[70]  Karen Littleton,et al.  Epistemology, Assessment, Pedagogy: Where Learning Meets Analytics in the Middle Space , 2014, J. Learn. Anal..

[71]  P. Reimann,et al.  Process mining techniques for analysing patterns and strategies in students’ self-regulated learning , 2013, Metacognition and Learning.

[72]  Kalina Bontcheva,et al.  GATECloud.net: a platform for large-scale, open-source text processing on the cloud , 2013, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[73]  M. Azmitia,et al.  Friendship, transactive dialogues, and the development of scientific reasoning , 1993 .

[74]  Andreas Stolcke,et al.  Dialogue act modeling for automatic tagging and recognition of conversational speech , 2000, CL.

[75]  Martyn Hammersley,et al.  Reproducing or constructing? Some questions about transcription in social research , 2010 .

[76]  Karen Littleton,et al.  The negotiation and co‐construction of meaning and understanding within a postgraduate online learning community , 2005 .

[77]  Rebecca Ferguson,et al.  XIP Dashboard: visual analytics from automated rhetorical parsing of scientific metadiscourse , 2013 .

[78]  Karen Littleton,et al.  Discourse, computation and context – sociocultural DCLA revisited , 2013 .

[79]  N. Mercer,et al.  Dialogue and the Development of Children's Thinking: A Sociocultural Approach , 2007 .

[80]  Daniel D. Suthers,et al.  The Temporal Development of Representational Practices: Implications for Theory and Analysis of Situated Learning , 2010, 2010 43rd Hawaii International Conference on System Sciences.