Exploring Social Learning Analytics to Support Teaching and Learning Decisions in Online Learning Environments

Most teachers to date have adopted summative assessment items as a benchmark to measure students’ learning and for making pedagogical decisions. However, these may not necessarily provide comprehensive evidence for the actual learning process, particularly in online learning environments due to their failure to monitor students’ online learning patterns over time. In this paper, we explore how social learning analytics (SLA) can be used as a proxy by teachers to understand students’ learning processes and to support them in making informed pedagogical decisions during the run of a course. This study was conducted in a semester-long undergraduate course, at a large public university in Norway, and made use of data from 4 weekly online discussions delivered through the university learning management system Canvas. First, we used NodeXL a social network analysis tool to analyze and visualize students’ online learning processes, and then we used Coh-Metrix, a theoretically grounded, computational linguistic tool to analyze the discourse features of students’ discussion posts. Our findings revealed that SLA provides insight and an overview of the students’ cognitive and social learning processes in online learning environments. This exploratory study contributes to an improved conceptual understanding of SLA and details some of the methodological implications of an SLA approach to enhance teaching and learning in online learning environments.

[1]  Shane Dawson,et al.  SNAPP: a bird's-eye view of temporal participant interaction , 2011, LAK.

[2]  Daniel C. Dreesmann,et al.  The exclusive language of science? Comparing knowledge gains and motivation in English-bilingual biology lessons between non-selected and preselected classes , 2018, International Journal of Science Education.

[3]  Anders I. Mørch,et al.  Mutual development in mass collaboration: Identifying interaction patterns in customer-initiated software product development , 2016, Comput. Hum. Behav..

[4]  Nada Dabbagh,et al.  How to structure online discussions for meaningful discourse: a case study , 2005, Br. J. Educ. Technol..

[5]  Arthur C. Graesser,et al.  Automated Evaluation of Text and Discourse with Coh-Metrix: Coh-Metrix Measures , 2014 .

[6]  Dragan Gasevic,et al.  SENS: Network analytics to combine social and cognitive perspectives of collaborative learning , 2019, Comput. Hum. Behav..

[7]  A. Graesser,et al.  Language and Discourse Analysis with Coh-Metrix: Applications from Educational Material to Learning Environments at Scale , 2016, J. Learn. Anal..

[8]  Julián Chaparro-Peláez,et al.  Applying social learning analytics to message boards in online distance learning: A case study , 2015, Comput. Hum. Behav..

[9]  de Nooy Wouter,et al.  Exploratory Social Network Analysis with Pajek. Revised and Expanded Edition for Updated Software. Third edition. , 2018 .

[10]  Donatella Persico,et al.  Informing learning design with learning analytics to improve teacher inquiry , 2015, Br. J. Educ. Technol..

[11]  A. Kluge Learning science with an interactive simulator: negotiating the practice-theory barrier , 2019, International Journal of Science Education.

[12]  Bart Rienties,et al.  Implementing a Learning Analytics Intervention and Evaluation Framework: what works? , 2017 .

[13]  Arthur C. Graesser,et al.  Exploring development of social capital in a CMOOC through language and discourse , 2018, Internet High. Educ..

[14]  Vladimir Batagelj,et al.  Exploratory Social Network Analysis with Pajek: Revised and Expanded Edition for Updated Software , 2018 .

[15]  V. Batagelj,et al.  Exploratory Social Network Analysis with Pajek , 2018 .

[16]  Johanna D. Moore,et al.  Analysing discussion forum data: a replication study avoiding data contamination , 2019, LAK.

[17]  V. John-Steiner,et al.  Sociocultural approaches to learning and development: A Vygotskian framework , 1996 .

[18]  Heinz Ulrich Hoppe,et al.  Analysing content and patterns of interaction for improving the learning design of networked learning environments , 2015, Br. J. Educ. Technol..

[19]  Dragan Gasevic,et al.  Proceedings of the 8th International Conference on Learning Analytics and Knowledge , 2011, LAK.

[20]  Carlos Delgado Kloos,et al.  Key Action Extraction for Learning Analytics , 2012, EC-TEL.

[21]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[22]  Hendrik Drachsler,et al.  Opportunities and Challenges in Using Learning Analytics in Learning Design , 2017, EC-TEL.

[23]  Rebecca Ferguson,et al.  Social learning analytics: five approaches , 2012, LAK.

[24]  Arthur C. Graesser,et al.  Modeling Learners' Social Centrality and Performance through Language and Discourse , 2015, EDM.

[25]  Caroline Haythornthwaite,et al.  Social Network Informed Design for Learning with Educational Technology , 2012 .

[26]  Carmel Kent,et al.  Deconstructing online social learning: network analysis of the creation, consumption and organization types of interactions , 2018, International Journal of Research & Method in Education.

[27]  Ben Shneiderman,et al.  Analyzing Social Media Networks with NodeXL: Insights from a Connected World , 2010 .

[28]  Osmar R. Zaïane,et al.  Collaborative Learning of Students in Online Discussion Forums: A Social Network Analysis Perspective , 2014 .