Examining Instructor Use of Learning Analytics

This study takes an instructor-centric approach to Learning Analytic (LA) research by analyzing instructor use of the LA within an educational streaming video platform called TrACE. The goal of this study is to understand how instructors naturally interact with analytic dashboards through an empirical analysis. To accomplish this, data of 14 instructors from three institutions that used TrACE from Spring 2015 to Spring 2016 was collected. Data was analyzed to identify frequency of analytic visits, duration of analytic use, differences in analytic use, and differences in use between semesters. Instructors demonstrated preferences for some analytics over others, but the majority of teachers generate short sessions that may not allow for in-depth exploration in analytics. Finally, instructor activity is not always consistent between semesters. Focus groups were conducted to explore motivations behind these findings and future work includes developing LA that address discovered issues.

[1]  Maren Scheffel,et al.  Quality Indicators for Learning Analytics , 2014, J. Educ. Technol. Soc..

[2]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[3]  Ulrik Schroeder,et al.  Supporting action research with learning analytics , 2013, LAK '13.

[4]  Mark C. Lewis,et al.  The Effectiveness of Video Quizzes in a Flipped Class , 2015, SIGCSE.

[5]  Brian Dorn,et al.  Piloting TrACE: Exploring Spatiotemporal Anchored Collaboration in Asynchronous Learning , 2015, CSCW.

[6]  Carlos Delgado Kloos,et al.  Usage Pattern Recognition in Student Activities , 2011, EC-TEL.

[7]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[8]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[9]  David Slavit,et al.  A Culture of Collaborative Inquiry: Learning to Develop and Support Professional Learning Communities , 2008, Teachers College Record: The Voice of Scholarship in Education.

[10]  Mary Lou Maher,et al.  Flipped Classroom Strategies for CS Education , 2015, SIGCSE.

[11]  D. Schoen.  Educating the reflective practitioner , 1987 .

[12]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[13]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[14]  Marek Hatala,et al.  A qualitative evaluation of evolution of a learning analytics tool , 2012, Comput. Educ..

[15]  Sebastián Ventura,et al.  Mining Rare Association Rules from e-Learning Data , 2010, EDM.

[16]  S. Dawson.  SNAPP : Realising the affordances of real-time SNA within networked learning environments , 2010 .

[17]  Ulrik Schroeder,et al.  A rule-based indicator definition tool for personalized learning analytics , 2016, LAK.

[18]  J. M. Simmons,et al.  Reflective Pedagogical Thinking: How Can We Promote It and Measure It? , 1990 .