Teaching and Learning Analytics to Support Teacher Inquiry: A Systematic Literature Review

Teacher inquiry is identified as a key global need for driving the continuous improvement of the teaching and learning conditions for learners. However, specific barriers (mainly related to teachers’ data literacy competences), can defer teachers from engaging with inquiry to improve their teaching practice. To alleviate these barriers and support teacher inquiry, the concept of Teaching and Learning Analytics (TLA) has been proposed, as a complementing synergy between Teaching Analytics and Learning Analytics. Teaching and Learning Analytics aims to provide a framework in which the insights generated by Learning Analytics methods and tools can become meaningfully translated for driving teachers’ inquiry to improve their teaching practice, captured through Teaching Analytics methods and tools. In this context, TLA have been identified as a research challenge with significant practical impact potential. This chapter contributes the first systematic literature review in the emerging research field of Teaching and Learning Analytics. The insights gained from the systematic literature review aim to (a) transparently outline the existing state-of-the-art following a structured analysis methodology, as well as (b) elicit insights and shortcomings which could inform future work in the Teaching and Learning Analytics research field.

[1]  Dennis Zielke,et al.  Design and Implementation of a Learning Analytics Toolkit for Teachers , 2012, J. Educ. Technol. Soc..

[2]  Jui-Long Hung,et al.  Integrating Data Mining in Program Evaluation of K-12 Online Education , 2012, J. Educ. Technol. Soc..

[3]  Sergey Butakov,et al.  Applying artificial intelligence to the educational data: an example of syllabus quality analysis , 2012, LAK.

[4]  Shane Dawson,et al.  Teaching smarter: how mining ICT data can inform and improve learning and teaching practice , 2008 .

[5]  Abelardo Pardo,et al.  Combining observational and experiential data to inform the redesign of learning activities , 2015, LAK.

[6]  Saskia Brand-Gruwel,et al.  Student differences in regulation strategies and their use of learning resources: implications for educational design , 2016, LAK.

[7]  Miguel Ángel Conde González,et al.  Visualisation of student learning model in serious games , 2015, Comput. Hum. Behav..

[8]  Baruch B. Schwarz,et al.  E-Moderation of Synchronous Discussions in Educational Settings: A Nascent Practice , 2011 .

[9]  Manuel Mucientes,et al.  Learning Analytics Framework for Educational Virtual Worlds , 2013, VARE.

[10]  Pierre Dillenbourg,et al.  Teaching analytics: towards automatic extraction of orchestration graphs using wearable sensors , 2016, LAK.

[11]  Russell K. Schutt,et al.  Research Methods in Education , 2011 .

[12]  Ellen B. Mandinach,et al.  A Perfect Time for Data Use: Using Data-Driven Decision Making to Inform Practice , 2012 .

[13]  Xavier Prat-Resina,et al.  Connecting Analytics and Curriculum Design: Process and Outcomes of Building a Tool to Browse Data Relevant to Course Designers , 2014, J. Learn. Anal..

[14]  Davide Taibi,et al.  A framework to support educational decision making in mobile learning , 2015, Comput. Hum. Behav..

[15]  Anouschka van Leeuwen,et al.  Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL , 2014, Comput. Educ..

[16]  Shane Dawson,et al.  'Seeing' the learning community: An exploration of the development of a resource for monitoring online student networking , 2010, Br. J. Educ. Technol..

[17]  Julie A. Marsh,et al.  How leaders can support teachers with data-driven decision making , 2015 .

[18]  David Wiley,et al.  Data-Driven Decision Making in the K-12 Classroom , 2014 .

[19]  Xavier Ochoa,et al.  Curricular Design Analysis: A Data-Driven Perspective , 2014, J. Learn. Anal..

[20]  Ulrik Schroeder,et al.  Supporting action research with learning analytics , 2013, LAK '13.

[21]  John Fritz.  LMS Course Design As Learning Analytics Variable , 2016, PCLA@LAK.

[22]  Rosemary Luckin,et al.  A method for teacher inquiry in cross-curricular projects: Lessons from a case study , 2015, Br. J. Educ. Technol..

[23]  Yishay Mor,et al.  Supporting teachers in data-informed educational design , 2015, Br. J. Educ. Technol..

[24]  Yea-Ru Chuang,et al.  An Analytics-Based Approach to Managing Cognitive Load by Using Log Data of Learning Management Systems and Footprints of Social Media , 2015, J. Educ. Technol. Soc..

[25]  Manuel Mucientes,et al.  Learning analytics for the prediction of the educational objectives achievement , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[26]  Bart Rienties,et al.  Analysing 157 learning designs using learning analytic approaches as a means to evaluate the impact of pedagogical decision making , 2016, Br. J. Educ. Technol..

[27]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[28]  Matthew Montebello,et al.  A case study inside virtual worlds: use of analytics for immersive spaces , 2013, LAK '13.

[29]  Francisco J. García-Peñalvo,et al.  Tap into visual analysis of the customization of grouping of activities in eLearning , 2013, TEEM '13.

[30]  Erik Duval,et al.  Interactive surfaces and learning analytics: data, orchestration aspects, pedagogical uses and challenges , 2016, LAK.

[31]  Heinz Ulrich Hoppe,et al.  Analysing content and patterns of interaction for improving the learning design of networked learning environments , 2015, Br. J. Educ. Technol..

[32]  Agathe Merceron.  Investigating the core group effect in usage of resources with analytics , 2012, LAK '12.

[33]  Barbara Wasson,et al.  Editorial: Learning design, teacher inquiry into student learning and learning analytics: A call for action , 2015, Br. J. Educ. Technol..

[34]  Bart Rienties,et al.  "Scaling up" learning design: impact of learning design activities on LMS behavior and performance , 2015, LAK.

[35]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[36]  Nancy Parker,et al.  Extending the AAT Tool with a User-Friendly and Powerful Mechanism to Retrieve Complex Information from Educational Log Data , 2013, CHI-KDD.

[37]  Barbara Wasson,et al.  Grand Challenge Problem 11: Empowering Teachers with Student Data , 2016 .

[38]  A. L. Dyckhoff.  Implications for Learning Analytics Tools : A Meta-Analysis of Applied Research Questions , 2011 .

[39]  Xavier Ochoa,et al.  Simple metrics for curricular analytics , 2016 .

[40]  Kevin C. Almeroth,et al.  Moodog: Tracking students' Online Learning Activities , 2007 .

[41]  Alejandra Martínez-Monés,et al.  DESPRO: A method based on roles to provide collaboration analysis support adapted to the participants in CSCL situations , 2015, Comput. Educ..

[42]  Alicia Nieto-Reyes,et al.  Analyzing collaboration and interaction in learning environments to form learner groups , 2015, Comput. Hum. Behav..

[43]  Carlos Monroy,et al.  A learning analytics approach to characterize and analyze inquiry-based pedagogical processes , 2015, LAK.

[44]  Katrina Sin,et al.  Application of Big Data in Education Data Mining and Learning Analytics-A Literature Review , 2015, SOCO 2015.

[45]  Vania Dimitrova,et al.  CourseVis: A graphical student monitoring tool for supporting instructors in web-based distance courses , 2007, Int. J. Hum. Comput. Stud..

[46]  Scott Studham,et al.  Personalized Multi-Regression Models for Predicting Students ’ Performance in Course Activities , 2014 .

[47]  Pearl Brereton,et al.  Protocol for a Tertiary study of Systematic Literature Reviews and Evidence-based Guidelines in IT and Software Engineering , 2009 .

[48]  Wai Yee Wong,et al.  Using a Risk Management Approach in Analytics for Curriculum and Program Quality Improvement , 2016, PCLA@LAK.

[49]  Martin Ebner,et al.  Learning Analytics: From Theory to Practice - Data Support for Learning and Teaching , 2014, CAA.

[50]  Julián Chaparro-Peláez,et al.  Applying social learning analytics to message boards in online distance learning: A case study , 2015, Comput. Hum. Behav..

[51]  Riccardo Mazza,et al.  Exploring Usage Analysis in Learning Systems: Gaining Insights From Visualisations , 2005 .

[52]  Kristine Lund,et al.  Grand Challenge Problems in Technology-Enhanced Learning II: MOOCs and Beyond , 2016 .

[53]  Peter N. Posch,et al.  Teachers Investigate Their Work: An introduction to action research across the professions , 1993 .

[54]  Linda Corrin,et al.  A conceptual framework linking learning design with learning analytics , 2016, LAK.

[55]  James D. Slotta,et al.  Orchestrating of complex inquiry: three roles for learning analytics in a smart classroom infrastructure , 2013, LAK '13.

[56]  Marek Hatala,et al.  A qualitative evaluation of evolution of a learning analytics tool , 2012, Comput. Educ..

[57]  María Jesús Rodríguez-Triana,et al.  Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations , 2015, Br. J. Educ. Technol..

[58]  Alejandra Martínez-Monés,et al.  Recurrent routines: Analyzing and supporting orchestration in technology-enhanced primary classrooms , 2011, Comput. Educ..

[59]  Anouschka van Leeuwen,et al.  Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics , 2015, Comput. Educ..

[60]  Nancy Fichtman Dana,et al.  The Reflective Educator′s Guide to Classroom Research: Learning to Teach and Teaching to Learn Through Practitioner Inquiry , 2003 .

[61]  Di Xu,et al.  How do online course design features influence student performance? , 2016, Comput. Educ..

[62]  Davinia Hernández Leo,et al.  How was the activity? A visualization support for a case of location-based learning design , 2015, Br. J. Educ. Technol..

[63]  Erik Duval,et al.  Evaluating the Student Activity Meter: Two Case Studies , 2011, ICWL.

[64]  Colm P. Howlin,et al.  Learning and Academic Analytics in the Realizeit System , 2014 .

[65]  H. Timperley.  Teacher professional learning and development , 2007 .

[66]  Miguel Ángel Conde González,et al.  Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning , 2014, Comput. Hum. Behav..

[67]  Geneviève Gauthier,et al.  Using Teaching Analytics to Inform Assessment Practices in Technology Mediated Problem Solving Tasks , 2013, IWTA@LAK.

[68]  Nikolaos M. Avouris,et al.  Towards the real-time evaluation of collaborative activities: Integration of an automatic rater of collaboration quality in the classroom from the teacher’s perspective , 2014, Education and Information Technologies.

[69]  Manolis Mavrikis,et al.  Towards analytics for educational interactive e-books: the case of the reflective designer analytics platform (RDAP) , 2016, LAK.

[70]  Barbara Wasson,et al.  Towards teacher-led design inquiry of learning , 2014 .

[71]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[72]  Kinshuk,et al.  Teaching Improvement Technologies for Adaptive and Personalized Learning Environments , 2015 .

[73]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[74]  Riccardo Mazza,et al.  MOCLog – Monitoring Online Courses with log data , 2012 .

[75]  Barbara Wasson,et al.  Teacher Inquiry into Student Learning: The TISL Heart Model and Method for use in Teachers' Professional Development , 2016 .

[76]  Shane Dawson,et al.  Informing Pedagogical Action , 2013 .

[77]  Shane Dawson,et al.  The pairing of lecture recording data with assessment scores: a method of discovering pedagogical impact , 2013, LAK '13.

[78]  Mansureh Kebritchi,et al.  Learning Analytics Methods, Benefits, and Challenges in Higher Education: A Systematic Literature Review. , 2016 .

[79]  Vania Dimitrova,et al.  Using Student and Group Models to Support Teachers in Web-Based Distance Education , 2005, User Modeling.