Computer Assisted, Formative Assessment and Dispositional Learning Analytics in Learning Mathematics and Statistics

Learning analytics seeks to enhance the learning process through systematic measurements of learning related data and to provide informative feedback to learners and teachers, so as to support the regulation of the learning. Track data from technology enhanced learning systems constitute the main data source for learning analytics. This empirical contribution provides an application of Buckingham Shum and Deakin Crick’s theoretical framework of dispositional learning analytics [1]: an infrastructure that combines learning dispositions data with data extracted from computer assisted, formative assessments. In a large introductory quantitative methods module based on the principles of blended learning, combining face-to-face problem-based learning sessions with e-tutorials, we investigate the predictive power of learning dispositions, outcomes of continuous formative assessments and other system generated data in modeling student performance and their potential to generate informative feedback. Using a dynamic, longitudinal perspective, Computer Assisted Formative Assessments seem to be the best predictor for detecting underperforming students and academic performance, while basic LMS data did not substantially predict learning.

[1]  Assessment Understood as Enabling , 2014 .

[2]  Simon Buckingham Shum,et al.  Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics , 2012, International Conference on Learning Analytics and Knowledge.

[3]  Andrew J. Martin.  Examining a multidimensional model of student motivation and engagement using a construct validation approach. , 2007, The British journal of educational psychology.

[4]  Susanne Narciss,et al.  Fostering achievement and motivation with bug-related tutoring feedback in a computer-based training for written subtraction. , 2006 .

[5]  Rebecca Ferguson,et al.  Social Learning Analytics , 2012, J. Educ. Technol. Soc..

[6]  S. Narciss.  Feedback Strategies for Interactive Learning Tasks , 2007 .

[7]  Claire Wyatt-Smith,et al.  Designing assessment for quality learning , 2014 .

[8]  Menucha Birenbaum,et al.  New Insights Into Learning and Teaching and Their Implications for Assessment , 2003 .

[9]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[10]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[11]  Erik Duval,et al.  Dataset-Driven Research to Support Learning and Knowledge Analytics , 2012, J. Educ. Technol. Soc..

[12]  J. Vermunt,et al.  Patterns in Student Learning: Relationships Between Learning Strategies, Conceptions of Learning, and Learning Orientations , 2004 .

[13]  Dirk T. Tempelaar,et al.  Formative assessment and learning analytics , 2013, LAK '13.

[14]  Zdenek Zdráhal,et al.  Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment , 2013, LAK '13.

[15]  J. Vermunt.  Leerstijlen en sturen van leerprocessen in het hoger onderwijs : naar procesgerichte instructie in zelfstandig denken , 1992 .

[16]  Yoon Jeon Kim,et al.  Formative and Stealth Assessment , 2014 .

[17]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..