The impact of 151 learning designs on student satisfaction and performance: social learning (analytics) matters

An increasing number of researchers are taking learning design into consideration when predicting learning behavior and outcomes across different modules. This study builds on preliminary learning design work that was presented at LAK2015 by the Open University UK. In this study we linked 151 modules and 111.256 students with students' satisfaction and performance using multiple regression models. Our findings strongly indicate the importance of learning design in predicting and understanding performance of students in blended and online environments. In line with proponents of social learning analytics, our primary predictor for academic retention was the amount of communication activities, controlling for various institutional and disciplinary factors. Where possible, appropriate communication tasks that align with the learning objectives of the course may be a way forward to enhance academic retention.

[1]  Rebecca Ferguson,et al.  Social learning analytics: five approaches , 2012, LAK.

[2]  Gráinne Conole,et al.  Designing for Learning in an Open World , 2012 .

[3]  Martin Weller,et al.  Final Project Report of the OULDI- JISC Project: Challenge and Change in Curriculum Design Process, Communities, Visualisation and Practice , 2012 .

[4]  J. Beishuizen,et al.  Student learning experience as indicator of teaching quality , 2012 .

[5]  Dirk T. Tempelaar,et al.  In search for the most informative data for feedback generation: Learning analytics in a data-rich context , 2015, Comput. Hum. Behav..

[6]  J. B. Arbaugh,et al.  System, scholar or students? Which most influences online MBA course effectiveness? , 2014, J. Comput. Assist. Learn..

[7]  Shane Dawson,et al.  Where learning analytics meets learning design , 2012, LAK '12.

[8]  Carol Calvert.  Developing a model and applications for probabilities of student success: a case study of predictive analytics , 2014 .

[9]  Shane Dawson,et al.  Learning designs and learning analytics , 2011, LAK.

[10]  Alejandro Armellini,et al.  Learning design and assessment with e-tivities , 2010, Br. J. Educ. Technol..

[11]  J. Arbaugh,et al.  A Structural Equation Model of Predictors for Effective Online Learning , 2005 .

[12]  Dirk T. Tempelaar,et al.  A review of the role of information communication technology and course design in transitional education practices , 2012, Interact. Learn. Environ..

[13]  John T. E. Richardson,et al.  Approaches to studying across the adult life span: Evidence from distance education , 2013 .

[14]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[15]  Bernard Scott,et al.  Competencies for learning design: A review of the literature and a proposed framework , 2011, Br. J. Educ. Technol..

[16]  Julie L. Booth,et al.  Instructional Complexity and the Science to Constrain It , 2013, Science.

[17]  Rebecca Ferguson,et al.  Social Learning Analytics , 2012, J. Educ. Technol. Soc..

[18]  Bart Rienties,et al.  "Scaling up" learning design: impact of learning design activities on LMS behavior and performance , 2015, LAK.

[19]  Bart Rienties,et al.  Modelling and Managing Learner Satisfaction: Use of Learner Feedback to Enhance Blended and Online Learning Experience , 2016 .

[20]  Peter Goodyear,et al.  Processing and Visualizing Data in Complex Learning Environments , 2013 .

[21]  J. Arbaugh,et al.  Technological and Structural Characteristics, Student Learning and Satisfaction with Web-Based Courses , 2002 .

[22]  Betty Pfefferbaum,et al.  American behavioral scientist , 1995 .

[23]  Kathleen M. T. Collins,et al.  Students’ Perceptions of Characteristics of Effective College Teachers: A Validity Study of a Teaching Evaluation Form Using a Mixed-Methods Analysis , 2007 .

[24]  Shane Dawson,et al.  Informing Pedagogical Action , 2013 .

[25]  Bart Rienties,et al.  Analysing 157 learning designs using learning analytic approaches as a means to evaluate the impact of pedagogical decision making , 2016, Br. J. Educ. Technol..

[26]  Herbert W. Marsh,et al.  SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching. , 1982 .