Learning analytics to unveil learning strategies in a flipped classroom

Prior education studies have consistently emphasized the importance of sustained and active student engagement to aid academic performance and achievement of learning outcomes (e.g., Hockings, Cooke, Yamashita, McGinty, & Bowl, 2008; Michael, 2006). The positive impact of such active learning models on academic outcomes has been well established, particularly, in the STEM (Science, Technology, Engineering andMathematics) disciplines. For example, Freeman et al. (2014) demonstrated that students undertaking STEM courses incorporating active learning models received (on average) higher academic grades and were less likely to fail in comparison to peers in more traditional and lecture based modes of teaching. While active learning has clear benefits for student learning outcomes, the process of implementation is often more complex than first anticipated (Gillies & Boyle, 2010; Hung, 2011). For instance, student engagement in active learning does not occur spontaneously and educators must employ careful consideration of the curriculum design, activity sequencing and progression as well as the diversity of learners, including learners' prior experience and motivation, background and knowledge. Flipped learning (FL) is a form of blended learning that requires students' active participation in learning activities both before and during face-to-face sessions with the teacher (Lage, Platt, & Tregua, 2000). However, students frequently lack the necessary skills, time, and/ormotivation to fully participate in pre-class activities and therefore do not commit to the level of involvement in the learning process that effectively complements the intended design (Lai & Hwang, 2016; Mason, Shuman, & Cook, 2013). Clearly, the reasoning for why students may or may not engage in pre-class activities is complex and multi-dimensional. However, if provided with a deeper insight into the types of learning strategies students employ in such active learning models, teaching staff can make better informed decisions regarding student support and course design processes (Stief & Dollar, 2009). Despite the increasing popularity of FL and similar active learning models, there has been limited attention devoted to understanding

[1]  Abelardo Pardo,et al.  Data2U: scalable real time student feedback in active learning environments , 2016, LAK.

[2]  Maria Bannert,et al.  e-Research and learning theory: What do sequence and process mining methods contribute? , 2014, Br. J. Educ. Technol..

[3]  J. Biggs What the student does: teaching for enhanced learning , 1999 .

[4]  John T. E. Richardson,et al.  Methodological Issues in Questionnaire-Based Research on Student Learning in Higher Education , 2004 .

[5]  Philip H. Winne,et al.  Learning Strategies, Study Skills, and Self-Regulated Learning in Postsecondary Education , 2013 .

[6]  K. Trigwell,et al.  RELATING APPROACHES TO STUDY AND QUALITY OF LEARNING OUTCOMES AT THE COURSE LEVEL , 1991 .

[7]  Dianne Jamieson-Noel,et al.  Self-regulating studying by objectives for learning: Students’ reports compared to a model , 2003 .

[8]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[9]  Mingming Zhou,et al.  Modeling Academic Achievement by Self-Reported versus Traced Goal Orientation. , 2012 .

[10]  Philip H. Winne,et al.  Exploring students’ calibration of self reports about study tactics and achievement , 2002 .

[11]  M. Hannafin,et al.  Cognitive strategies and learning from the world wide web , 1997 .

[12]  Marcelo Worsley,et al.  Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming , 2014, Journal of the Learning Sciences.

[13]  Philip H. Winne,et al.  A Cognitive and Metacognitive Analysis of Self-Regulated Learning , 2011 .

[14]  Andrew J. Elliot,et al.  Stability and change in achievement goals. , 2007 .

[15]  Kristopher J Preacher,et al.  Use of the extreme groups approach: a critical reexamination and new recommendations. , 2005, Psychological methods.

[16]  Marek Hatala,et al.  Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions , 2015, Internet High. Educ..

[17]  George Siemens,et al.  Learning Analytics , 2013 .

[18]  Hiromi Yamashita,et al.  Switched off? A study of disengagement among computing students at two universities , 2008 .

[19]  Chris S. Hulleman,et al.  Achievement Goal Theory at the Crossroads: Old Controversies, Current Challenges, and New Directions , 2011 .

[20]  Min Kyu Kim,et al.  The experience of three flipped classrooms in an urban university: an exploration of design principles , 2014, Internet High. Educ..

[21]  P. H. Miller,et al.  Strategy utilization deficiencies in children: when, where, and why. , 1994, Advances in child development and behavior.

[22]  Embry-Riddle Aeronautical,et al.  The Flipped Classroom: A Survey of the Research , 2013 .

[23]  R. Bjork,et al.  Self-regulated learning: beliefs, techniques, and illusions. , 2013, Annual review of psychology.

[24]  Jeremy F. Strayer How learning in an inverted classroom influences cooperation, innovation and task orientation , 2012 .

[25]  Geraldine Clarebout,et al.  Regulation of tool-use within a blended course: Student differences and performance effects , 2013, Comput. Educ..

[26]  P. Reed,et al.  Evaluating Web-supported Learning Versus Lecture-based Teaching: Quantitative and Qualitative Perspectives , 2005 .

[27]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[28]  Geraldine Clarebout,et al.  Students' tool-use within a web enhanced course: Explanatory mechanisms of students' tool-use pattern , 2013, Comput. Hum. Behav..

[29]  R. Azevedo,et al.  A Theoretical Review of Winne and Hadwin’s Model of Self-Regulated Learning: New Perspectives and Directions , 2007 .

[30]  M. Lage,et al.  Inverting the Classroom: A Gateway to Creating an Inclusive Learning Environment , 2000 .

[31]  Sarah Rae Sletten Investigating Self-Regulated Learning Strategies in the Flipped Classroom , 2015 .

[32]  Thomas M. Duffy,et al.  Online learning: Learner characteristics and their approaches to managing learning , 2009 .

[33]  Kathleen E. Cook,et al.  Comparing the Effectiveness of an Inverted Classroom to a Traditional Classroom in an Upper-Division Engineering Course , 2013, IEEE Transactions on Education.

[34]  D. Glance,et al.  Flipping the sociology classroom: Towards a practice of online pedagogy , 2013 .

[35]  A. U. Chamot LANGUAGE LEARNING STRATEGY INSTRUCTION: CURRENT ISSUES AND RESEARCH , 2005, Annual Review of Applied Linguistics.

[36]  Gilbert Ritschard,et al.  Analyzing and Visualizing State Sequences in R with TraMineR , 2011 .

[37]  Philip H. Winne,et al.  How Software Technologies Can Improve Research on Learning and Bolster School Reform , 2006 .

[38]  C. Phillips,et al.  The use of flipped classrooms in higher education: A scoping review , 2015, Internet High. Educ..

[39]  E. Wagenmakers,et al.  Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies , 2014, Psychonomic Bulletin & Review.

[40]  Dragan Gasevic,et al.  Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success , 2016, Internet High. Educ..

[41]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[42]  Baharuddin Aris,et al.  Significance of preparedness in flipped classroom , 2015 .

[43]  Negin Mirriahi,et al.  Design, Deployment and Evaluation of a Flipped Learning First-Year Engineering Course , 2017 .

[44]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[45]  Jan Keith Farmer,et al.  Where ' s the evidence that active learning works ? , 2006 .

[46]  Taylor Martin,et al.  Using Learning Analytics to Understand the Learning Pathways of Novice Programmers , 2013 .

[47]  Gordon Pask,et al.  Learning Strategies and Individual Competence. , 1972 .

[48]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[49]  Mariane Frenay,et al.  Task Value, Self-Efficacy and Goal Orientations: Impact on self-regulated learning, choice and performance among university students , 2007 .

[50]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[51]  B. Zimmerman Self-Regulated Learning and Academic Achievement: An Overview , 1990 .

[52]  D. Garrison,et al.  Researching the community of inquiry framework: Review, issues, and future directions , 2007, Internet High. Educ..

[53]  A. Elliot,et al.  A 2 X 2 achievement goal framework. , 2001, Journal of personality and social psychology.

[54]  K. Trigwell,et al.  Relations between teachers' approaches to teaching and students' approaches to learning , 1999 .

[55]  Philip H. Winne,et al.  Examining trace data to explore self-regulated learning , 2007 .

[56]  Jan Herrington,et al.  Learning analytics and study behaviour: a pilot study , 2011 .

[57]  Dorit Maor,et al.  Using academic analytic tools to investigate studying behaviours in technology-supported learning environments , 2010 .

[58]  Patricia Devine,et al.  Doty, R. Getting Started as a Pharmacy Preceptor. Washington, D.C. American Pharmacists Association; 2011, 153pp, $31.50 (paperback), ISBN 9781582121468. , 2012, American Journal of Pharmaceutical Education.

[59]  R. A. Ellis,et al.  Learning through inquiry: student difficulties with online course-based Material , 2005, J. Comput. Assist. Learn..

[60]  Gautam Biswas,et al.  Using Hidden Markov Models to Characterize Student Behaviors in Learning-by-Teaching Environments , 2008, Intelligent Tutoring Systems.

[61]  E. Deci,et al.  Self-determination theory: A macrotheory of human motivation, development, and health. , 2008 .

[62]  R. Pierce,et al.  Vodcasts and Active-Learning Exercises in a “Flipped Classroom” Model of a Renal Pharmacotherapy Module , 2012, American Journal of Pharmaceutical Education.

[63]  C. Weinstein,et al.  Self-Regulation Interventions with a Focus on Learning Strategies , 2000 .

[64]  Shane Dawson,et al.  Informing Pedagogical Action , 2013 .

[65]  Paul S. Steif,et al.  Study of Usage Patterns and Learning Gains in a Web‐based Interactive Static Course , 2009 .

[66]  R. Gillies,et al.  Teachers' reflections on cooperative learning: Issues of implementation , 2010 .

[67]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[68]  Michelle K. Smith,et al.  Active learning increases student performance in science, engineering, and mathematics , 2014, Proceedings of the National Academy of Sciences.

[69]  N. Purdie,et al.  Effects of Learning Skills Interventions on Student Learning: A Meta-Analysis , 1996 .

[70]  Charles G Prober,et al.  Medical education reimagined: a call to action. , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[71]  P. Reimann,et al.  Process mining techniques for analysing patterns and strategies in students’ self-regulated learning , 2013, Metacognition and Learning.

[72]  Barbara A. Greene,et al.  Influences on achievement : Goals, perceived ability, and cognitive engagement , 1996 .

[73]  Gautam Biswas,et al.  Analysis of Productive Learning Behaviors in a Structured Inquiry Cycle Using Hidden Markov Models , 2010, EDM.

[74]  Jacqueline E McLaughlin,et al.  Pharmacy Student Engagement, Performance, and Perception in a Flipped Satellite Classroom , 2013, American Journal of Pharmaceutical Education.

[75]  Philip H. Winne,et al.  A METACOGNITIVE VIEW OF INDIVIDUAL DIFFERENCES IN SELF-REGULATED LEARNING , 1996 .

[76]  Gwo-Jen Hwang,et al.  A self-regulated flipped classroom approach to improving students' learning performance in a mathematics course , 2016, Comput. Educ..

[77]  L. Abeysekera,et al.  Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research , 2015 .

[78]  Woei Hung,et al.  Theory to reality: a few issues in implementing problem-based learning , 2011 .