Learning experience assessment of flipped courses

The flipped classroom has shown a positive effect on academic performance and student satisfaction. However, there are relatively few studies that help us understand when or why this method has a positive effect on students, so as to aid the design of a flipped class. In this study, an instrument for assessing the student learning experience in flipped courses is proposed and validated, comparing the results of their application over two semesters in a university-level programming class with three flipped sections (n = 151) and four conventional ones (n = 226). We found that with a similar score in terms of learning experience, the achievement in a flipped course is slightly higher than in a lecture-based course, F(1,108) = 4.20, p = 0.04, d = 0.19. A multiple regression analysis was conducted for the effect on achievement of GPA, level of challenge, feedback and enjoyment. By controlling for these factors, students in flipped classes achieved higher scores than students in lecture-based courses, β = 0.1, t(370) = 2.4, p = 0.02. The expected improvement in achievement increases when features of the flipped classroom improve the student experience. Our results suggest that the design of a flipped class should consider the effect of different implementation features on student experience in order to select the most appropriate ones for a particular context.

[1]  Dylan M Glatt,et al.  The Flipped Classroom: A Course Redesign to Foster Learning and Engagement in a Health Professions School , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[2]  Embry-Riddle Aeronautical,et al.  The Flipped Classroom: A Survey of the Research , 2013 .

[3]  Christopher P. Niemiec,et al.  Autonomy, competence, and relatedness in the classroom , 2009 .

[4]  David J. Shernoff,et al.  Student engagement in high school classrooms from the perspective of flow theory. , 2003 .

[5]  Aaron Sams,et al.  Flip Your Classroom: Reach Every Student in Every Class Every Day , 2012 .

[6]  J. Hair.  Multivariate data analysis , 1972 .

[7]  Diane Horton,et al.  Evaluating an inverted CS1 , 2014, SIGCSE.

[8]  Diane Horton,et al.  Drop, Fail, Pass, Continue: Persistence in CS1 and Beyond in Traditional and Inverted Delivery , 2015, SIGCSE.

[9]  Robert D. Macredie,et al.  Teaching Introductory Programming: A Quantitative Evaluation of Different Approaches , 2015, TOCE.

[10]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[11]  Sheng-Chin Yu,et al.  journal homepage: www.elsevier.com/locate/compedu , 2022 .

[12]  E. Pedhazur.  Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[13]  D. Kuhn,et al.  Problem-Based Learning in K–12 Education , 2011 .

[14]  J. Stevens.  Applied Multivariate Statistics for the Social Sciences , 1986 .

[15]  Fred Paas,et al.  Instructional design for advanced learners: Establishing connections between the theoretical frameworks of cognitive load and deliberate practice , 2005 .

[16]  M. Csíkszentmihályi,et al.  The Concept of Flow , 2014 .

[17]  J. D. Walker,et al.  It's not about seat time: Blending, flipping, and efficiency in active learning classrooms , 2014, Comput. Educ..

[18]  W. Hays.  Using Multivariate Statistics , 1983 .

[19]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[20]  J. Hattie,et al.  The Power of Feedback , 2007 .

[21]  David C. Haak,et al.  Increased Structure and Active Learning Reduce the Achievement Gap in Introductory Biology , 2011, Science.

[22]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[23]  Nian-Shing Chen,et al.  Is FLIP enough? Or should we use the FLIPPED model instead? , 2014, Comput. Educ..

[24]  E. Deci,et al.  Facilitating internalization: the self-determination theory perspective. , 1994, Journal of personality.

[25]  Min Kyu Kim,et al.  The experience of three flipped classrooms in an urban university: an exploration of design principles , 2014, Internet High. Educ..

[26]  Adem Karahoca,et al.  Computer assisted active learning system development for critical thinking in history of civilization , 2010 .

[27]  D. A. Walker,et al.  JMASM9: Converting Kendall’s Tau For Correlational Or Meta-Analytic Analyses , 2003 .

[28]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[29]  Yasuhiro Hayashi,et al.  Collaborative Learning in Computer Programming Courses That Adopted the Flipped Classroom , 2015, 2015 International Conference on Learning and Teaching in Computing and Engineering.

[30]  Mark J. Graham,et al.  Increased Preclass Preparation Underlies Student Outcome Improvement in the Flipped Classroom , 2015, CBE life sciences education.

[31]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[32]  Kathleen E. Cook,et al.  Comparing the Effectiveness of an Inverted Classroom to a Traditional Classroom in an Upper-Division Engineering Course , 2013, IEEE Transactions on Education.

[33]  R. Felder,et al.  Understanding Student Differences , 2005 .

[34]  C. Phillips,et al.  The use of flipped classrooms in higher education: A scoping review , 2015, Internet High. Educ..

[35]  Francisco J. Martínez-López,et al.  Modelling students' flow experiences in an online learning environment , 2014, Comput. Educ..

[36]  Lev Vygotsky.  Mind in society , 1978 .

[37]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[38]  Michelle K. Smith,et al.  Active learning increases student performance in science, engineering, and mathematics , 2014, Proceedings of the National Academy of Sciences.

[39]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[40]  Jamie L. Jensen,et al.  Improvements from a Flipped Classroom May Simply Be the Fruits of Active Learning , 2015, CBE life sciences education.

[41]  Xiaowen Fang,et al.  Development of an Instrument for Studying Flow in Computer Game Play , 2013, Int. J. Hum. Comput. Interact..

[42]  Paul van Schaik,et al.  Attitudes towards user experience (UX) measurement , 2014, Int. J. Hum. Comput. Stud..

[43]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[44]  David J. Shernoff,et al.  Flow in Schools Cultivating Engaged Learners and Optimal Learning Environments , 2008 .

[45]  Richard E. Mayer,et al.  e-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2002 .