A Multi-level Analysis of the Relationship between Instructional Practices and Retention in Computer Science

Increasing retention in computer science (CS) courses is a goal of many CS departments. A key step to increasing retention is to understand the factors that impact the likelihood students will continue to enroll in CS courses. Prior research on retention in CS has mostly examined factors such as prior exposure to programming and students' personality characteristics, which are outside the control of undergraduate instructors. This study focuses on factors within the control of instructors, namely, instructional practices that directly impact students' classroom experiences. Participants were recruited from 25 sections of 14 different courses over 4 semesters. A multi-level model tested the effects of individual and class-average perceptions of cooperative learning and teacher directedness on the probability of subsequent enrollment in a CS course, while controlling for students' mastery of CS concepts and status as a CS major. Results indicated that students' individual perceptions of instructional practices were not associated with retention, but the average rating of cooperative learning within a course section was negatively associated with retention. Consistent with prior research, greater mastery of CS concepts and considering or having declared a CS major were associated with a higher probability of taking a future CS courses. Implications for findings are discussed.

[1]  Mark Guzdial,et al.  Success in introductory programming: what works? , 2013, CACM.

[2]  Jeffrey C. Carver,et al.  Increased Retention of Early Computer Science and Software Engineering Students Using Pair Programming , 2007, 20th Conference on Software Engineering Education & Training (CSEET'07).

[3]  Jeffrey J. McConnell,et al.  Active learning and its use in computer science , 1996, ITiCSE.

[4]  Jacob P. Somervell Pair Programming: Not for Everyone? , 2006, FECS.

[5]  Karthikeyan Umapathy,et al.  A Meta-Analysis of Pair-Programming in Computer Programming Courses , 2017, ACM Trans. Comput. Educ..

[6]  Jo Handelsman,et al.  Increasing Persistence of College Students in STEM , 2013, Science.

[7]  Leen-Kiat Soh,et al.  Future-Oriented Motivation and Retention in Computer Science , 2018, SIGCSE.

[8]  Sylvia Beyer,et al.  Why are women underrepresented in Computer Science? Gender differences in stereotypes, self-efficacy, values, and interests and predictors of future CS course-taking and grades , 2014, Comput. Sci. Educ..

[9]  J McConnellJeffrey Active learning and its use in computer science , 1996 .

[10]  Joseph Hilbe,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2009 .

[11]  I. Warner,et al.  Hierarchical Mentoring: A Transformative Strategy for Improving Diversity and Retention in Undergraduate STEM Disciplines , 2011, Journal of Science Education and Technology.

[12]  Sandra Katz,et al.  Gender and race in predicting achievement in computer science , 2003, IEEE Technol. Soc. Mag..

[13]  Mark H. Overmars,et al.  Teaching computer science through game design , 2004, Computer.

[14]  E. Seymour,et al.  Talking About Leaving: Why Undergraduates Leave The Sciences , 1997 .

[15]  Leen-Kiat Soh,et al.  Motivational and Self‐Regulated Learning Profiles of Students Taking a Foundational Engineering Course , 2015 .

[16]  David N. Beede,et al.  STEM: Good Jobs Now and for the Future. ESA Issue Brief #03-11. , 2011 .

[17]  Leo C. Ureel,et al.  The impact of placement in introductory computer science courses on student persistence in a computing major , 2018, ITiCSE.

[18]  Ulrich Trautwein,et al.  Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modeling , 2009 .

[19]  Mark Guzdial,et al.  Teaching the Nintendo generation to program , 2002, CACM.

[20]  G. Diekhoff,et al.  THE RELATIONSHIP BETWEEN ACADEMIC DISHONESTY AND COLLEGE CLASSROOM ENVIRONMENT , 1999 .

[21]  Mark R. Young The Motivational Effects of the Classroom Environment in Facilitating Self-Regulated Learning , 2005, Journal of Marketing Education.

[22]  Leen-Kiat Soh,et al.  Implicit intelligence beliefs of computer science students: Exploring change across the semester , 2017 .

[23]  Sandra Katz,et al.  Gender, achievement, and persistence in an undergraduate computer science program , 2006, DATB.

[24]  Leen-Kiat Soh,et al.  Associations of students' creativity, motivation, and self-regulation with learning and achievement in college computer science courses , 2013, 2013 IEEE Frontiers in Education Conference (FIE).

[25]  Melissa A. Dagley,et al.  Increasing Retention and Graduation Rates Through a STEM Learning Community , 2016 .

[26]  Scott L. Thomas,et al.  An Introduction to Multilevel Modeling Techniques: MLM and SEM Approaches Using Mplus, Third Edition , 2015 .

[27]  Jessica Watkins,et al.  Retaining Students in Science, Technology, Engineering, and Mathematics (STEM) Majors , 2013 .

[28]  Steve Cunningham,et al.  Teaching computer science in context , 2010, INROADS.

[29]  Andrew J. Elliot,et al.  Perceptions of Classroom Environment, Achievement Goals, and Achievement Outcomes. , 2001 .

[30]  Michail N. Giannakos,et al.  Understanding student retention in computer science education: The role of environment, gains, barriers and usefulness , 2016, Education and Information Technologies.