Modeling Key Differences in Underrepresented Students' Interactions with an Online STEM Course

Little is known about the ways that underrepresented students in online STEM courses interact and behave differently from their peers, or whether online courses offer learning opportunities that can better suit these under-served populations. The current study examines the logged behavioral patterns of 470 university students, spanning 3 years, who were enrolled in an online introductory STEM course. Cross-validated data mining methods were applied to their interaction logs to determine if first generation, non-white, female, or non-traditional (≥ 23 years old) students could be classified by their behaviors. Model classification accuracies were evaluated with the Matthews Correlation Coefficient (MCC). First generation (MCC = .123), non-white (MCC = .153), female (MCC = .183) and non-traditional students (MCC = .109) were classified at levels significantly above chance (MCC = 0). Follow-up analyses of predictive features showed that first-generation students made more quiz attempts, non-white students interacted more during night hours (8pm-8am), female students submitted quizzes earlier, and non-traditional students accessed discussion forums less than their peers. We show that understanding behaviors is crucial in this context because behaviors in the first two weeks alone (e.g., discussion forum participation, number of logins) predicted eventual grade in the course (MCC = .200). Implications are discussed, including suggestions for future research as well as interventions and course features that can support underrepresented STEM students in online learning spaces.

[1]  Danielle S. McNamara,et al.  Predicting Success in Massive Open Online Courses (MOOCs) Using Cohesion Network Analysis , 2017, CSCL.

[2]  Danielle S. McNamara,et al.  Combining click-stream data with NLP tools to better understand MOOC completion , 2016, LAK.

[3]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[4]  David N. Beede,et al.  STEM: Good Jobs Now and for the Future. ESA Issue Brief #03-11. , 2011 .

[5]  David N. Beede,et al.  Women in STEM: A Gender Gap to Innovation , 2011 .

[6]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[7]  Amanda L. Griffith,et al.  Persistence of Women and Minorities in STEM Field Majors: Is it the School That Matters? , 2010 .

[8]  Ray Kaupp Online Penalty: The Impact of Online Instruction on the Latino-White Achievement Gap. , 2012 .

[9]  Claire Wladis,et al.  The Online STEM Classroom—Who Succeeds? An Exploration of the Impact of Ethnicity, Gender, and Non-traditional Student Characteristics in the Community College Context , 2015 .

[10]  Ryan Shaun Joazeiro de Baker,et al.  Analyzing Early At-Risk Factors in Higher Education e-Learning Courses , 2015, EDM.

[11]  I. E. Allen,et al.  Changing Course: Ten Years of Tracking Online Education in the United States. , 2013 .

[12]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[13]  Claire Wladis,et al.  Which STEM majors enroll in online courses, and why should we care? The impact of ethnicity, gender, and non-traditional student characteristics , 2015, Comput. Educ..

[14]  P. Allison Multiple Regression: A Primer , 1994 .

[15]  Daryl E. Chubin,et al.  Diversifying the Engineering Workforce , 2005 .

[16]  William F. Punch,et al.  The LearningOnline Network with Computer-Assisted Personalized Approach (LON-CAPA) , 2003, PGLDB.

[17]  Di Xu,et al.  Performance Gaps Between Online and Face-to-Face Courses: Differences Across Types of Students and Academic Subject Areas , 2014 .

[18]  Yael M Levitte,et al.  What’s So Special about STEM? A Comparison of Women’s Retention in STEM and Professional Occupations , 2013, Social forces; a scientific medium of social study and interpretation.

[19]  Shanna Smith Jaggars,et al.  The Effectiveness of Distance Education across Virginia's Community Colleges: Evidence from Introductory College-Level Math and English Courses , 2011 .