Internet-based alternatives for equitable preparation, access, and success in gateway courses

Abstract Remedial college courses generate tuition and fit neatly into existing course structures. But they often fail to deliver access and success in foundational “gateway” undergraduate courses. Because under-represented minorities are over-represented in these courses, remedial courses obstruct equitable access and success. Schools are increasingly turning instead to supplemental instruction and Internet-based intelligent tutoring systems (ITSs). But these alternatives don't generate tuition, are difficult to evaluate, and can require substantial infrastructure. This study compared 2561 students who qualified for Principles of Chemistry and Biochemistry by passing Developmental Chemistry with 607 students who qualified by completing a commercial Internet-based ITS. Propensity-score techniques were used to control for biased selection and assignment. We found that spending approximately 30 h on a $30 ITS was equally as effective as spending hundreds of hours and thousands of dollars of tuition on a three or five credit remedial course in terms of final grades in Principles for the entire population as well as for under-represented minorities. This finding has implications for advising students and for designing and evaluating programs for underprepared students and under-represented minorities.

[1]  K. Topping The effectiveness of peer tutoring in further and higher education: A typology and review of the literature , 1996 .

[2]  Henry M. Levin,et al.  Remediation in the Community College , 2008 .

[3]  K. Meyer,et al.  A Mixed-Methods Assessment of Using an Online Commercial Tutoring System to Teach Introductory Statistics , 2009 .

[4]  B. Long,et al.  The Role of Remedial and Developmental Courses in Access and Persistence , 2013 .

[5]  Shanna Smith Jaggars,et al.  Characterizing the Effectiveness of Developmental Education: A Response to Recent Criticism , 2013 .

[6]  Thomas Bailey,et al.  Developmental Education in Community Colleges , 2010 .

[7]  K. Rath,et al.  Supplemental instruction in introductory biology I: enhancing the performance and retention of underrepresented minority students. , 2007, CBE life sciences education.

[8]  Marco A. Palma,et al.  Impacts of playing after school on academic performance: a propensity score matching approach , 2017 .

[9]  Kimberly J. Vannest,et al.  Academic Benefits of Peer Tutoring: A Meta-Analytic Review of Single-Case Research , 2013 .

[10]  Christopher J. Grayce A Commercial Implementation of Knowledge Space Theory In College General Chemistry , 2013, Knowledge Spaces, Applications in Education.

[11]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[12]  S G Smith,et al.  Educational uses of the PLATO computer system. , 1976, Science.

[13]  Arthur C. Graesser,et al.  The impact of a technology-based mathematics after-school program using ALEKS on student's knowledge and behaviors , 2013, Comput. Educ..

[14]  B. Bloom The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[15]  James A. Kulik,et al.  Effectiveness of Intelligent Tutoring Systems , 2016 .

[16]  Gloria Crisp,et al.  Hispanic Student Success: Factors Influencing the Persistence and Transfer Decisions of Latino Community College Students Enrolled in Developmental Education , 2010 .

[17]  Chien-Yuan Su,et al.  Designing and implementing a personalized remedial learning system for enhancing the programming learning , 2013, J. Educ. Technol. Soc..

[18]  Phillip Dawson,et al.  On the Effectiveness of Supplemental Instruction , 2014 .

[19]  Jim E. Greer,et al.  Evaluation Methods for Intelligent Tutoring Systems Revisited , 2015, International Journal of Artificial Intelligence in Education.

[20]  Miguel Nussbaum,et al.  Methodology for evaluating a novel education technology: a case study of handheld video games in Chile , 2006, Comput. Educ..

[21]  Judith Scott-Clayton,et al.  Do High-Stakes Placement Exams Predict College Success? , 2012 .

[22]  Neelu Jyothi Ahuja,et al.  A Critical Review of Development of Intelligent Tutoring Systems: Retrospect, Present and Prospect , 2013 .

[23]  Albert T. Corbett,et al.  Intelligent Tutoring Systems , 1985, Science.

[24]  Davis Jenkins,et al.  Integrating Basic Skills and Career-Technical Instruction: Findings From a Field Study of Washington State’s I-BEST Model , 2011 .

[25]  Gloria Crisp,et al.  The Impact of Developmental Education on Community College Persistence and Vertical Transfer , 2014 .

[26]  W. Norton Grubb,et al.  From Black Box to Pandora's Box: Evaluating Remedial/Developmental Education. CCRC Brief Number 11. , 2001 .

[27]  T. Lancaster,et al.  Contract Cheating: The Outsourcing of Assessed Student Work , 2015 .

[28]  R. P. Wilder,et al.  Maternal Smoking During Pregnancy and Birthweight: A Propensity Score Matching Approach , 2008, Maternal and Child Health Journal.

[29]  Linda Crocker,et al.  Teaching for the Test: Validity, Fairness, and Moral Action , 2005 .

[30]  Hunter R. Boylan,et al.  30 Years of Developmental Education: A Retrospective , 2007 .

[31]  Henry M. Levin,et al.  The Economic Payoff to Investing in Educational Justice , 2009 .

[32]  Robert Kelchen,et al.  An Analysis of Student Fees: The Roles of States and Institutions , 2016 .

[33]  Marios C. Angelides,et al.  Embedding an intelligent tutoring system in a business gaming-simulation environment , 1994, Proceedings of Winter Simulation Conference.

[34]  Jack F. Eichler,et al.  Online Homework Put to the Test: A Report on the Impact of Two Online Learning Systems on Student Performance in General Chemistry. , 2013 .

[35]  Deanna C. Martin,et al.  Breaking the Attrition Cycle: The Effects of Supplemental Instruction on Undergraduate Performance and Attrition. , 1983 .

[36]  L. Steven Zwerling Developmental Math with a Difference. , 1979 .

[37]  Thurston Domina,et al.  New Evidence on College Remediation , 2006 .

[38]  T. Bailey CHALLENGE AND OPPORTUNITY: RETHINKING THE ROLE AND FUNCTION OF DEVELOPMENTAL EDUCATION IN COMMUNITY COLLEGE , 2009 .

[39]  Clive R. Belfield,et al.  Improving the Targeting of Treatment , 2012 .

[40]  Hai-Anh H. Dang,et al.  The Growing Phenomenon of Private Tutoring: Does it Deepen Human Capital, Widen Inequalities, or Waste Resources? , 2008 .

[41]  Thomas Bailey,et al.  Referral, Enrollment, and Completion in Developmental Education Sequences in Community Colleges. CCRC Working Paper No. 15. , 2008 .

[42]  Fred Phillips,et al.  An Intelligent Tutoring System for the Accounting Cycle: Enhancing Textbook Homework with Artificial Intelligence , 2009 .

[43]  Greg Ridgeway,et al.  Toolkit for Weighting and Analysis of Nonequivalent Groups , 2014 .

[44]  Ling-Hsiu Chen,et al.  Enhancement of student learning performance using personalized diagnosis and remedial learning system , 2011, Comput. Educ..

[45]  John R. Anderson,et al.  Cognitive Modeling and Intelligent Tutoring , 1990, Artif. Intell..

[46]  Nancy Falchikov,et al.  Learning Together: Peer Tutoring in Higher Education , 2001 .

[47]  P. Ashwin Peer Support: Relations between the context, process and outcomes for the students who are supported , 2003 .

[48]  Tereza Virtová,et al.  A tool for learning or a tool for cheating? The many-sided effects of a participatory student website in mass higher education , 2015, Br. J. Educ. Technol..

[49]  Ryan Shaun Joazeiro de Baker,et al.  Stupid Tutoring Systems, Intelligent Humans , 2016, International Journal of Artificial Intelligence in Education.

[50]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[51]  Ji Won You,et al.  Identifying significant indicators using LMS data to predict course achievement in online learning , 2016, Internet High. Educ..

[52]  Xiangen Hu,et al.  A Potential Technological Solution for Reducing the Achievement Gap Between White And Black Students , 2013, Knowledge Spaces, Applications in Education.

[53]  Leif Bryngfors,et al.  Supplemental Instruction: Whom Does it Serve? , 2011 .

[54]  David R. Arendale,et al.  History of Supplemental Instruction (SI): Mainstreaming of developmental education , 2002 .

[55]  Chris Warnick,et al.  Beyond the Budget: Sustainability and Writing Studios , 2010 .

[56]  K. VanLehn The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[57]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .