Effects of Adaptive Learning Technologies on Math Achievement: A Quantitative Study of ALEKS Math Software

The intent of this study is to investigate the effects of a particular adaptive math learning program (ALEKS) on math achievement and its impact on closing the achievement gap in math performance of middle school students. The study is conducted in two small urban school districts in a southern city. The study is a quasi-experimental research design with a sample size of 1110 students in grades fifth through ninth forming a control group and a treatment group of equal sizes. The data is compiled from the 2014-2015 school year (archived data) and has been analyzed using analysis of covariance (ANCOVA) to compare mean scores of the two groups from a norm-referenced test and regression analysis to understand various categorical variables affecting math achievement on ALEKS.

[1]  K. Koedinger,et al.  Investigations into Help Seeking and Learning with a Cognitive Tutor , 2001 .

[2]  K. Koedinger,et al.  Exploring the Assistance Dilemma in Experiments with Cognitive Tutors , 2007 .

[3]  Luis Martínez-López,et al.  An Intelligent Tutoring System Architecture for Competency-Based Learning , 2011, KES.

[4]  Ruth Ellen Hanna,et al.  Predicting student preparedness in calculus , 2006 .

[5]  Mathieu Koppen,et al.  Introduction to knowledge spaces: How to build, test, and search them , 1990 .

[6]  Robert E. Slavin,et al.  Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis , 2008 .

[7]  Mare Taagepera,et al.  Mapping Students' Thinking Patterns in Learning Organic Chemistry by the Use of Knowledge Space Theory , 2000 .

[8]  Erica Frankenberg,et al.  A Multiracial Society with Segregated Schools: Are We Losing the Dream? Cambridge , 2003 .

[9]  Jean-Paul Doignon,et al.  The assessment of knowledge, in theory and in practice , 2003, IEMC '03 Proceedings. Managing Technologically Driven Organizations: The Human Side of Innovation and Change (IEEE Cat. No.03CH37502).

[10]  Adrianna Kezar,et al.  What is the best way to achieve broader reach of improved practices in higher education? , 2011 .

[11]  Judy M. Taylor.  The Effects of a Computerized-Algebra Program on Mathematics Achievement of College and University Freshmen Enrolled in a Developmental Mathematics Course , 2008 .

[12]  Dietrich Albert,et al.  Adaptive and Dynamic Hypertext Tutoring Systems Based on Knowledge Space Theory , 1996 .

[13]  Cristina Varsavsky,et al.  Chances of success in and engagement with mathematics for students who enter university with a weak mathematics background , 2010 .

[14]  Tom Vander Ark.  Getting Smart: How Digital Learning is Changing the World , 2011 .

[15]  James P. Spillane,et al.  Alignment and Accountability in Policy Design and Implementation , 2016 .

[16]  Wellesley R. Foshay,et al.  Computer-based instruction’s (CBI) rediscovered role in K-12: An evaluation case study of one high school’s use of CBI to improve pass rates on high-stakes tests , 2008 .

[17]  George W. Bohrnstedt,et al.  School Composition and the Black-White Achievement Gap. NCES 2015-018. , 2015 .

[18]  J. L. McKenney,et al.  Influences on Learning in Simulation Games , 1966 .

[19]  Jessica Ravenel,et al.  Effects of Computer-Based Programs on Mathematical Achievement Scores for Fourth-Grade Students. , 2014 .

[20]  Karen Saxe,et al.  A Common Vision for Undergraduate Mathematics , 2016 .

[21]  J. Anderson,et al.  Automaticity and the ACT* theory. , 1992, The American journal of psychology.

[22]  S. Krimsky.  Do Financial Conflicts of Interest Bias Research? , 2013 .

[23]  Alfinio Flores,et al.  Examining Disparities in Mathematics Education: Achievement Gap or Opportunity Gap? , 2007 .

[24]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[25]  Anthony G. Picciano.  BLENDED LEARNING: IMPLICATIONS FOR GROWTH AND ACCESS , 2019, Online Learning.

[26]  J. Waller,et al.  Comparison of Five Analytic Techniques for Two-Group, Pre-Post Repeated Measures Designs Using SAS ® , 2014 .

[27]  Leila Gano.  Fitting Technology to the Mathematics Pedagogy: Its Effect on Students' Academic Achievement , 2010 .

[28]  G. Hagerty,et al.  Redesigning College Algebra: Combining Educational Theory and Web-Based Learning to Improve Student Attitudes and Performance , 2010 .

[29]  J. Valentine,et al.  Outcome-Reporting Bias in Education Research , 2013 .

[30]  N. Dickard,et al.  The Sustainability Challenge: Taking EdTech to the Next Level. , 2003 .

[31]  John F. Gardner,et al.  AC 2007-1998: BENEFITS OF A TUTORIAL MATHEMATICS PROGRAM FOR ENGINEERING STUDENTS ENROLLED IN PRECALCULUS: A TEMPLATE FOR ASSESSMENT , 2007 .

[32]  Angel A. Juan,et al.  Teaching mathematics online in the European Area of Higher Education: an instructor's point of view , 2011 .

[33]  Michael Villano,et al.  Probabilistic Student Modeling with Knowledge Space Theory , 1992 .

[34]  C. R. Anderson.  An Experiment on Behavioral Learning in a Consumer Credit Game , 1970 .

[35]  Vincent Aleven,et al.  Intelligent Tutoring Goes To School in the Big City , 1997 .

[36]  Georgette M. Michko,et al.  A Meta-Analysis of the Effectiveness of Teaching and Learning With Technology on Student Outcomes December 2003 , 2003 .

[37]  Shana Goldwyn,et al.  School Leadership that Works: From Research to Results , 2007 .

[38]  Nicolas Gury,et al.  Dropping out of higher education in France: a micro‐economic approach using survival analysis , 2011 .

[39]  Beverley Park Woolf,et al.  Building Intelligent Interactive Tutors , 2008 .

[40]  Christopher H. Tienken,et al.  The Impact of Computer Assisted Instruction on Seventh-Grade Students' Mathematics Achievement. , 2007 .

[41]  Roberto Agodini,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from Two Student Cohorts. Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education , 2009 .

[42]  Jean-Paul Doignon.  Knowledge Spaces and Skill Assignments , 1994 .

[43]  K. Meyer,et al.  A Mixed-Methods Assessment of Using an Online Commercial Tutoring System to Teach Introductory Statistics , 2009 .

[44]  M. Haberman,et al.  The Pedagogy of Poverty versus Good Teaching , 2010 .

[45]  Wanjira Kinuthia,et al.  The effect of aleks on students' mathematics achievement in an online learning environment and the cognitive complexity of the initial and final assessments , 2012 .

[46]  Ryan Shaun Joazeiro de Baker,et al.  Off-task behavior in the cognitive tutor classroom: when students "game the system" , 2004, CHI.

[47]  Michael G. Watt.  States' Implementation of the Common Core State Standards and the Australian Curriculum: A Comparison of the Change Process in Two Countries. , 2015 .

[48]  Ryan Shaun Joazeiro de Baker,et al.  Detecting Student Misuse of Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[49]  D. Dimitrov,et al.  Pretest-posttest designs and measurement of change. , 2003, Work.

[50]  Owen Conlan,et al.  Using Knowledge Space Theory to support Learner Modeling and Personalization , 2006 .

[51]  Marc Harper,et al.  Mathematics Placement at the University of Illinois , 2013 .

[52]  Thomas T. Liao,et al.  Book Review: Blended: Using Disruptive Innovation to Improve Schools , 2015 .

[53]  J. Falmagne,et al.  Assessing Mathematical Knowledge in a Learning Space : Validity and / or Reliability ∗ , 2006 .

[54]  Thomas J. Kane,et al.  Using Imperfect Information to Identify Effective Teachers , 2008 .

[55]  Jean-Claude Falmagne,et al.  Spaces for the Assessment of Knowledge , 1985, Int. J. Man Mach. Stud..

[56]  Jason L. Anthony,et al.  A Randomized Control Trial Evaluating the Effectiveness of Computer Assisted Instruction in Numeracy on Math Outcomes for Monolingual English Speaking Kindergartners from Title 1 Schools. , 2016 .

[57]  John R. Anderson.  ACT: A simple theory of complex cognition. , 1996 .

[58]  Dietrich Albert,et al.  RATH - A Relational Adaptive Tutoring Hypertext WWW-Environment Based on Knowledge Space Theory , 1997 .

[59]  Cathy Ringstaff,et al.  The Learning Return on Our Educational Technology Investment: A Review of Findings from Research. , 2002 .

[60]  J. Schofield.  Computers and classroom culture , 1995 .

[61]  Heather Staker,et al.  Classifying K-12 Blended Learning. , 2012 .

[62]  Clayton M. Christensen,et al.  Is K-12 Blended Learning Disruptive? An Introduction to the Theory of Hybrids. , 2013 .

[63]  John F. Gardner,et al.  An Innovative Method To Realistically Track Engineering Student Retention And Academic Progress , 2007 .

[64]  nominatif de l’habitat,et al.  Definitions , 1964, Innovation Dynamics and Policy in the Energy Sector.

[65]  Mike Schmoker.  Focus: Elevating the Essentials to Radically Improve Student Learning, 2nd Edition , 2014 .

[66]  Christopher A. Salerno.  The Effect of Time on Computer-Assisted Instruction for At-Risk Students , 1995 .