How Effective are Intelligent Tutoring Systems in Computer Science Education?

A meta-analysis on the effectiveness of Intelligent Tutoring Systems (ITS) in computer science education compared the learning outcomes of ITS and non-ITS instruction. A search of the literature found 22 effect sizes (involving 1,447 participants) that met the pre-defined inclusion criteria. Although most of the ITS were used to teach programming, other topics such as database design and computer literacy were also represented. There was a significant overall effect size favoring the use of ITS. There was a significant advantage of ITS over teacher-led classroom instruction and non-ITS computer-based instruction. ITS were more effective than the instructional methods to which they were compared regardless of whether they modeled misconceptions and regardless of whether they were the primary means of instruction or were an integrated component of learning activities that included other means of instruction.

[1]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[2]  Albert T. Corbett,et al.  Cognitive Computer Tutors: Solving the Two-Sigma Problem , 2001, User Modeling.

[3]  H. Chad Lane,et al.  Teaching the tacit knowledge of programming to noviceswith natural language tutoring , 2005, Comput. Sci. Educ..

[4]  Albert T. Corbett,et al.  Intelligent Tutoring Systems , 1985, Science.

[5]  H. Cooper,et al.  A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning , 2014 .

[6]  Antonija Mitrovic,et al.  An Intelligent Tutoring System for Entity Relationship Modelling , 2004, Int. J. Artif. Intell. Educ..

[7]  Ani Grubišić,et al.  What is Our Effect Size: Evaluating the Educational Influence of a Web-Based Intelligent Authoring Shell? , 2004 .

[8]  Amruth N. Kumar,et al.  Model-Based Reasoning for Domain Modeling in a Web-Based Intelligent Tutoring System to Help Students Learn to Debug C++ Programs , 2002, Intelligent Tutoring Systems.

[9]  Antonija Mitrovic,et al.  Evaluation of a Constraint-Based Tutor for a Database Language , 1999 .

[10]  Neil C. Rowe,et al.  An intelligent tutor for intrusion detection on computer systems , 1998, Comput. Educ..

[11]  Konstantina Chrysafiadi,et al.  PeRSIVA: An empirical evaluation method of a student model of an intelligent e-learning environment for computer programming , 2013, Comput. Educ..

[12]  Valerie J. Shute,et al.  Intelligent Tutoring Systems: Past, Present, and Future. , 1994 .

[13]  Cristina Conati,et al.  Intelligent Tutoring Systems: New Challenges and Directions , 2009, IJCAI.

[14]  Slavomir Stankov,et al.  Controlled experiment replication in evaluation of e-learning system's educational influence , 2009, Comput. Educ..

[15]  Philip C. Abrami,et al.  What Forty Years of Research Says About the Impact of Technology on Learning , 2011 .

[16]  Ning Wang,et al.  The politeness effect: Pedagogical agents and learning outcomes , 2008, Int. J. Hum. Comput. Stud..

[17]  EunKyoung Lee,et al.  The Impact of a Peer-Learning Agent Based on Pair Programming in a Programming Course , 2010, IEEE Transactions on Education.

[18]  Antonija Mitrovic,et al.  An Intelligent SQL Tutor on the Web , 2003, Int. J. Artif. Intell. Educ..

[19]  Slavomir Stankov,et al.  TEx-Sys model for building intelligent tutoring systems , 2008, Comput. Educ..

[20]  Chih-Ming Chen,et al.  Intelligent web-based learning system with personalized learning path guidance , 2008, Comput. Educ..

[21]  Davide Fossati,et al.  Learning Linked Lists: Experiments with the iList System , 2008, Intelligent Tutoring Systems.

[22]  Dragan Gasevic,et al.  Evaluating an Intelligent Tutoring System for Design Patterns: the DEPTHS Experience , 2009, J. Educ. Technol. Soc..

[23]  Haider Ali Ramadhan.  DISCOVER: AN INTELLIGENT DISCOVERY PROGRAMMING SYSTEM , 2000, Cybern. Syst..

[24]  Miguel A. Redondo,et al.  Using fuzzy logic applied to software metrics and test cases to assess programming assignments and give advice , 2012, J. Netw. Comput. Appl..

[25]  Davide Fossati,et al.  I learn from you, you learn from me: How to make iList learn from students , 2009, AIED.

[26]  Ling-Hsiu Chen,et al.  Enhancement of student learning performance using personalized diagnosis and remedial learning system , 2011, Comput. Educ..

[27]  Antonija Mitrovic,et al.  KERMIT: A Constraint-Based Tutor for Database Modeling , 2002, Intelligent Tutoring Systems.

[28]  Samy S. Abu-Naser.  Evaluating the Effectiveness of the CPP-Tutor, an Intelligent Tutoring System for Students Learning to Program in C++ , 2009 .

[29]  K. VanLehn.  The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .