The impact of integrating ICT with teaching: Evidence from a randomized controlled trial in rural schools in China

Recent attention has been placed on whether integrating Information Communication Technology (hereafter, ICT) into education can effectively improve learning outcomes. However, the empirical evidence of the impact of programmes that adopt ICT in schooling is mixed. Theory suggests it may be due to differences in whether or not the ICT programmes are integrated into a teaching programme of a class. Unfortunately, few empirical studies compare the relative effectiveness of programmes that integrate ICT into teaching with the ones that do not. In order to understand the most effective way to design new programmes that attempt to utilize ICT to improve English learning, we conducted a clustered randomized controlled trial (RCT) with some schools receiving ICT that was integrated into the teaching programme of the class; with some schools that received ICT without having it integrated into the teaching programme; and with other schools being used as controls. The RCT involved 6304 fifth grade students studying English in 127 rural schools in rural China. Our results indicate that when the programme is integrated into the teaching programme of a class it is effective in improving student test scores relative to the control schools. No programme impact, however, is found when the ICT programme is not integrated into the teaching program. We also find that when ICT programmes are integrated into teaching, the programmes work similarly for students that have either high or low initial (or baseline) levels of English competency. When ICT programmes are not integrated with teaching, they only raise the educational performance of English students who were performing better during the baseline. We conducted a randomized experiment to test how to use ICT to improve learning.Student test scores improved when ICT is integrated into the teaching programme.Both better and poorer performing students benefited when ICT is integrated.No impact is found when ICT is not integrated into the teaching programme.

[1]  Zhu Wei-wei,et al.  Difficulties for the development and principles for the promotion of IoT industry in the new era——an interpretation of “The 12th Five-Year Plan for the Development of IoT Industry” by the Ministry of Industry and Information Technology , 2012 .

[2]  Scott Rozelle,et al.  Computer assisted learning as extracurricular tutor? Evidence from a randomised experiment in rural boarding schools in Shaanxi , 2013 .

[3]  Bassma Basheer Nomass,et al.  The Impact of Using Technology in Teaching English as a Second Language , 2013 .

[4]  S. Mumtaz.  Factors affecting teachers' use of information and communications technology: a review of the literature , 2000 .

[5]  Aurora Tatiana Dina,et al.  The Advantages and Disadvantages of Computer Assisted Language Learning and Teaching for Foreign Languages , 2013 .

[6]  Ya Chi Chien.  Effects Of Computer-assisted Language Learning (call) Instruction On The Acquisition Of Passive Grammatical Forms By Post-secondary English As A Second Language (esl) Students , 2011 .

[7]  Roberto Agodini,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from Two Student Cohorts. Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education , 2009 .

[8]  William R. Penuel,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort , 2007 .

[9]  Kursat Cagiltay,et al.  Use of Commercial Games for Educational Purposes: Will Today’s Teacher Candidates Use them in the Future? , 2006 .

[10]  Joan E. Hughes,et al.  The Role of Teacher Knowledge and Learning Experiences in Forming Technology-Integrated Pedagogy , 2005 .

[11]  D. Graddol,et al.  English in China today , 2010, English Today.

[12]  Murat Hismanoglu.  Prospective EFL Teachers' Perceptions of ICT Integration: A Study of Distance Higher Education in Turkey , 2012, J. Educ. Technol. Soc..

[13]  Ralf Schwarzer,et al.  Self-efficacy in the adoption and maintenance of health behaviors: Theoretical approaches and a new model. , 1992 .

[14]  Johan van Braak,et al.  A multidimensional approach to determinants of computer use in primary education: teacher and school characteristics , 2008, J. Comput. Assist. Learn..

[15]  Ting Jiang.  Other-Regarding Preferences and Other-Regarding Cheating – Experimental Evidence from China, Italy, Japan and the Netherlands , 2014 .

[16]  Eyiuche Ifeoma.  Using Computer-Assisted Language Learning To Improve Students' English Language Achievement in Universal Basic Education , 2010 .

[17]  Heather Lotherington,et al.  Factors contributing to teachers' successful implementation of IT , 2002, J. Comput. Assist. Learn..

[18]  Joyojeet Pal,et al.  The case for multi-user design for computer aided learning in developing regions , 2006, WWW '06.

[19]  Leigh L. Linden.  Complement or substitute? The effect of technology on student achievement in India , 2008 .

[20]  Scott Rozelle,et al.  Integrating computer-assisted learning into a regular curriculum: evidence from a randomised experiment in rural schools in Shaanxi , 2014 .

[21]  Leigh L. Linden,et al.  How to Teach English in India: Testing the Relative Productivity of Instruction Methods within the Pratham English Language Education Program 1 , 2008 .

[22]  Fang Lai,et al.  Does Computer-Assisted Learning Improve Learning Outcomes ? Evidence from a Randomized Experiment in Public Schools in Rural Minority Areas in Qinghai , China , 2013 .

[23]  Alan B. Krueger,et al.  Putting Computerized Instruction to the Test: A Randomized Evaluation of a "Scientifically-Based" Reading Program , 2004 .

[24]  Abdurrahman Ghaleb Almekhlafi,et al.  The Effect of Computer Assisted Language Learning (CALL) on United Arab Emirates English as a Foreign Language (EFL) School Students’ Achievement and Attitude , 2006 .

[25]  J. Angrist,et al.  New Evidence on Classroom Computers and Pupil Learning , 1999, SSRN Electronic Journal.

[26]  Jeremy F. Jones.  CALL and the Responsibilities of Teachers and Administrators , 2001 .

[27]  Mehrak Rahimi,et al.  ICT Use in EFL Classes: A Focus on EFL Teachers’ Characteristics , 2011 .

[28]  Stephen Krashen,et al.  Principles and Practice in Second Language Acquisition , 1982 .

[29]  Khalid Bingimlas.  Barriers to the Successful Integration of ICT in Teaching and Learning Environments: A Review of the Literature , 2009 .

[30]  E. Hatch.  Second language acquisition : a book of readings , 1979 .

[31]  Lisa Barrow,et al.  Technology's Edge: The Educational Benefits of Computer-Aided Instruction. NBER Working Paper No. 14240. , 2008 .

[32]  Jack L. Burston,et al.  CALL at the Crossroads: Myths, Realities, Promises, and Challenges , 1996 .

[33]  Shu Ching Yang,et al.  A study of high school English teachers' behavior, concerns and beliefs in integrating information technology into English instruction , 2008, Comput. Hum. Behav..

[34]  Glenn Stockwell.  A review of technology choice for teaching language skills and areas in the CALL literature , 2007, ReCALL.

[35]  S. Gass,et al.  Input, Interaction and Output: An Overview , 2006 .

[36]  G. Hu.  English Language Education in China: Policies, Progress, and Problems , 2005 .

[37]  Martin Ebner,et al.  Successful implementation of user-centered game based learning in higher education: An example from civil engineering , 2007, Comput. Educ..

[38]  S. Rozelle,et al.  Does computer-assisted learning improve learning outcomes? Evidence from a randomized experiment in migrant schools in Beijing , 2015 .

[39]  Michael H. Long.  The Role of the Linguistic Environment in Second Language Acquisition , 1996 .

[40]  Michael Kremer,et al.  Chapter 61 Using Randomization in Development Economics Research: A Toolkit ★ , 2007 .

[41]  Matthew Boswell,et al.  Computer Technology in Education: Evidence from a pooled Study of Computer Assisted Learning Programs among Rural Students in China , 2015 .

[42]  Ralf Schwarzer,et al.  Measuring optimistic self-beliefs: A Chinese adaptation of the General Self-Efficacy Scale. , 1995 .

[43]  Shannon Sauro,et al.  COMPUTER-MEDIATED CORRECTIVE FEEDBACK AND THE DEVELOPMENT OF L2 GRAMMAR , 2009 .

[44]  Yvonne Lam.  Technophilia vs. Technophobia: A Preliminary Look at Why Second-Language Teachers Do or Do Not Use Technology in Their Classrooms , 2000 .