The relationship between ICT and student literacy in mathematics, reading, and science across 44 countries: A multilevel analysis

Abstract This study conceptualized ICT as multi-level (country-, school-, and student-level) constructs and examined their relationships with student mathematics, reading, and scientific literacy. Three-level hierarchical linear models (HLM) were employed to analyse the Programme for International Student Assessment (PISA) 2015 data of 305,414 15-year-old students from 11,075 schools across 44 countries. The findings indicated that (i) national ICT skills had a more positive effect on student academic performance than did national ICT access and use; (ii) students ICT availability at school positively associated with student academic success, whereas student ICT availability at home negatively associated with student academic success; (iii) student ICT academic use negatively correlated with student performance, while ICT entertainment use positively correlated with student performance; and (v) student attitudes toward ICT demonstrated mixed effects on student academic success – specifically, student interest, competence, and autonomy in using ICT had positive correlations, while student enjoyment of social interaction around ICT had a negative correlation with student academic performance.

[1]  Ludger Woessmann,et al.  Computers and Student Learning: Bivariate and Multivariate Evidence on the Availability and Use of Computers at Home and at School , 2004, SSRN Electronic Journal.

[2]  Michele L. Ybarra,et al.  Online "predators" and their victims: myths, realities, and implications for prevention and treatment. , 2008, The American psychologist.

[3]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[4]  Peggy A. Ertmer,et al.  Removing obstacles to the pedagogical changes required by Jonassen's vision of authentic technology-enabled learning , 2013, Comput. Educ..

[5]  Anja Balanskat,et al.  The The ICT impact report , 2006 .

[6]  Rae Condie,et al.  The impact of ICT in schools - a landscape review , 2007 .

[7]  Jehanzeb R. Cheema,et al.  Quantity and Quality of Computer Use and Academic Achievement: Evidence from a Large-Scale International Test Program , 2013 .

[8]  Nancy Law.  Educational innovations beyond technology: nurturing leadership and establishing learning organizations / Nancy Law, Allan Yuen, Robert Fox , 2011 .

[9]  Eden Litt,et al.  Measuring users’ internet skills: A review of past assessments and a look toward the future , 2013, New Media Soc..

[10]  Francesco Avvisati.  Students, computers and learning : making the connection , 2015 .

[11]  Charalambos Vrasidas,et al.  Can Computer Use Hurt Science Achievement? The USA Results from PISA , 2003 .

[12]  Ting Seng Eng,et al.  The impact of ICT on learning: A review of research , 2005 .

[13]  Khalid Bingimlas.  Barriers to the Successful Integration of ICT in Teaching and Learning Environments: A Review of the Literature , 2009 .

[14]  Pia Sundqvist,et al.  Out-of-school digital gameplay and in-school L2 English vocabulary outcomes * , 2015 .

[15]  S. Hennessy,et al.  Literature Review in Science Education and the Role of ICT: Promise, Problems and Future Directions , 2003 .

[16]  Dominik Petko,et al.  Perceived Quality of Educational Technology Matters , 2017 .

[17]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[18]  M. Carrasco,et al.  Learning Environments with Technological Resources: A Look at Their Contribution to Student Performance in Latin American Elementary Schools , 2012 .

[19]  Valerie E. Lee,et al.  Using Hierarchical Linear Modeling to Study Social Contexts: The Case of School Effects , 2000 .

[20]  Mark D. Griffiths,et al.  Excessive Computer Game Playing: Evidence for Addiction and Aggression? , 2007, Cyberpsychology Behav. Soc. Netw..

[21]  Bonnie Wing-Yin Chow,et al.  Culture, motivation, and reading achievement: High school students in 41 countries , 2010 .

[22]  Chin-Chung Tsai,et al.  Developing an Internet Attitude Scale for high school students , 2001, Comput. Educ..

[23]  Nagy K. Hanna,et al.  Why national strategies are needed for ICT-enabled development , 2003 .

[24]  Erkan Erdogdu,et al.  The impact of access to ICT, student background and school/home environment on academic success of students in Turkey: An international comparative analysis , 2015, Comput. Educ..

[25]  Yong Zhao,et al.  Technology uses and student achievement: A longitudinal study , 2007, Comput. Educ..

[26]  Tony Fisher,et al.  ImpaCT2: the impact of information and communication technologies on pupil learning and attainment , 2002 .

[27]  O. Bulut,et al.  The Relationship between Students' Exposure to Technology and Their Achievement in Science and Math , 2011 .

[28]  Birgit Eickelmann,et al.  ICT use in mathematics lessons and the mathematics achievement of secondary school students by international comparison: Which role do school level factors play? , 2017, Education and Information Technologies.

[29]  Stephen Krashen,et al.  Free Voluntary Reading , 2011 .

[30]  Jana Heinz.  Digital Skills and the Influence of Students’ Socio-Economic Background. An Exploratory Study in German Elementary Schools , 2016 .

[31]  Roger Azevedo,et al.  Learning With Computer-Based Learning Environments: A Literature Review of Computer Self-Efficacy , 2009 .

[32]  Willem J. Pelgrum,et al.  Obstacles to the integration of ICT in education: results from a worldwide educational assessment , 2001, Comput. Educ..

[33]  King Luu,et al.  An analysis of the relationship between information and communication technology (ICT) and scientific literacy in Canada and Australia , 2011, Comput. Educ..

[34]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[35]  Peter Twining,et al.  Research on ICT in K-12 schools - A review of experimental and survey-based studies in computers & education 2011 to 2015 , 2017, Comput. Educ..

[36]  Sule Bayraktar,et al.  A Meta-analysis of the Effectiveness of Computer-Assisted Instruction in Science Education , 2000 .

[37]  Yaobin Lu,et al.  Internet inequality: The relationship between high school students' Internet use in different locations and their Internet self-efficacy , 2010, Comput. Educ..

[38]  Yves Punie,et al.  NMC Horizon Report Europe: 2014 Schools Edition , 2014 .

[39]  H. Goldstein.  Multilevel Statistical Models , 2006 .

[40]  Brita Larsson.  English Out-of-School Activities - A Way of Integrating Outwards? , 2012 .

[41]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[42]  F. Williams.  Measuring the Information Society , 1988 .

[43]  Jingjing Zhang,et al.  How the ICT development level and usage influence student achievement in reading, mathematics, and science , 2015, Comput. Educ..

[44]  Philip C. Abrami,et al.  What Forty Years of Research Says About the Impact of Technology on Learning , 2011 .

[45]  K. Frank,et al.  Factors Affecting Technology Uses in Schools: An Ecological Perspective , 2003 .

[46]  Khe Foon Hew,et al.  Using Twitter for education: Beneficial or simply a waste of time? , 2017, Comput. Educ..

[47]  Robert E. Slavin,et al.  How features of educational technology applications affect student reading outcomes: A meta-analysis , 2012 .

[48]  E. Hargittai.  Digital Na(t)ives? Variation in Internet Skills and Uses among Members of the “Net Generation”* , 2010 .

[49]  Shelley Yeo,et al.  Making a Difference: Student Perceptions of E-learning Blended with Traditional Teaching Methods , 2011 .

[50]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[51]  Jing Lei,et al.  Quantity versus quality: A new approach to examine the relationship between technology use and student outcomes , 2010, Br. J. Educ. Technol..

[52]  Peggy A. Ertmer,et al.  Teacher Technology Change , 2010 .

[53]  Sedat Gumus,et al.  EXPLORING THE RELATIONSHIP BETWEEN PURPOSE OF COMPUTER USAGE AND READING SKILLS OF TURKISH STUDENTS: EVIDENCE FROM PISA 2006 , 2011 .

[54]  Unesco Uis,et al.  Guide to Measuring Information and Communication Technologies (ICT) in Education , 2009 .

[55]  M. Cox,et al.  A review of the research literature relating to ICT and attainment , 2004 .

[56]  D. Istance,et al.  OECD Work on Technology and Education: Innovative Learning Environments as an Integrating Framework. , 2013 .

[57]  J. Stevens.  Applied Multivariate Statistics for the Social Sciences , 1986 .

[58]  R. Kozma.  National policies that connect ICT-based education reform to economic and social development , 2005 .

[59]  Yuan‐Hsuan Lee,et al.  The effect of individual differences in the inner and outer states of ICT on engagement in online reading activities and PISA 2009 reading literacy: Exploring the relationship between the old and new reading literacy , 2012 .

[60]  Thomas A. Brush,et al.  Integrating technology into K-12 teaching and learning: current knowledge gaps and recommendations for future research , 2007 .

[61]  Punie Yves,et al.  Innovating teaching and learning practices: Key elements for developing Creative Classrooms in Europe , 2012 .