IEA International Computer and Information Literacy Study 2018 Assessment Framework

Overview 7 Purpose of the study 7 Background to the study 7 The place of CIL in relation to traditional disciplines 10 Research questions, participants, and instruments 12 Computer and information literacy framework 15 Overview 15 Defining computer and information literacy 16 Structure of the computer and information literacy construct 18 Strands and aspects 19 Contextual framework 25 Overview 25 Classification of contextual factors 25 Contextual levels and variables 27 Assessment design 35 The ICILS test design 35 The ICILS test instrument 36 Types of assessment task 36 Mapping test items to the CIL framework 43 The ICILS student questionnaire and context instruments 44 Foreword As an international, nonprofit cooperative of national research institutions and governmental research agencies, the International Association for the Evaluation of Educational Achievement (IEA) has conducted more than 30 large-scale comparative studies in countries around the world. These studies have reported on educational policies, practices, and learning outcomes on a wide range of topics and subject matters. These investigations have proven to be a key resource for monitoring educational quality and progress within individual countries and across a broad international context. The International Computer and Information Literacy Study (ICILS) follows a series of earlier IEA studies that had, as their particular focus, information and communication technologies (ICT) in education. The first of these, the Computers in Education Study (COMPED), was carried out in 1989 and again in 1992 for the purpose of reporting on the educational use of computers in the context of emerging governmental initiatives to implement ICT in schools. The next series of projects in this area was the Second These projects provided an update on the implementation of computer technology resources in schools and their utilization in the teaching process. The continuing rapid development of computer and other information technologies has transformed the environment in which young people access, create, and share information. Many countries, having recognized the imperative of digital technology in all its forms, acknowledge the need to educate their citizens in the use of these technologies so that they and their society can secure the future economic and social benefits of proficiency in the use of digital technologies. Within this context, many questions relating to the efficacy of instructional programs and how instruction is progressed in the area of digital literacy arise. ICILS represents the first international comparative study to investigate how students are developing the set of knowledge, understanding, …

[1]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[2]  R. Haigh Planning for Computer Literacy , 1985 .

[3]  Richard J. Shavelson,et al.  Self-Concept: Its Multifaceted, Hierarchical Structure , 1985 .

[4]  W. Riddle,et al.  Comparison of the Achievement of American Elementary and Secondary Pupils with Those Abroad--The Examinations Sponsored by the International Association for the Evaluation of Educational Achievement (IEA). , 1986 .

[5]  F. Williams Measuring the Information Society , 1988 .

[6]  Kenneth J. Travers,et al.  The IEA Study of Mathematics I: Analysis of Mathematics Curricula. Supplement. , 1989 .

[7]  C. Knox-Quinn International Society for Technology in Education. , 1992 .

[8]  D. Treiman,et al.  A standard international socio-economic index of occupational status , 1992 .

[9]  A. Bandura Perceived Self-Efficacy in Cognitive Development and Functioning , 1993, Educational Psychologist.

[10]  Terri Gullickson,et al.  The Six Pillars of Self-Esteem. , 1995 .

[11]  L. Saha International encyclopedia of the sociology of education , 1997 .

[12]  Cleborne D. Maddux,et al.  Logo: A Retrospective , 1997 .

[13]  Jaap Scheerens,et al.  The Foundations of Educational Effectiveness , 1997 .

[14]  Kathleen R. Tyner,et al.  Literacy in a Digital World: Teaching and Learning in the Age of Information , 1998 .

[15]  Gary M. Church The Human-Computer Interface and Information Literacy: Some Basics and Beyond. , 1999 .

[16]  Andrea A. diSessa,et al.  Changing Minds: Computers, Learning, and Literacy , 2000 .

[17]  David Bawden,et al.  Information and digital literacies: a review of concepts , 2001, J. Documentation.

[18]  M. Prensky Digital Natives, Digital Immigrants Part 1 , 2001 .

[19]  T. Goetz,et al.  Academic Emotions in Students' Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research , 2002 .

[20]  Paul Monroe,et al.  International Encyclopaedia of Education , 2002 .

[21]  James W. Marcum Rethinking Information Literacy , 2002, The Library Quarterly.

[22]  P. Twining Oversold and underused: computers in the classroom , 2002 .

[23]  Ragnar Nordlie,et al.  Information literacy: the case or non‐case of Norway? , 2003 .

[24]  Franci Pivec,et al.  Measuring the information society , 2003 .

[25]  S. Dutta,et al.  The Global Information Technology Report , 2003 .

[26]  Sirje Virkus,et al.  Information literacy in Europe: a literature review , 2003, Inf. Res..

[27]  Albert K. Boekhorst,et al.  Becoming information literate in The Netherlands , 2003 .

[28]  Grace S Kao,et al.  Racial and Ethnic Stratification in Educational Achievement and Attainment , 2003 .

[29]  Benno Homann,et al.  German libraries at the starting line for the new task of teaching information literacy , 2003 .

[30]  Scientific International Standard Classification of Education, ISCED 1997 , 2003 .

[31]  Ronald E. Anderson,et al.  Cross-national Policies and Practices on Information and Communication Technology in Education , 2003 .

[32]  Grace S Kao Social Capital and Its Relevance to Minority and Immigrant Populations , 2004 .

[33]  Ludger Woessmann How Equal are Educational Opportunities? Family Background and Student Achievement in Europe and the United States , 2004, SSRN Electronic Journal.

[34]  Steven J. Chrostowski,et al.  TIMSS 2003 International Mathematics Report: Findings from IEA's Trends in International Mathematics and Science Study at the Fourth and Eighth Grades. , 2004 .

[35]  Brian C. Nelson,et al.  "Students' Motivation and Learning of Science in a Multi-User Virtual Environment" , 2005 .

[36]  Karin Taube How in the world do students read , 2005 .

[37]  Selcuk R. Sirin Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research , 2005 .

[38]  Deborah Talmi,et al.  The impact of ICT on education , 2006 .

[39]  Ola Erstad,et al.  A new direction? , 2006, Education and Information Technologies.

[40]  Kelly Wilkinson Students Computer Literacy: Perception versus Reality. , 2006 .

[41]  Gayle S. Christensen,et al.  Where immigrant students succeed: A comparative review of performance and engagement in PISA 2003 , 2006 .

[42]  Jeannette M. Wing An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[43]  David G. Victor,et al.  Natural Gas and Geopolitics: Introduction to the study , 2006 .

[44]  Andreas Schleicher Where immigrant students succeed: a comparative review of performance and engagement in PISA 2003 1 , 2006 .

[45]  Lina Markauskaite,et al.  Exploring the structure of trainee teachers’ ICT literacy: the main components of, and relationships between, general cognitive and technical capabilities , 2007 .

[46]  Nicholas C. Burbules,et al.  E-Lessons Learned , 2007, Teachers College Record: The Voice of Scholarship in Education.

[47]  C. Dede Reinventing the Role of Information and Communications Technologies in Education , 2007, Teachers College Record: The Voice of Scholarship in Education.

[48]  Pierre Foy,et al.  PIRLS 2006 International Report IEA's Progress in International Reading Literacy Study in Primary Schools in 40 Countries , 2007 .

[49]  G. Glass,et al.  Teacher Professional Development and ICT: Strategies and Models , 2007, Teachers College Record: The Voice of Scholarship in Education.

[50]  J. Fraillon,et al.  National Assessment Program--ICT Literacy Years 6 & 10 Report, 2005. , 2007 .

[51]  S. Livingstone,et al.  Converging traditions of research on media and information literacies: disciplinary, critical, and methodological issues , 2008 .

[52]  Willem J. Pelgrum,et al.  Pedagogy and ICT Use : In Schools Around the World Findings from the IEA Sites 2006 Study , 2008 .

[53]  R. Kozma Comparative Analysis of Policies for ICT in Education , 2008 .

[54]  Barrie Gunter,et al.  The Google generation: the information behaviour of the researcher of the future , 2008, Aslib Proc..

[55]  M. A. Bennett Digital Literacy European Commission Working Paper and Recommendations from Digital Literacy High-Level Expert Group , 2008 .

[56]  Sandra Poindexter,et al.  Literacy in Information and Communication Technology , 2008 .

[57]  R. Catts,et al.  Towards information literacy indicators , 2008 .

[58]  G. McCullough,et al.  International Encyclopedia of Education , 2008 .

[59]  Sue Bennett,et al.  The 'digital natives' debate: A critical review of the evidence , 2008, Br. J. Educ. Technol..

[60]  J. Fraillon,et al.  National assessment program: ICT literacy Years 6 and 10 , 2008 .

[61]  Wolfram Schulz,et al.  International civic and citizenship education study : assessment framework , 2008 .

[62]  Roger Azevedo,et al.  Learning With Computer-Based Learning Environments: A Literature Review of Computer Self-Efficacy , 2009 .

[63]  Christine Greenhow,et al.  Learning, Teaching, and Scholarship in a Digital Age , 2009 .

[64]  Neil Selwyn,et al.  The digital native - myth and reality , 2009, Aslib Proc..

[65]  Katerina Ananiadou,et al.  21st Century Skills and Competences for New Millennium Learners in OECD Countries. OECD Education Working Papers, No. 41. , 2009 .

[66]  Carol Jago A History of NAEP Assessment Frameworks. , 2009 .

[67]  Kenneth L. Kraemer,et al.  One Laptop per Child: Vision vs. Reality , 2022 .

[68]  R. Hambleton National Assessment of Educational Progress (NAEP) , 2009 .

[69]  Katerina Ananiadou,et al.  21st Century Skills and Competences for New Millennium Learners in OECD Countries , 2009 .

[70]  Bert P. M. Creemers,et al.  International encyclopedia of education (3rd ed.) , 2010 .

[71]  Boaventura DaCosta,et al.  The digital literacy debate: an investigation of digital propensity and information and communication technology , 2010 .

[72]  Ronald E. Anderson,et al.  Technology and learning : access in schools around the world , 2010 .

[73]  O. Erstad,et al.  Conceptions of Technology Literacy and Fluency , 2010 .

[74]  M. Warschauer,et al.  New Technology and Digital Worlds: Analyzing Evidence of Equity in Access, Use, and Outcomes , 2010 .

[75]  J. Fraillon,et al.  ICCS 2009 International Report: Civic knowledge, attitudes and engagement among lower secondary school students in thirty-eight countries. , 2010 .

[76]  A. V. D. Beemt Interactive media practices of young people , 2010 .

[77]  Paul Resnick,et al.  Educational Priorities for Technology-Mediated Social Participation , 2010, Computer.

[78]  John Harrison,et al.  Computational Thinking: A Digital Age Skill for Everyone. , 2011 .

[79]  GoodeJoanna,et al.  Exploring Computer Science , 2011 .

[80]  Gwo-Jen Hwang,et al.  Research trends in mobile and ubiquitous learning: a review of publications in selected journals from 2001 to 2010 , 2011, Br. J. Educ. Technol..

[81]  P. Shawn Irvin,et al.  Student learning in science simulations: Design features that promote learning gains† , 2011 .

[82]  M. Peters,et al.  Transforming American Education: Learning Powered by Technology , 2011 .

[83]  Wolfram Schulz,et al.  Scaling Procedures for ICILS Questionnaire Items , 2011 .

[84]  Patrick Griffin,et al.  Assessment and Teaching of 21st Century Skills , 2011 .

[85]  Chris Stephenson,et al.  Bringing computational thinking to K-12: what is Involved and what is the role of the computer science education community? , 2011, INROADS.

[86]  Apostolos Koutropoulos Digital Natives: Ten Years After , 2011 .

[87]  Philip C. Abrami,et al.  What Forty Years of Research Says About the Impact of Technology on Learning , 2011 .

[88]  Wolfram Schulz,et al.  Scaling Procedures for ICILS Test Items , 2011 .

[89]  Miguel Nussbaum,et al.  Assessment of 21st century ICT skills in Chile: Test design and results from high school level students , 2012, Comput. Educ..

[90]  I. Mullis,et al.  PIRLS 2021 International Results in Reading , 2012 .

[91]  J. Voogt,et al.  A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies , 2012 .

[92]  Файл загружен,et al.  Digital Competence in Practice : An Analysis of Frameworks , 2012 .

[93]  Slavi Stoyanov,et al.  Online consultation on experts’ views on digital competence , 2012 .

[94]  I. Mullis,et al.  TIMSS 2011 International Results in Mathematics. , 2012 .

[95]  Linda Sturman,et al.  International comparison of computing in schools , 2012 .

[96]  Alfred V. Aho,et al.  Computation and Computational Thinking , 2012, Comput. J..

[97]  Dian Schaffhauser,et al.  Out of Print: Reimagining the K-12 Textbook in a Digital Age. , 2012 .

[98]  Ferrari Anusca DIGCOMP: A Framework for Developing and Understanding Digital Competence in Europe. , 2013 .

[99]  Won-Gyu Lee,et al.  Meanings of criteria and norms: Analyses and comparisons of ICT literacy competencies of middle school students , 2013, Comput. Educ..

[100]  Florence Martin,et al.  Here and now mobile learning: An experimental study on the use of mobile technology , 2013, Comput. Educ..

[101]  Mitchel Resnick,et al.  Imagining, Creating, Playing, Sharing, Reflecting: How Online Community Supports Young People as Designers of Interactive Media , 2013 .

[102]  Johan van Braak,et al.  Direct measures of digital information processing and communication skills in primary education: Using item response theory for the development and validation of an ICT competence scale , 2014, Comput. Educ..

[103]  S. Seljan Digital Agenda for Europe: A Europe 2020 Initiative , 2014 .

[104]  Bill Davey,et al.  Reflections on the Beginnings of an Educational Revolution (?) , 2014, Reflections on the History of Computers in Education.

[105]  Acma – Australian Communications Fostering Digital Citizenship through Safe and Responsible use of ICT , 2014 .

[106]  Sze Yee Lye,et al.  Review on teaching and learning of computational thinking through programming: What is next for K-12? , 2014, Comput. Hum. Behav..

[107]  Sandra Wills,et al.  The Educational Programming Language Logo: Its Nature and Its Use in Australia , 2014, Reflections on the History of Computers in Education.

[108]  J. Fraillon,et al.  Preparing for Life in a Digital Age: The IEA International Computer and Information Literacy Study International Report , 2014 .

[109]  Joke Voogt,et al.  Information Literacy in the Netherlands: Rise, Fall and Revival , 2014, Reflections on the History of Computers in Education.

[110]  Julie Coiro,et al.  Handbook of Research on New Literacies , 2014 .

[111]  Hye-Sook Kim,et al.  An analysis of variables affecting the ICT literacy level of Korean elementary school students , 2014, Comput. Educ..

[112]  Johan van Braak,et al.  Institutionalised ICT use in primary education: A multilevel analysis , 2014, Comput. Educ..

[113]  J. Caspersen,et al.  Novice teachers and how they cope , 2014 .

[114]  Ronny Scherer,et al.  Revisiting teachers' computer self-efficacy: A differentiated view on gender differences , 2015, Comput. Hum. Behav..

[115]  Perman Gochyyev,et al.  Rethinking ICT literacy: From computer skills to social network settings , 2015 .

[116]  Aman Yadav,et al.  Computational thinking in compulsory education: Towards an agenda for research and practice , 2015, Education and Information Technologies.

[117]  Roy D. Pea,et al.  Designing for deeper learning in a blended computer science course for middle school students , 2015, Comput. Sci. Educ..

[118]  Ove Edvard Hatlevik,et al.  Predictors of digital competence in 7th grade: a multilevel analysis , 2015, J. Comput. Assist. Learn..

[119]  Johan van Braak,et al.  Primary school pupils' ICT competences: Extensive model and scale development , 2015, Comput. Educ..

[120]  Matthew Berland,et al.  Comparing Virtual and Physical Robotics Environments for Supporting Complex Systems and Computational Thinking , 2015, Journal of Science Education and Technology.