Development and validation of the Internet Skills Scale (ISS)

ABSTRACT Although a number of instruments have been used to measure Internet skills in nationally representative surveys, there are several challenges with the measures available: incompleteness and over-simplification, conceptual ambiguity, and the use of self-reports. Here, we aim to overcome these challenges by developing a set of reliable measures for use in research, practice, and policy evaluations based on a strong conceptual framework. To achieve this goal, we carried out a literature review of skills-related studies to develop the initial Internet skills framework and associated instrument. After the development of this instrument, we used a three-fold approach to test the validity and reliability of the latent skill constructs and the corresponding items. The first step consisted of cognitive interviews held in both the UK and the Netherlands. Based on the cognitive interview results, we made several amendments to the proposed skill items to improve clarity. The second step consisted of a pilot survey of digital skills, both in the UK and in the Netherlands. During the final step, we examined the consistency of the five Internet skill scales and their characteristics when measured in a representative sample survey of Dutch Internet users. The result is a theoretical, empirically and cross-nationally consistent instrument consisting of five types of Internet skills: operational, navigation information, social, creative, and mobile.

[1]  Ulla K. Bunz.  A Generational Comparison of Gender, Computer Anxiety, and Computer-Email-Web Fluency , 2009 .

[2]  Yoram Eshet-Alkalai,et al.  Digital Literacy: A Conceptual Framework for Survival Skills in the Digital era , 2004 .

[3]  Brian S. Krueger.  A Comparison of Conventional and Internet Political Mobilization , 2006 .

[4]  S. Hick,et al.  Inequality and the digital divide : myths and realities , 2002 .

[5]  Alexander Johannes Aloysius Maria van Deursen,et al.  Measuring digital skills: from digital skills to tangible outcomes , 2014 .

[6]  Antonio Fini,et al.  Are young generations in secondary school digitally competent? A study on Italian teenagers , 2012, Comput. Educ..

[7]  Ellen Helsper,et al.  A corresponding fields model for the links between social and digital exclusion , 2012 .

[8]  Alexander Johannes Aloysius Maria van Deursen,et al.  Measuring Digital Skills , 2008 .

[9]  Alexander van Deursen,et al.  Internet Skills, Sources of Support, and Benefiting From Internet Use , 2014, Int. J. Hum. Comput. Interact..

[10]  Mark Warschauer,et al.  Demystifying the digital divide. , 2003, Scientific American.

[11]  William Voon,et al.  Perceived versus actual computer-email-web fluency , 2007, Comput. Hum. Behav..

[12]  R. Stine,et al.  Bootstrapping Goodness-of-Fit Measures in Structural Equation Models , 1992 .

[13]  Albert H. Segars,et al.  Assessing the unidimensionality of measurement : a paradigm and illustration within the context of information systems research , 1997 .

[14]  Robert LaRose,et al.  Internet Self-Efficacy and the Psychology of the Digital Divide , 2006, J. Comput. Mediat. Commun..

[15]  Yair Amichai-Hamburger,et al.  Experiments in Digital Literacy , 2004, Cyberpsychology Behav. Soc. Netw..

[16]  Alexander van Deursen,et al.  Proposing a Survey Instrument for Measuring Operational, Formal, Information, and Strategic Internet Skills , 2012, Int. J. Hum. Comput. Interact..

[17]  J. Dijk,et al.  Internet skill levels increase, but gaps widen: a longitudinal cross-sectional analysis (2010–2013) among the Dutch population , 2015 .

[18]  Ellen Helsper,et al.  Tangible outcomes of internet use: from digital skills to tangible outcomes project report , 2015 .

[19]  Alexander Johannes Aloysius Maria van Deursen,et al.  Digital Skills: Unlocking the Information Society , 2014 .

[20]  Roman Brandtweiner,et al.  How to become a sophisticated user: a two-dimensional approach to e-literacy , 2010, New Media Soc..

[21]  Alexander van Deursen,et al.  Measuring Internet Skills , 2010, Int. J. Hum. Comput. Interact..

[22]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[23]  Denise Potosky,et al.  The Internet knowledge (iKnow) measure , 2007, Comput. Hum. Behav..

[24]  Eden Litt,et al.  Measuring users’ internet skills: A review of past assessments and a look toward the future , 2013, New Media Soc..

[25]  R. Eynon,et al.  Distinct skill pathways to digital engagement , 2013 .

[26]  S. Brooks,et al.  Applied Multivariate Statistics for the Social Sciences , 1993 .

[27]  Eszter Hargittai,et al.  Second-Level Digital Divide: Differences in People's Online Skills , 2002, First Monday.

[28]  J. Hair.  Multivariate data analysis : a global perspective , 2010 .

[29]  Ulla K. Bunz,et al.  The Computer-Email-Web (CEW) Fluency Scale--Development and Validation , 2001 .

[30]  R. Gonzalez.  Applied Multivariate Statistics for the Social Sciences , 2003 .

[31]  E. McColl.  Cognitive Interviewing. A Tool for Improving Questionnaire Design , 2006, Quality of Life Research.

[32]  Marco Gui,et al.  Digital skills of internet natives: Different forms of digital literacy in a random sample of northern Italian high school students , 2011, New Media Soc..

[33]  D. Bawden.  Origins and Concepts of Digital Literacy , 2008 .

[34]  Файл загружен,et al.  Digital Competence in Practice : An Analysis of Frameworks , 2012 .

[35]  Brian H. Spitzberg.  Preliminary Development of a Model and Measure of Computer-Mediated Communication (CMC) Competence , 2006, J. Comput. Mediat. Commun..

[36]  Kimberly Merritt,et al.  AN INVESTIGATION OF SELF-REPORTED COMPUTER LITERACY: IS IT RELIABLE? , 2005 .

[37]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[38]  Wallace Koehler,et al.  Virtual inequality: Beyond the digital divide , 2004, J. Assoc. Inf. Sci. Technol..

[39]  Sanna Talja,et al.  The social and discursive construction of computing skills , 2005, J. Assoc. Inf. Sci. Technol..

[40]  Henry Jenkins.  Confronting the Challenges of Participatory Culture: Media Education for the 21st Century , 2006 .

[41]  Alexander van Deursen,et al.  Internet skills and the digital divide , 2011, New Media Soc..

[42]  Sonia Livingstone,et al.  Digital literacy and safety skills , 2011 .

[43]  Eszter Hargittai,et al.  Survey Measures of Web-Oriented Digital Literacy , 2005 .

[44]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[45]  C. Haythornthwaite.  Social networks and online community , 2009 .

[46]  Eszter Hargittai,et al.  Succinct Survey Measures of Web-Use Skills , 2012 .