Factorial invariance across gender of a perceived ICT literacy scale

Abstract This study used the framework of multiple-group confirmatory factor analysis (MGCFA) to test the factorial invariance (configural, measurement, and structural invariance) of a newly developed three-factor, 17-item perceived information and communication technology (ICT) literacy scale (3F-PICTLS) across gender, which includes the three subscales of information literacy (information), internet literacy (communication), and computer literacy (technology). Using a stratified random sample of 825 secondary school students (396 males) with ages ranging from 11 to 16 (mean = 13.16, SD = .773), the scale showed configural and partial measurement invariance but not structural invariance across gender. These findings highlight the importance of measurement invariance as a methodological challenge for researchers who attempt to make meaningful comparisons and interpretations across gender in a variety of contexts in the scholarship of ICT in education, which is largely ignored in existing literature. From a practical standpoint, we discuss the implications for teachers to assess and promote ICT literacy for students of different genders. Taken together, this study provides new methodological and pragmatic insights into a greater understanding of the issue of gender differences in ICT literacy for researchers and practitioners.

[1]  Michelene T. H. Chi,et al.  Searching for Information on-Line and off-Line: Gender Differences among Middle School Students , 2003 .

[2]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[3]  Joke Voogt,et al.  Computer literacy in secondary education: the performance and engagement of girls , 1987 .

[4]  F. K. Sarfo,et al.  Technology and gender equity: Rural and urban students' attitudes towards information and communication technology , 2011 .

[5]  Patricia Senn Breivik,et al.  21st century learning and information literacy , 2005 .

[6]  Chin-Chung Tsai,et al.  Junior high school students' Internet usage and self-efficacy: A re-examination of the gender gap , 2010, Comput. Educ..

[7]  Jason W. Osborne,et al.  Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. , 2005 .

[8]  T. Schmitt.  Current Methodological Considerations in Exploratory and Confirmatory Factor Analysis , 2011 .

[9]  Dimiter M. Dimitrov,et al.  Testing for Factorial Invariance in the Context of Construct Validation , 2010 .

[10]  Ove Edvard Hatlevik,et al.  Digital competence at the beginning of upper secondary school: Identifying factors explaining digital inclusion , 2013, Comput. Educ..

[11]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[12]  E. Carmines,et al.  Analyzing models with unobserved variables: analysis of covariance structures , 1981 .

[13]  Chao-Min Chiu,et al.  Internet self-efficacy and electronic service acceptance , 2004, Decis. Support Syst..

[14]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[15]  G. A. Marcoulides,et al.  An Introduction to Applied Multivariate Analysis , 2008 .

[16]  K. Widaman.  Common Factors Versus Components: Principals and Principles, Errors and Misconceptions , 2007 .

[17]  King Luu,et al.  An analysis of the relationship between information and communication technology (ICT) and scientific literacy in Canada and Australia , 2011, Comput. Educ..

[18]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[19]  David Bawden,et al.  Information and digital literacies: a review of concepts , 2001, J. Documentation.

[20]  Hye-Sook Kim,et al.  An analysis of variables affecting the ICT literacy level of Korean elementary school students , 2014, Comput. Educ..

[21]  C. Tømte,et al.  Challenging Our Views on ICT, Gender and Education , 2011 .

[22]  Yaobin Lu,et al.  Internet inequality: The relationship between high school students' Internet use in different locations and their Internet self-efficacy , 2010, Comput. Educ..

[23]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[24]  Zoheir Ezziane,et al.  Information Technology Literacy: Implications on Teaching and Learning , 2007, J. Educ. Technol. Soc..

[25]  Wilfred W. F. Lau,et al.  Developing and validating of a perceived ICT literacy scale for junior secondary school students: Pedagogical and educational contributions , 2014, Comput. Educ..

[26]  Amery D. Wu,et al.  Decoding the Meaning of Factorial Invariance and Updating the Practice of Multi-group Confirmatory Factor Analysis: A Demonstration With TIMSS Data , 2007 .

[27]  S. Borges-Yáñez,et al.  Differential item functioning of the Spanish version of the Child Perceptions Questionnaire. , 2013, Journal of investigative and clinical dentistry.

[28]  D. Kaplan.  Structural Equation Modeling: Foundations and Extensions , 2000 .

[29]  Zhi-Jin Zhong,et al.  From access to usage: The divide of self-reported digital skills among adolescents , 2011, Comput. Educ..

[30]  J. Cooper,et al.  The digital divide: the special case of gender , 2006, J. Comput. Assist. Learn..

[31]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[32]  Richard P. Bagozzi,et al.  Assessing Construct Validity in Organizational Research , 1991 .

[33]  B. Byrne.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[34]  Factorial Invariance and Latent Mean Differences of Scores on the Achievement Goal Tendencies Questionnaire across Gender and Age in a Sample of Spanish Students. , 2011 .

[35]  B. Byrne.  Testing for Multigroup Invariance Using AMOS Graphics: A Road Less Traveled , 2004 .

[36]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[37]  K. Jacobs,et al.  Gender Differences in Environmental Values , 2014 .

[38]  Tina N. Hohlfeld,et al.  Examining the digital divide in K-12 public schools: Four-year trends for supporting ICT literacy in Florida , 2008, Comput. Educ..

[39]  Ellen Meier,et al.  Different but similar: computer use patterns between young Korean males and females , 2011 .

[40]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[41]  Kim F. Nimon,et al.  Measurement Invariance: A Foundational Principle for Quantitative Theory Building , 2011 .