Development and validation of New Media Literacy Scale (NMLS) for university students

Along with the emergence of new media technologies, individuals are now expected not only to consume but also produce, share and criticize digital contents. Being new media literate, they also need to know socio-cultural and emotional aspects of new media beyond its technical characteristics. New media literacy (NML) involves a series of crucial skills needed for living and working in the mediated and participatory society of 21st century. Although there has been a growing interest in the conceptualization of NML, the literature lacks a measuring instrument to operationalize NML. This study attempts to fill this gap by developing and validating a NML scale (NMLS) for university students. The sample included 1226 students at a state university in Turkey. Both exploratory and confirmatory factor analyses as well as item analyses including internal consistency coefficients, item-total correlations, and item discrimination powers were conducted to determine construct validity and reliability. Consistent with the adopted theoretical framework, the 35-item NMLS comprised four factors: Functional Consumption, Critical Consumption, Functional Prosumption, and Critical Prosumption. Potential applications of NMLS for measuring students' new media competencies were discussed within the pedagogical and research contexts. This study aimed to develop a theoretically-grounded New Media Literacy Scale (NMLS).Development and cross-validation samples included a total of 1226 university students.Factor analyses yielded and then confirmed a 35-item, four-factor model of NMLS.The NMLS indicated satisfactory convergent and discriminant validity and reliability.The NMLS can be used to measure new media competencies in education and research.

[1]  Jeff Share,et al.  Critical Media Literacy, Democracy, and the Reconstruction of Education , 2007 .

[2]  Edward J. Maloney.  What Web 2.0 Can Teach Us about Learning. , 2007 .

[3]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[4]  Yoram Eshet-Alkalai,et al.  Issues in Informing Science and Information Technology Thinking in the Digital Era: a Revised Model for Digital Literacy , 2022 .

[5]  M. Karaman,et al.  Media Literacy Levels of the Candidate Teachers , 2009 .

[6]  Chang Zhu,et al.  Teachers’ stages of concern for media literacy education and the integration of MLE in Chinese primary schools , 2014 .

[7]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[8]  Barbara M. Byrne,et al.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[9]  R. Hobbs.  The State of Media Literacy: A Response to Potter , 2011 .

[10]  N. Selwyn.  Web 2.0 applications as alternative environments for informal learning: a critical review , 2007 .

[11]  Wendell Bell,et al.  The Third Wave. , 1982 .

[12]  S. Noar.  The Role of Structural Equation Modeling in Scale Development , 2003 .

[13]  T. Brown,et al.  Confirmatory Factor Analysis for Applied Research , 2006 .

[14]  J. Pallant.  SPSS survival manual : a step-by-step guide to data analysis using SPSS version 15 , 2007 .

[15]  Ulrike Cress,et al.  Learning by Foraging: The Impact of Social Tags on Knowledge Acquisition , 2009, EC-TEL.

[16]  Brian A Primack,et al.  Quantifying media literacy: development, reliability, and validity of a new measure , 2009, Educational media international.

[17]  Robert A Ping,et al.  On assuring valid measures for theoretical models using survey data , 2004 .

[18]  David Buckingham,et al.  Media Education: Literacy, Learning and Contemporary Culture , 2003 .

[19]  M. Lynn.  Determination and quantification of content validity. , 1986, Nursing research.

[20]  R. Hobbs,et al.  The Past, Present, and Future of Media Literacy Education , 2009, Journal of Media Literacy Education.

[21]  Janice W. Butler,et al.  Grappling with Change: Web 2.0 and Teacher Educators , 2012 .

[22]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[23]  S. West,et al.  Teacher's Corner: Testing Measurement Invariance of Second-Order Factor Models , 2005 .

[24]  J. Hair.  Multivariate data analysis , 1972 .

[25]  Mark J. W. Lee,et al.  Social software and participatory learning: Pedagogical choices with technology affordances in the Web 2.0 era , 2007 .

[26]  Henry Jenkins.  Convergence Culture: Where Old and New Media Collide , 2006 .

[27]  D. Chen,et al.  Unpacking New Media Literacy , 2011 .

[28]  Geoffrey M. Maruyama,et al.  Basics of structural equation modeling , 1997 .

[29]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[30]  Tessa Jolls,et al.  Media Literacy—A National Priority for a Changing World , 2004 .

[31]  Julie Pallant,et al.  SPSS survival manual : a step by step guide to data analysis using SPSS for Windows , 2001, Behaviour Change.

[32]  Feng Deng,et al.  Understanding New Media Literacy: An Explorative Theoretical Framework , 2013, J. Educ. Technol. Soc..

[33]  Heinz Ulrich Hoppe,et al.  E-learning in School Education in the Coming 10 Years for Developing 21st Century Skills: Critical Research Issues and Policy Implications , 2014, J. Educ. Technol. Soc..

[34]  David D. Oberhelman.  Coming to terms with Web 2.0 , 2007 .

[35]  Tim O'Reilly,et al.  What is Web 2.0: Design Patterns and Business Models for the Next Generation of Software , 2007 .