Measuring digital literacies: Junior high-school students' perceived competencies versus actual performance

Abstract The widespread belief is that youth, "digital natives", who live their entire lives in media-rich digital environments and are ubiquitously connected through social networks, naturally develop digital competencies. This study investigated digital literacies among 280 junior-high-school students with the aim of comparing participants' perceived digital literacy competencies and their actual performance in relevant digital tasks. The findings showed that only a few of participants' perceived skills were related to their actual performance. Generally, participants displayed high confidence in their digital literacies and significantly over-estimated their actual competencies. This gap was most evident in social-emotional skills, which were, on average, perceived by students as their strongest skills, while their actual level of performance was very low. Positive strong correlations were found between participants' self-reported evaluations of different digital skills, indicating their perception as a single factor, while actual performance tests revealed low-to medium-size correlations between different literacies. For educational decision-makers, the findings highlight the importance of designing training programs aimed to develop students' digital literacies, with a special emphasis on social-emotional competencies. Such training may enhance important competencies needed, reduce unfounded self-perceptions, and thus, develop efficient digital functioning in contemporary society.

[1]  Ina Blau,et al.  The ethical dissonance in digital and non-digital learning environments: Does technology promotes cheating among middle school students? , 2017, Comput. Hum. Behav..

[2]  Yoonhyuk Jung,et al.  The common sense of dependence on smartphone: A comparison between digital natives and digital immigrants , 2016, New Media Soc..

[3]  A. Turner.  Generation Z: Technology and Social Interest , 2015 .

[4]  J. Fraillon,et al.  Preparing for life in a digital age , 2014 .

[5]  Ina Blau.  Teachers for "Smart Classrooms": The Extent of Implementation of an Interactive Whiteboard- based Professional Development Program on Elementary Teachers' Instructional Practices , 2011 .

[6]  D. Garrison,et al.  Assessing Social Presence In Asynchronous Text-based Computer Conferencing , 1999 .

[7]  P. Kirschner,et al.  Do Learners Really Know Best? Urban Legends in Education , 2013 .

[8]  Rakefet Ackerman,et al.  Metacognitive regulation of text learning: on screen versus on paper. , 2011, Journal of experimental psychology. Applied.

[9]  Luci Pangrazio.  Reconceptualising critical digital literacy , 2016 .

[10]  Rakefet Ackerman,et al.  Overcoming screen inferiority in learning and calibration , 2014, Comput. Hum. Behav..

[11]  P. Gilster.  Digital Literacy , 1997, Encyclopedia of Education and Information Technologies.

[12]  Jeffrey Alan Greene,et al.  Measuring critical components of digital literacy and their relationships with learning , 2014, Comput. Educ..

[13]  Colin Lankshear,et al.  Digital Literacy and Digital Literacies: - Policy, Pedagogy and Research Considerations for Education , 2006 .

[14]  Jae Eun Lee,et al.  Perception and reality , 2003 .

[15]  A. V. Deursen.  Internet Skills: Vital assets in an information society , 2010 .

[16]  J. Pontious,et al.  Perception and reality. , 2007, The Journal of the Oklahoma State Medical Association.

[17]  Alexander Johannes Aloysius Maria van Deursen,et al.  Rethinking Internet skills: The contribution of gender, age, education, Internet experience, and hours online to medium- and content-related Internet skills , 2011 .

[18]  J. Pellegrino,et al.  Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century , 2013 .

[19]  Katrina A. Meyer,et al.  FACE-TO-FACE VERSUS THREADED DISCUSSIONS: THE ROLE OF TIME AND HIGHER-ORDER THINKING , 2019, Online Learning.

[20]  Yehuda Peled,et al.  Technological, pedagogical and content knowledge in one-to-one classroom: teachers developing “digital wisdom” , 2016, Interact. Learn. Environ..

[21]  Yoram Eshet-Alkalai,et al.  Digital Literacy: A Conceptual Framework for Survival Skills in the Digital era , 2004 .

[22]  Richard C. Overbaugh,et al.  The Effect of Student Choice of Online Discussion Format on Tiered Achievement and Student Satisfaction , 2007 .

[23]  Yoram Eshet-Alkalai,et al.  Does the medium affect the message? The effect of congruent versus incongruent display on critical reading , 2010 .

[24]  Don D. McMahon,et al.  Incorporating Functional Digital Literacy Skills as Part of the Curriculum for High School Students with Intellectual Disability. , 2015 .

[25]  Yair Amichai-Hamburger,et al.  Experiments in Digital Literacy , 2004, Cyberpsychology Behav. Soc. Netw..

[26]  Alexander Johannes Aloysius Maria van Deursen,et al.  MEASURING DIGITAL SKILLS Performance tests of operational, formal, information and strategic Internet skills among the Dutch population , 2008 .

[27]  L. Lebduska.  Emoji, Emoji, What for Art Thou? , 2014, Harlot: A Revealing Look at the Arts of Persuasion.

[28]  Yoram Eshet-Alkalai,et al.  Sourcing while reading divergent expert accounts: Pathways from views of knowing to written argumentation , 2015 .

[29]  Rebecca Eynon,et al.  Development and validation of the Internet Skills Scale (ISS) , 2016 .

[30]  M. Prensky.  H. Sapiens Digital: From Digital Immigrants and Digital Natives to Digital Wisdom , 2009 .

[31]  Medios sociales y autogestión del perfil digital: identidad y pedagogía con blogs en un máster , 2012 .

[32]  M Gui,et al.  How deep are different forms of digital skills divide among young people? Results from an extensive survey of 1000 northern-Italian high school students , 2009 .

[33]  Rakefet Ackerman,et al.  Understanding metacognitive inferiority on screen by exposing cues for depth of processing , 2017 .

[34]  Ina Blau,et al.  How Do Personality, Synchronous Media, and Discussion Topic Affect Participation? , 2012, J. Educ. Technol. Soc..

[35]  Francesco Avvisati.  Students, computers and learning : making the connection , 2015 .

[36]  Diana G. Oblinger,et al.  Educating the Net Generation , 2005 .

[37]  Christopher Essex,et al.  Synchronous and asynchronous communication tools in distance education , 2001 .

[38]  P. Alexander,et al.  Reading Into the Future: Competence for the 21st Century , 2012 .

[39]  D. Randy Garrison,et al.  Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education , 1999, Internet High. Educ..

[40]  E. Litt.  Knock, Knock. Who's There? The Imagined Audience , 2012 .

[41]  Yehuda Peled,et al.  Does 1:1 Computing in a Junior High-School Change the Pedagogical Perspectives of Teachers and Their Educational Discourse?. , 2015 .

[42]  Meg Murray,et al.  Unraveling the Digital Literacy Paradox: How Higher Education Fails at the Fourth Literacy , 2014 .

[43]  Ilse Mariën,et al.  Developing Digital Skills and Competences: A Quick-Scan Analysis of 13 Digital Literacy Models , 2017 .

[44]  Yoram Eshet,et al.  Changes Over Time in Digital Literacy , 2009, Cyberpsychology Behav. Soc. Netw..

[45]  R. Eynon,et al.  Distinct skill pathways to digital engagement , 2013 .

[46]  Harminder Singh,et al.  Understanding the effect of e-learning on individual performance: The role of digital literacy , 2015, Comput. Educ..

[47]  Genevieve Marie Johnson,et al.  Synchronous and Asynchronous Text-Based CMC in Educational Contexts: A Review of Recent Research , 2006 .

[48]  Wan Ng,et al.  Can we teach digital natives digital literacy? , 2012, Comput. Educ..

[49]  Ivan K. Ash,et al.  Source Evaluation, Comprehension, and Learning in Internet Science Inquiry Tasks , 2009 .

[50]  E. Hargittai.  Digital Na(t)ives? Variation in Internet Skills and Uses among Members of the “Net Generation”* , 2010 .

[51]  J. Fraillon,et al.  Preparing for Life in a Digital Age: The IEA International Computer and Information Literacy Study International Report , 2014 .

[52]  Ina Blau,et al.  How do medium naturalness, teaching-learning interactions and Students' personality traits affect participation in synchronous E-learning? , 2018, Internet High. Educ..

[53]  Yair Amichai-Hamburger,et al.  The impact of the Internet on the social lives of users: A representative sample from 13 countries , 2011, Comput. Hum. Behav..

[54]  Colin Lankshear,et al.  Digital literacy and participation in online social networking spaces , 2008 .

[55]  Avner Caspi,et al.  Social presence in online discussion groups: testing three conceptions and their relations to perceived learning , 2008 .

[56]  Zhi-Jin Zhong,et al.  From access to usage: The divide of self-reported digital skills among adolescents , 2011, Comput. Educ..

[57]  Rakefet Ackerman,et al.  Generalizing screen inferiority - does the medium, screen versus paper, affect performance even with brief tasks? , 2016 .

[58]  Social media and self-curatorship: Reflections on identity and pedagogy through blogging on a masters module , 2012 .

[59]  Eran Chajut,et al.  You Can Teach Old Dogs New Tricks : The Factors That Affect Changes over Time in Digital Literacy , 2010 .

[60]  Ina Blau,et al.  Pedagogical Perspectives and Practices Reflected in Metaphors of Learning and Digital Learning of ICT Leaders , 2018 .

[61]  C. Kinzer,et al.  New Literacies , 2018, Theoretical Models and Processes of Literacy.

[62]  A. Zohar,et al.  How does information technology shape thinking , 2006 .

[63]  M. Gui.  The digital skills of Internet-natives The role of ascriptive differences in the possession of different forms of digital literacy in a random sample of northern Italian high school students , 2010 .

[64]  Alexander van Deursen,et al.  Measuring Internet Skills , 2010, Int. J. Hum. Comput. Interact..

[65]  Anke Görzig,et al.  Primary School Children’s Internet Skills : A Report on Performance Tests of Operational, Formal, Information, and Strategic Internet Skills , 2014 .

[66]  Ina Blau,et al.  e-Leadership of school principals: Increasing school effectiveness by a school data management system , 2013, Br. J. Educ. Technol..

[67]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[68]  Julie Coiro,et al.  New Literacies: A Dual-Level Theory of the Changing Nature of Literacy, Instruction, and Assessment , 2017, Theoretical Models and Processes of Literacy.

[69]  Ruth V. Small,et al.  Digital literacy and informal learning environments: an introduction , 2013 .

[70]  Yoram Eshet-Alkalai,et al.  Cheating and Feeling Honest: Committing and Punishing Analog versus Digital Academic Dishonesty Behaviors in Higher Education , 2016 .

[71]  S. Barzilai,et al.  The role of epistemic perspectives in comprehension of multiple author viewpoints , 2015 .

[72]  J. Palfrey,et al.  Born digital: understanding the first generation of digital natives , 2009, Choice Reviews Online.

[73]  Antonio Fini,et al.  Are young generations in secondary school digitally competent? A study on Italian teenagers , 2012, Comput. Educ..

[74]  Hague,et al.  Digital literacy across the curriculum , 2011 .

[75]  Kirsti Ala-Mutka.  Mapping Digital Competence: Towards a Conceptual Understanding , 2011 .

[76]  Kate Goodwin,et al.  Give Them Something to Talk About: The Role of Dialogue in Mentoring Relationships. , 2013 .

[77]  Ronny Scherer,et al.  The role of ICT self-efficacy for students' ICT use and their achievement in a computer and information literacy test , 2016, Comput. Educ..

[78]  D. Randy Garrison,et al.  The first decade of the community of inquiry framework: A retrospective , 2010, Internet High. Educ..

[79]  M. Prensky.  Digital Natives, Digital Immigrants Part 1 , 2001 .

[80]  Ina Blau,et al.  Digital competences and long-term ICT integration in school culture: The perspective of elementary school leaders , 2016, Education and Information Technologies.

[81]  David Bawden,et al.  Information and digital literacies: a review of concepts , 2001, J. Documentation.

[82]  Ina Blau,et al.  Comparing online opportunities and risks among Israeli children and youth Hebrew and Arabic speakers , 2014, New Rev. Hypermedia Multim..

[83]  Gail Salaway,et al.  The ECAR Study of Undergraduate Students and Information Technology, 2008 , 2007 .

[84]  John Suler,et al.  Psychological Aspects of Cyberspace: Reflections on the Psychology and Social Science of Cyberspace , 2008 .

[85]  Ina Blau,et al.  Developing Digital Wisdom by Students and Teachers , 2016 .

[86]  Marco Gui,et al.  Digital skills of internet natives: Different forms of digital literacy in a random sample of northern Italian high school students , 2011, New Media Soc..

[87]  D. Bawden.  Origins and Concepts of Digital Literacy , 2008 .

[88]  Mark J. W. Lee,et al.  Mapping the digital terrain :New media and social software as catalysts for pedagogical change , 2008 .

[89]  Alexander Johannes Aloysius Maria van Deursen,et al.  Digital Skills: Unlocking the Information Society , 2014 .

[90]  Jean-François Rouet,et al.  The Skills of Document Use: From Text Comprehension to Web-Based Learning , 2006 .

[91]  Shannon D. Smith,et al.  The ECAR Study of Undergraduate Students and Information Technology, 2009—Key Findings , 2010 .

[92]  Файл загружен,et al.  Digital Competence in Practice : An Analysis of Frameworks , 2012 .

[93]  Michael Corry,et al.  Designs, Management Tactics, and Strategies in Asynchronous Learning Discussions , 2003 .

[94]  Yoram Eshet-Alkalai,et al.  Issues in Informing Science and Information Technology Thinking in the Digital Era: a Revised Model for Digital Literacy , 2022 .

[95]  K. Weiler,et al.  Discourse: studies in the cultural politics of education , 2008 .

[96]  Melissa R. Gross,et al.  What's skill got to do with it?: Information literacy skills and self-views of ability among first-year college students , 2012, J. Assoc. Inf. Sci. Technol..

[97]  Ina Blau,et al.  Application use, Online Relationship Types, Self-Disclosure, and Internet Abuse among Children and Youth: Implications for Education and Internet Safety Programs , 2011 .