Towards an educational data literacy framework: enhancing the profiles of instructional designers and e-tutors of online and blended courses with new competences

In the era of digitalization of learning and teaching processes, Educational Data Literacy (EDL) is highly valued and is becoming essential. EDL is conceptualized as the ability to collect, manage, analyse, comprehend, interpret, and act upon educational data in an ethical, meaningful, and critical manner. The professionals in the field of digitally supported education, i.e., Instructional Designers (IDs) and e-Tutors (eTUTs) of online and blended courses, need to be ready to inform their decisions with educational data, and face the upcoming data-related challenges; they need to update and enhance their profiles with relevant competences. This paper proposes a framework for EDL competence profiles of IDs/eTUTs and evaluates the proposal with the participation of worldwide professionals ( N  = 210) with experience in digitally supported education. The evaluation aims at validating the proposal and assesses (a) the current EDL-readiness of IDs/eTUTs; and (b) the extent to which the framework captures and describes the essential EDL competences. The findings indicate that professionals are not EDL-competent yet, but the proposed dimensions and related competences are offering a solid approach to support EDL development.

[1]  Milo Shields,et al.  Information Literacy, Statistical Literacy, Data Literacy , 2005 .

[2]  Stan Matwin,et al.  Strategies and Best Practices for Data Literacy Education: Knowledge Synthesis Report , 2015 .

[3]  R. Viner,et al.  School closure and management practices during coronavirus outbreaks including COVID-19: a rapid systematic review , 2020, The Lancet Child & Adolescent Health.

[4]  S. Demetriadis,et al.  Ethical issues in learning analytics: a review of the field , 2021, Educational Technology Research and Development.

[5]  Michail N. Giannakos,et al.  From childhood to maturity: Are we there yet? Mapping the intellectual progress in learning analytics during the past decade , 2020, LAK.

[6]  E. Mandinach,et al.  Using Student Achievement Data to Support Instructional Decision Making. IES Practice Guide. NCEE 2009-4067. , 2009 .

[7]  Solon Barocas,et al.  Ten simple rules for responsible big data research , 2017, PLoS Comput. Biol..

[8]  Gerd Kortuem,et al.  Creating an Understanding of Data Literacy for a Data-driven Society , 2016, J. Community Informatics.

[9]  J. Raffaghelli,et al.  Centering complexity in ‘educators’ data literacy’ to support future practices in faculty development: a systematic review of the literature , 2020, Teaching in Higher Education.

[10]  Jenny S. Wakefield,et al.  Traits, Skills, & Competencies Aligned with Workplace Demands: What Today's Instructional Designers Need to Master , 2012 .

[11]  Brian Gill,et al.  A Conceptual Framework for Data-Driven Decision Making , 2014 .

[12]  M.ª Teresa Sánchez-Compaña,et al.  Teacher Digital Literacy: The Indisputable Challenge after COVID-19 , 2021, Sustainability.

[13]  Omer Tene,et al.  Beyond IRBs: Ethical Guidelines for Data Research , 2016 .

[14]  H. Arksey,et al.  Scoping studies: towards a methodological framework , 2005 .

[15]  D. Sampson,et al.  Towards Modelling Teachers’ ICT Competence Profile in Europe , 2014 .

[16]  K. Schildkamp,et al.  Data literacy: What do educators learn and struggle with during a data use intervention? , 2018 .

[17]  Ellen B. Mandinach,et al.  What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions , 2016 .

[18]  Barbara Means,et al.  Teachers' Ability to Use Data to Inform Instruction: Challenges and Supports. , 2011 .

[19]  An Gie Yong,et al.  A Beginner's Guide to Factor Analysis: Focusing on Exploratory Factor Analysis , 2013 .

[20]  Todd D. Reeves,et al.  Effects of an asynchronous online data literacy intervention on pre-service and in-service educators' beliefs, self-efficacy, and practices , 2019, Comput. Educ..

[21]  Matthew J. Koehler,et al.  Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge , 2006, Teachers College Record: The Voice of Scholarship in Education.

[22]  Demetrios G. Sampson,et al.  Teaching and Learning Analytics to Support Teacher Inquiry: A Systematic Literature Review , 2017 .

[23]  Albert D. Ritzhaupt,et al.  A Job Announcement Analysis of Educational Technology Professional Positions , 2015 .

[24]  Richard O. Sinnott,et al.  Advancing the ethical use of digital data in human research: challenges and strategies to promote ethical practice , 2018, Ethics and Information Technology.

[25]  Diana Adler,et al.  Using Multivariate Statistics , 2016 .

[26]  Miguel-Ángel Marzal,et al.  Incorporating Data Literacy into Information Literacy Programs: Core Competencies and Contents , 2013 .

[27]  Barbara Wasson,et al.  Data Literacy and Use for Learning When Using Learning Analytics for Learners , 2016, LAL@LAK.

[28]  Alejandro Peña-Ayala,et al.  Learning Analytics: Fundaments, Applications, and Trends , 2017 .

[29]  Roger Clarke,et al.  Guidelines for the responsible application of data analytics , 2017, Comput. Law Secur. Rev..

[30]  C. Drew.  Design for data ethics: using service design approaches to operationalize ethical principles on four projects , 2018, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[31]  J. Crisp,et al.  The Delphi method? , 1997, Nursing research.

[32]  Julie A. Marsh,et al.  Interventions Promoting Educators’ Use of Data: Research Insights and Gaps , 2012, Teachers College Record: The Voice of Scholarship in Education.

[33]  Hamed Haddadi,et al.  Human-Data Interaction: The Human Face of the Data-Driven Society , 2014, ArXiv.

[34]  J. Henderson,et al.  Data literacy training and use for educational professionals , 2020 .

[35]  Monica W. Tracey,et al.  Exploring the relationship of ethics and privacy in learning analytics and design: implications for the field of educational technology , 2016 .

[36]  Ifeanyi G. Ndukwe,et al.  Teaching analytics, value and tools for teacher data literacy: a systematic and tripartite approach , 2020, International Journal of Educational Technology in Higher Education.

[37]  M. Cannarsa.  Ethics Guidelines for Trustworthy AI , 2021, The Cambridge Handbook of Lawyering in the Digital Age.

[38]  Demetrios G. Sampson,et al.  Competence Models in Technology-Enhanced Competence-Based Learning , 2008 .

[39]  W. Erdelen.  United Nations Educational, Scientific and Cultural Organization (UNESCO) , 2019, The Grants Register 2020.

[40]  Eva Dobozy,et al.  Informing Learning Design through Analytics: Applying Network Graph Analysis. , 2018 .