Analytics to literacies: The development of a learning analytics framework for multiliteracies assessment

The rapid advances in information and communication technologies, coupled with increased access to information and the formation of global communities, have resulted in interest among researchers and academics to revise educational practice to move beyond traditional ‘literacy’ skills towards an enhanced set of “multiliteracies” or “new media literacies”. Measuring the literacy of a population, in the light of its linkage to individual and community wealth and wellbeing, is essential to determining the impact of compulsory education. The opportunity now is to develop tools to assess individual and societal attainment of these new literacies. Drawing on the work of Jenkins and colleagues (2006) and notions of a participatory culture, this paper proposes a conceptual framework for how learning analytics can assist in measuring individual achievement of multiliteracies and how this evaluative process can be scaled to provide an institutional perspective of the educational progress in fostering these fundamental skills.

[1]  Gregor Kennedy,et al.  Making Sense of Audit Trail Data. , 2004 .

[2]  Gregor E. Kennedy,et al.  Measurement and evidence of computer-based task switching and multitasking by 'Net Generation' students , 2011, Comput. Educ..

[3]  John Fritz,et al.  Classroom walls that talk: Using online course activity data of successful students to raise self-awareness of underperforming peers , 2011, Internet High. Educ..

[4]  Rebecca Ferguson,et al.  Social Learning Analytics , 2012, J. Educ. Technol. Soc..

[5]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[6]  Jim Dator,et al.  Universities Without “Quality” and Quality Without “Universities” , 2005, Jim Dator: A Noticer in Time.

[7]  Lori Lockyer,et al.  Multiliteracies and Assessment Practice , 2010 .

[8]  R. Burt.  Structural Holes and Good Ideas1 , 2004, American Journal of Sociology.

[9]  Philip Barker,et al.  Blogs, Wikipedia, Second Life, and beyond: From Production to Produsage , 2009 .

[10]  Vic Lally,et al.  Analysing student engagement with learning and tutoring activities in networked learning communities: a multi-method approach , 2006, Int. J. Web Based Communities.

[11]  J. Manyika.  Big data: The next frontier for innovation, competition, and productivity , 2011 .

[12]  Anna Gerber,et al.  Building Virtual Communities Learning And Change In Cyberspace , 2016 .

[13]  J. Brown,et al.  Minds on Fire: Open Education, the Long Tail, and Learning 2.0 , 2008 .

[14]  Shane Dawson,et al.  Informing Pedagogical Action , 2013 .

[15]  S. Michaels,et al.  A pedagogy of Multiliteracies Designing Social Futures , 1996 .

[16]  Mary Kalantzis,et al.  Assessing Multiliteracies and the New Basics , 2003 .

[17]  Maarten De Laat,et al.  Network and content analysis in an online community discourse , 2002, CSCL.

[18]  Allyson F. Hadwin,et al.  nStudy: Tracing and Supporting Self-Regulated Learning in the Internet , 2013 .

[19]  M. Anstey,et al.  Teaching and Learning Multiliteracies: Changing Times, Changing Literacies , 2006 .

[20]  George Siemens,et al.  Current state and future trends: a citation network analysis of the learning analytics field , 2014, LAK.

[21]  Elizabeth Bagley,et al.  Epistemic network analysis : a Prototype for 21 st Century assessment of Learning , 2009 .

[22]  Carlos Delgado Kloos,et al.  Stepping out of the box: towards analytics outside the learning management system , 2011, LAK.

[23]  Henry Jenkins.  Confronting the Challenges of Participatory Culture: Media Education for the 21st Century , 2006 .

[24]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[25]  Kimberly E. Arnold.  Signals: Applying Academic Analytics. , 2010 .

[26]  Louis C. Pugliese,et al.  Action Analytics: Measuring and Improving Performance that Matters in Higher Education. , 2008 .

[27]  D. Garrison.  Self-Directed Learning: Toward a Comprehensive Model , 1997 .

[28]  Shane Dawson,et al.  Pedagogical practice after the information age , 2008 .

[29]  M. Warschauer.  The paradoxical future of digital learning , 2007 .

[30]  D. Bradley,et al.  Review of Australian Higher Education: final report , 2008 .

[31]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[32]  Gautam Biswas,et al.  Measuring Self-Regulated Learning Skills through Social Interactions in a teachable Agent Environment , 2010, Res. Pract. Technol. Enhanc. Learn..

[33]  Iván Martínez-Ortiz,et al.  Educational game design for online education , 2008, Comput. Hum. Behav..

[34]  Dragan Gasevic,et al.  Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions , 2015, Internet High. Educ..

[35]  Peter Davies,et al.  Learning to Think: Thinking to Learn , 1991 .

[36]  Hendrik Huijser,et al.  Refocusing Multiliteracies for the Net Generation , 2006 .

[37]  Christine Greenhow,et al.  Old Communication, New Literacies: Social Network Sites as Social Learning Resources , 2009, J. Comput. Mediat. Commun..

[38]  Luigi Sarti,et al.  A general framework for tracking and analysing learning processes in computer‐supported collaborative learning environments , 2007 .

[39]  R. Edwards.  Changing Places?: Flexibility, Lifelong Learning and a Learning Society , 1997 .

[40]  Ioana Literat,et al.  Measuring New Media Literacies: Towards the Development of a Comprehensive Assessment Tool , 2014, Journal of Media Literacy Education.

[41]  Len Unsworth,et al.  Teaching Multiliteracies Across the Curriculum: Changing Contexts of Text and Image in Classroom Practice , 2001 .

[42]  Hélène Fournier,et al.  The value of learning analytics to networked learning on a personal learning environment , 2011, LAK.

[43]  Simon Buckingham Shum,et al.  Discourse-centric learning analytics , 2011, LAK.

[44]  Robert Balfanz,et al.  Building a Grad Nation: Progress and Challenge in Ending the High School Dropout Epidemic. Annual Update, 2012. , 2012 .

[45]  Julie Coiro,et al.  Handbook of Research on New Literacies , 2014 .

[46]  C. Haythornthwaite.  Building Virtual Communities: Building Social Networks Via Computer Networks: Creating and Sustaining Distributed Learning Communities , 2002 .

[47]  Gunther Kress,et al.  Literacy in the New Media Age , 2003 .

[48]  M. Peters,et al.  Transforming American Education: Learning Powered by Technology , 2011 .

[49]  Andrew Graham.  Developing Creativity in Higher Education : An imaginative curriculum, Norman Jackson, Martin Oliver, Malcolm Shaw and James Wisdom (eds.) : book review , 2006 .

[50]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[51]  S. Muspratt.  Constructing critical literacies: teaching and learning textual practice , 1997 .

[52]  Peter R. Monge,et al.  Network Theory | Multidimensional Networks and the Dynamics of Sociomateriality: Bringing Technology Inside the Network , 2011 .

[53]  Shane Dawson,et al.  A study of the relationship between student communication interaction and sense of community , 2006, Internet High. Educ..

[54]  James Paul Gee,et al.  Good Video Games + Good Learning: collected essays on video games, learning and literacy , 2013 .

[55]  Betsy Duke,et al.  Connectivism as a Learning Theory for the Digital Age , 2012 .

[56]  Shane Dawson,et al.  Numbers Are Not Enough. Why e-Learning Analytics Failed to Inform an Institutional Strategic Plan , 2012, J. Educ. Technol. Soc..

[57]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[58]  Carolyn Penstein Rosé,et al.  Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning , 2008, Int. J. Comput. Support. Collab. Learn..

[59]  Shane Dawson,et al.  Measuring creative potential: Using social network analysis to monitor a learners' creative capacity , 2011 .

[60]  B. Cope,et al.  “Multiliteracies”: New Literacies, New Learning , 2009 .

[61]  James Paul Gee,et al.  Reflections on Reading Cope and Kalantzis' “‘Multiliteracies’: New Literacies, New Learning” , 2009 .

[62]  John Watson,et al.  Using Online Learning for At-Risk Students and Credit Recovery. Promising Practices in Online Learning. , 2008 .

[63]  Martin Oliver,et al.  Developing Creativity in Higher Education: An Imaginative Curriculum , 2006 .

[64]  Shane Dawson,et al.  'Seeing' the learning community: An exploration of the development of a resource for monitoring online student networking , 2010, Br. J. Educ. Technol..

[65]  S. Coles.  Learning about Extremes , 1994 .

[66]  George Siemens,et al.  Learning Analytics , 2013 .

[67]  Colin Lankshear,et al.  A new literacies sampler , 2007 .

[68]  Judy Kalman,et al.  BEYOND DEFINITION: CENTRAL CONCEPTS FOR UNDERSTANDING LITERACY , 2008 .

[69]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[70]  Caroline Haythornthwaite,et al.  E-learning Theory and Practice , 2011 .

[71]  D. Boud.  Sustainable Assessment: Rethinking assessment for the learning society , 2000 .

[72]  E. Duval.  Attention please!: learning analytics for visualization and recommendation , 2011, LAK.

[73]  Alexandra Poulovassilis,et al.  Learning as immersive experiences: Using the four-dimensional framework for designing and evaluating immersive learning experiences in a virtual world , 2010, Br. J. Educ. Technol..

[74]  John P. Campbell,et al.  Academic Analytics: A New Tool for a New Era. , 2007 .

[75]  Norman Jackson,et al.  Imagining a different world , 2006 .