Capturing the sociomateriality of digital literacy events

This paper discusses a method of collecting and analysing multimodal data during classroom-based digital literacy research. Drawing on reflections from two studies, the authors discuss theoretical and methodological implications encountered in the collection, transcription and presentation of such data. Following an ethnomethodological framework that co-develops theory and methodology, the studies capture digital literacy activities as real-time screen recordings, with embedded video recordings of participants’ movements and vocalisations around the tasks during writing. The result is a multimodal rendition of digital literacy events on- and off-screen, allowing linguistic and multimodal transcriptions to capture the complexity of the data in a format amenable to analysis. Acquiring such data allowed for the development of detailed analyses of digital literacy events in the classroom, including interaction that would otherwise have escaped standard ethnography and video analysis, through sensibilities that approach social and material items without  a priori  hierarchies. This leads us to a ‘performative’ notion of digital literacies and an analytic methodology that is useful for researchers paying greater attention to the sociomaterial assemblages in which digital literacy events unfold. Keywords:  digital literacies; multimodality; video analysis; screen capture; literacy studies; actor-network theory (Published: 31 January 2014) Citation : Research in Learning Technology 2014,  21:  21281 - http://dx.doi.org/10.3402/rlt.v21.21281

[1]  J. Tambling.  How We Became Posthuman: Virtual Bodies in Cybernetics, Literature and Informatics by N. Katherine Hayles (review) , 2001, Modern Language Review.

[2]  J. Gee.  Social Linguistics And Literacies: Ideology in Discourse , 1996 .

[3]  M. Baynham,et al.  The future of literacy studies , 2009 .

[4]  C. Heath,et al.  Technology in Action: ‘Interaction’ with computers in architecture , 2000 .

[5]  D. Bawden.  Origins and Concepts of Digital Literacy , 2008 .

[6]  B. Street.  Literacy in Theory and Practice , 1984 .

[7]  Florian Nadel,et al.  Workplace Studies Recovering Work Practice And Informing System Design , 2016 .

[8]  James Paul Gee,et al.  Women and Gaming: The Sims and 21st Century Learning , 2010 .

[9]  S. Heath,et al.  Ways with Words: Language, Life and Work in Communities and Classrooms , 1983 .

[10]  C. Jewitt.  Multimodality and Literacy in School Classrooms , 2008 .

[11]  Kristina A. Gutierrez.  Women and Gaming: The Sims and 21st Century Learning , 2011 .

[12]  H. Knoblauch.  Introduction to the special issue of Qualitative Research: video-analysis and videography , 2012 .

[13]  Christian Heath,et al.  Some ‘technical challenges’ of video analysis: social actions, objects, material realities and the problems of perspective , 2012 .

[14]  D. Westgate,et al.  Investigating classroom talk , 1987 .

[15]  B. Asher.  The Professional Vision , 1994 .

[16]  Jon Hindmarsh,et al.  Workplace Studies: Exploring the workplace , 2000 .

[17]  Karen Barad.  Posthumanist Performativity: Toward an Understanding of How Matter Comes to Matter , 2003, Signs: Journal of Women in Culture and Society.

[18]  Klaudia Frankfurter,et al.  Picture Theory: Essays on Verbal and Visual Representation , 1994 .

[19]  Hayes.  identifying the organization of wi iiing processes , 1980 .

[20]  Colin Lankshear,et al.  Introduction: digital literacies: concepts, policies and practices , 2008 .

[21]  C. Jewitt,et al.  The Handbook of Visual Analysis , 2000 .

[22]  Deborah A. Fields,et al.  A connective ethnography of peer knowledge sharing and diffusion in a tween virtual world , 2009, Int. J. Comput. Support. Collab. Learn..

[23]  J. Hindmarch.  Video in Qualitative Research: Analysing Social Interaction in Everyday Life , 2012, QMiP Bulletin.

[24]  P. Gilster.  Digital Literacy , 1997, Encyclopedia of Education and Information Technologies.

[25]  Shirley Brice Heath,et al.  What no bedtime story means: Narrative skills at home and school , 1982, Language in Society.

[26]  E. Srensen.  The Materiality of Learning: Technology and Knowledge in Educational Practice , 2009 .

[27]  Michel Callon,et al.  Actor Network Theory , 2001 .

[28]  Nigel Thrift,et al.  Patterned Ground: Entanglements of Nature and Culture , 2004 .

[29]  Sergio Pasquandrea.  Managing multiple actions through multimodality: Doctors' involvement in interpreter-mediated interactions , 2011, Language in Society.

[30]  W. Orlikowski.  Sociomaterial Practices: Exploring Technology at Work , 2007 .

[31]  Mary Bucholtz.  From Stance to Style: Gender, Interaction, and Indexicality in Mexican Immigrant Youth Slang , 2009 .

[32]  P. Garcez,et al.  Práticas de pesquisa microetnográfica: geração, segmentação e transcrição de dados audiovisuais como procedimentos analíticos plenos , 2014 .

[33]  James C. Gee.  The New Literacy Studies , 2015 .

[34]  Literacy, Emotion, and Authority: Reading and Writing on a Polynesian Atoll , 1995 .

[35]  George Psathas,et al.  Conversation Analysis: The Study of Talk-in-Interaction , 1994 .

[36]  Steve Benford,et al.  Object-focused interaction in collaborative virtual environments , 2000, TCHI.

[37]  J. Gee.  Social Linguistics and Literacies : Ideology in Discourses , 2008 .

[38]  J. Stigler,et al.  Integrating qualitative and quantitative approaches to the analysis of video data on classroom teaching , 1999 .

[39]  C. J. Bigum,et al.  A Video Monitoring Technique for Investigating Computer-Based Learning Programs. , 1985 .

[40]  D. Mavers,et al.  Multimodal transcription as academic practice: a social semiotic perspective , 2011 .

[41]  David K. Woods,et al.  Tales From the Bleeding Edge: The Qualitative Analysis of Complex Video Data Using Transana , 2011 .

[42]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[43]  A. Mol.  The Body Multiple: Ontology in Medical Practice , 2003 .

[44]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[45]  A. Paton.  WAYS WITH WORDS , 1995 .

[46]  W. Orlikowski.  The sociomateriality of organisational life: considering technology in management research , 2010 .

[47]  C. Jewitt.  The Routledge handbook of multimodal analysis , 2014 .

[48]  M. Baynham,et al.  Introduction: the Future of Literacy Studies , 2009 .

[49]  E. Hutchins.  Cognition in the wild , 1995 .

[50]  Peter H. Sawchuk,et al.  Emerging Approaches to Educational Research: Tracing the Socio-Material , 2011 .

[51]  Roz Ivanic,et al.  Situated literacies : reading and writing in context , 2000 .

[52]  M. McLarty,et al.  Using video technology in emancipatory research , 2000 .

[53]  B. Street.  Literacy and Development: Ethnographic Perspectives , 2001 .

[54]  B. Latour.  Reassembling the Social: An Introduction to Actor-Network-Theory , 2005 .

[55]  L. Gregg,et al.  Identifying the Organization of Writing Processes , 2016 .

[56]  Jon Hindmarsh,et al.  Video in Qualitative Research: Analysing Social Interaction in Everyday Life , 2010 .

[57]  Felicitas Macgilchrist,et al.  Framing the news: an ethnographic view of business newswriting , 2010 .

[58]  A. Nicholls.  The social life of the computer in Ramingining , 2009 .

[59]  Joanne Meredith,et al.  Repair: Comparing Facebook ‘chat’ with spoken interaction , 2014 .

[60]  B. Street,et al.  Literacy and development , 1970 .

[61]  B. Latour.  Science in action : how to follow scientists and engineers through society , 1989 .

[62]  Kevin M. Leander,et al.  Toward a Connective Ethnography of Online/Offline Literacy Networks , 2008 .

[63]  M. Cole,et al.  The psychology of literacy , 1983 .

[64]  Julia Gillen.  Digital Literacies , 2014 .

[65]  Idit Harel Caperton.  Toward a Theory of Game-Media Literacy: Playing and Building as Reading and Writing , 2010, Int. J. Gaming Comput. Mediat. Simulations.

[66]  Eva Lindgren,et al.  The Psycholinguistic Dimension in Second Language Writing: Opportunities for Research and Pedagogy Using Computer Keystroke Logging , 2008 .

[67]  C. Heath,et al.  Body movement and speech in medical interaction: Postscript: the use of medical records and computers during the consultation , 1986 .

[68]  Paul A. Cairns,et al.  Adaptive Interactive Narrative Model to Teach Ethics , 2010, Int. J. Gaming Comput. Mediat. Simulations.

[69]  Mary Bucholtz.  From Stance to Style , 2009 .

[70]  Katherine A. Clinton,et al.  Limits of the Local: Expanding Perspectives on Literacy as a Social Practice , 2002 .

[71]  Marcus Sanchez Svensson,et al.  Configuring Awareness , 2002, Computer Supported Cooperative Work (CSCW).

[72]  Gunther Kress,et al.  Literacy in the New Media Age , 2003 .

[73]  Arnulf Deppermann.  Multimodal interaction from a conversation analytic perspective , 2013 .

[74]  Julia Gillen,et al.  Digital literacies:Research briefing for the TLRP-TEL (Teaching and Learning Research Programme - Technology Enhanced Learning) , 2010 .

[75]  R. Edwards,et al.  Actor-Network Theory in Education , 2010 .

[76]  Tom Van Hout,et al.  Writing from news sources: The case of Apple TV , 2011 .

[77]  J. Law.  After Method: Mess in Social Science Research , 2004 .

[78]  A. Bruni,et al.  Reassembling the Social—An Introduction to Actor Network Theory , 2007 .

[79]  J. Lemke.  Discursive Technologies and the Social Organization of Meaning , 2001 .

[80]  R. Shoaps,et al.  From Stance to Style: Gender, Interaction, and Indexicality in Mexican Immigrant Youth Slang , 2009 .

[81]  Wiebe E. Bijker,et al.  Science in action : how to follow scientists and engineers through society , 1989 .

[82]  Ann Lewins,et al.  Using Software in Qualitative Research: A Step-by-Step Guide , 2007 .

[83]  C. Heath,et al.  How do desk-top computers affect the doctor-patient interaction? , 1995, Family practice.

[84]  Ibrar Bhatt,et al.  Digital literacy practices and their layered multiplicity , 2012 .

[85]  S. Heath.  Ways with Words: Language, Life and Work in Communities and Classrooms , 1983 .

[86]  Jon Hindmarsh,et al.  Workplace Studies: List of contributors , 2000 .

[87]  M. Callon.  The Sociology of an Actor-Network: The Case of the Electric Vehicle , 1986 .

[88]  Pedro M. Garcez.  Helping Philippe: Constructions of a Computer-Assisted Language Learning Environment , 1995 .

[89]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[90]  N. K. Hayles.  How We Think: Digital Media and Contemporary Technogenesis , 2012 .

[91]  Aditya Johri,et al.  The Socio-Materiality of Learning Practices and Implications for the Field of Learning Technology. , 2011 .

[92]  C. Goodwin,et al.  Practices of Seeing: Visual Analysis: An Ethnomethodological Approach , 2000 .

[93]  H. Garfinkel.  Studies in Ethnomethodology , 1968 .

[94]  B. Latour.  Pandora's Hope: Essays on the Reality of Science Studies , 1999 .

[95]  J. Law.  Actor-network theory and material semiotics , 2009 .

[96]  Allan Martin,et al.  DigEuLit: Concepts and Tools for Digital Literacy Development , 2006 .

[97]  C. Heath,et al.  Technology and social interaction: the emergence of 'workplace studies'. , 2000, The British journal of sociology.

[98]  Scott B. Waltz.  Nonhumans Unbound: Actor-Network Theory and the Reconsideration of "Things" in Educational Foundations , 2006 .

[99]  Marlene Asselin,et al.  New tools for new literacies research: an exploration of usability testing software , 2010 .