Which Strategies are Used in the Design of Technical LA Infrastructure?: A Qualitative Interview Study

In order to obtain a holistic perspective on learning, technical infrastructure at an institutional level can be advantageous for Learning Analytics (LA). If personal data is collected and processed in such infrastructure, legal requirements are of crucial importance. Recent studies have examined various aspects of LA infrastructure, such as ethical trade-offs and stakeholder needs. However, strategies for designing technical LA infrastructure at the institutional level and strategies for dealing with data protection regulations have been lacking so far, although they are crucial for the adoption of LA in Europe. The purpose of this paper is to examine three research questions: (RQ1) which strategies are currently used to design LA infrastructure; (RQ2) how data protection and privacy affect the design of LA infrastructure; and (RQ3) how could technical measures support the adoption of LA. These research questions were investigated by conducting eleven interviews with LA infrastructure developers representing eight different higher education institutions and ten different infrastructures. According to RQ1, the paper first examines the domain specificity of LA infrastructure and the four design strategies used. The paper also examines, according to RQ2, the interviewees’ awareness of data protection, the conflict with users’ consent, and the data subject rights. Finally, the paper presents, in line with RQ3, the results of the strategies in dealing with trust, stakeholder expectations, and engagement. Researchers and infrastructure developers can use and adopt these findings to improve their strategies for developing technical LA infrastructure with regard to data protection, privacy, and trust.

[1]  H. Rangwala,et al.  Learning Analytics in Higher Education , 2021, Advances in Electronic Government, Digital Divide, and Regional Development.

[2]  Steven J. Taylor,et al.  Introduction to Qualitative Research Methods: A Guidebook and Resource , 2015 .

[3]  Candace Thille,et al.  The heart of educational data infrastructures = Conscious humanity and scientific responsibility, not infinite data and limitless experimentation , 2019, Br. J. Educ. Technol..

[4]  Stefaan Ternier,et al.  Adopting Trust in Learning Analytics Infrastructure: A Structured Literature Review , 2019, J. Univers. Comput. Sci..

[5]  Katrien Verbert,et al.  Small data as a conversation starter for learning analytics: Exam results dashboard for first-year students in higher education , 2017 .

[6]  Craig Gentry,et al.  Fully homomorphic encryption using ideal lattices , 2009, STOC '09.

[7]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[8]  Paul Prinsloo,et al.  Ethics and Learning Analytics: Charting the (Un)Charted , 2017 .

[9]  Edward Curry,et al.  The Big Data Value Chain: Definitions, Concepts, and Theoretical Approaches , 2016, New Horizons for a Data-Driven Economy.

[10]  Simon Knight,et al.  Practical ethics for building learning analytics , 2019, Br. J. Educ. Technol..

[11]  Dragan Gasevic,et al.  Learning analytics in higher education --- challenges and policies: a review of eight learning analytics policies , 2017, LAK.

[12]  Jennifer Cobbe,et al.  The Security Implications of Data Subject Rights , 2019, IEEE Security & Privacy.

[13]  Paul Prinsloo,et al.  Learning analytics at the intersections of student trust, disclosure and benefit , 2019, LAK.

[14]  Carolyn Penstein Rosé,et al.  Guest Editorial: Special Section on Learning Analytics , 2017, IEEE Trans. Learn. Technol..

[15]  Siani Pearson,et al.  Privacy, Security and Trust Issues Arising from Cloud Computing , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[16]  Rebecca Ferguson,et al.  Guest Editorial: Ethics and Privacy in Learning Analytics , 2016, J. Learn. Anal..

[17]  Hendrik Drachsler,et al.  From signals to knowledge: A conceptual model for multimodal learning analytics , 2018, J. Comput. Assist. Learn..

[18]  Dai Griffiths,et al.  The influence of data protection and privacy frameworks on the design of learning analytics systems , 2017, LAK.

[19]  Dragan Gasevic,et al.  Ethics and Privacy as Enablers of Learning Analytics , 2016 .

[20]  Haralambos Mouratidis,et al.  DEFeND Architecture: A Privacy by Design Platform for GDPR Compliance , 2019, TrustBus.

[21]  Weiqin Chen,et al.  Privacy and data protection in learning analytics should be motivated by an educational maxim—towards a proposal , 2018, Research and Practice in Technology Enhanced Learning.

[22]  Niall Sclater,et al.  Developing a Code of Practice for Learning Analytics , 2016, J. Learn. Anal..

[23]  Ben Kei Daniel,et al.  Big Data and Learning Analytics in Higher Education , 2017 .

[24]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[25]  Peng Liang,et al.  A systematic mapping study on technical debt and its management , 2015, J. Syst. Softw..