LAOps: Learning Analytics with Privacy-aware MLOps

: The intake of computer science faculty has rapidly increased with simultaneous reductions to course personnel. Presently, the economy is recovering slightly, and students are entering the working life already during their studies. These reasons have fortified demands for flexibility to keep the target graduation time the same as before, even shorten it. Required flexibility is created by increasing distance learning and MOOCs, which challenges students’ self-regulation skills. Teaching methods and systems need to evolve to support students’ progress. At the curriculum design level, such learning analytics tools have already been taken into use. This position paper outlines a next-generation, course-scope analytics tool that utilises data from both the learning management system and Gitlab, which works here as a channel of student submissions. Gitlab provides GitOps, and GitOps will be enhanced with machine learning, thereby transforming as MLOps. MLOps that performs learning analytics, is called here LAOps. For analysis, data is copied to the cloud, and for that, it must be properly protected, after which models are trained and analyses performed. The results are provided to both teachers and students and utilised for personalisation and differentiation of exercises based on students’ skill level.

[1]  Daryl J. D'Souza,et al.  Formative assessment tasks as indicators of student engagement for predicting at-risk students in programming courses , 2021, Informatics Educ..

[2]  Tommi Mikkonen,et al.  MLOps Challenges in Multi-Organization Setup: Experiences from Two Real-World Cases , 2021, 2021 IEEE/ACM 1st Workshop on AI Engineering - Software Engineering for AI (WAIN).

[3]  Tommi Mikkonen,et al.  Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help? , 2021, 2021 IEEE/ACM 1st Workshop on AI Engineering - Software Engineering for AI (WAIN).

[4]  Ronald Jabangwe,et al.  Test Automation with Grad-CAM Heatmaps - A Future Pipe Segment in MLOps for Vision AI? , 2021, 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[5]  Sergey A. Sosnovsky,et al.  Knowledge models from PDF textbooks , 2021, New Rev. Hypermedia Multim..

[6]  Nezihe Merve Gurel,et al.  A Data Quality-Driven View of MLOps , 2021, IEEE Data Eng. Bull..

[7]  J. Okkonen,et al.  AI Driven Competency Development at the Threshold of Working Life , 2021 .

[8]  Ville Tirronen,et al.  Incorporating teacher-student dialogue into digital course material: Usage patterns and first experiences , 2020, 2020 IEEE Frontiers in Education Conference (FIE).

[9]  D. Tamburri Sustainable MLOps: Trends and Challenges , 2020, 2020 22nd International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC).

[10]  Peter Brusilovsky,et al.  Automatic Concept Extraction for Domain and Student Modeling in Adaptive Textbooks , 2020, International Journal of Artificial Intelligence in Education.

[11]  J. Okkonen,et al.  Ethical Considerations on Using Learning Analytics in Finnish Higher Education , 2020, AHFE.

[12]  Grigori Fursin,et al.  The Collective Knowledge project: making ML models more portable and reproducible with open APIs, reusable best practices and MLOps , 2020, ArXiv.

[13]  Lauri Malmi,et al.  Improving Engagement in Program Construction Examples for Learning Python Programming , 2020, International Journal of Artificial Intelligence in Education.

[14]  Jussi Okkonen,et al.  Expectation Differences Between Students and Staff of Using Learning Analytics in Finnish Universities , 2020, ICITS.

[15]  Yifan Wang,et al.  Challenges and Experiences with MLOps for Performance Diagnostics in Hybrid-Cloud Enterprise Software Deployments , 2020, OpML.

[16]  Nabile M. Safdar,et al.  Ethical considerations in artificial intelligence. , 2019, European journal of radiology.

[17]  Ville Isomöttönen,et al.  Less is More! Preliminary Evaluation of Multi-Functional Document-Based Online Learning Environment , 2019, 2019 IEEE Frontiers in Education Conference (FIE).

[18]  Heikki Hyyrö,et al.  Migrating Learning Management Systems Towards Microservice Architecture , 2019 .

[19]  Antonis Michalas,et al.  The lord of the shares: combining attribute-based encryption and searchable encryption for flexible data sharing , 2019, IACR Cryptol. ePrint Arch..

[20]  Lauri Malmi,et al.  An integrated practice system for learning programming in Python: design and evaluation , 2018, Research and Practice in Technology Enhanced Learning.

[21]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[22]  Erkki Kaila,et al.  Designing and creating a framework for learning analytics in Finland , 2018, 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[23]  Teemu Sirkiä,et al.  Jsvee & Kelmu: Creating and Tailoring Program Animations for Computing Education , 2016, 2016 IEEE Working Conference on Software Visualization (VISSOFT).

[24]  Angelo De Caro,et al.  Simple Functional Encryption Schemes for Inner Products , 2015, IACR Cryptol. ePrint Arch..

[25]  Judy Kay,et al.  Open Learner Models as Drivers for Metacognitive Processes , 2013 .

[26]  Tapio Salakoski,et al.  VILLE: a language-independent program visualization tool , 2007 .

[27]  Robert McCartney,et al.  Threshold concepts in computer science: do they exist and are they useful? , 2007, SIGCSE.