Teamwork assessment in the educational web of data: A learning analytics approach towards ISO 10018

Abstract The Web of Data is an emerging research field that contributes to make better decisions because it gathers, combines and analyses different data sources available worldwide. Educational data is an interesting domain because it deals with the quality of the education itself and educational institutions which are common goals for every country. This paper is devoted to present how this idea has been used to improve a learning analytics tool. By means of this tool, teachers can perform teamwork competence assessment of a group of students taking into account how the individuals acquire the essential components of such competence. In this sense, authors use the Comprehensive Training Model of the Teamwork Competence in Engineering Domain (CTMTC) method to gather competence evidences and improve the system with a learning analytics tool to support the process. This tool is able to transform competence evidences and stores them in a competence ontology built upon ISO 10018 concepts. The final result is the production of educational results for the web of data.

[1]  Ben Daniel,et al.  Big Data and analytics in higher education: Opportunities and challenges , 2015, Br. J. Educ. Technol..

[2]  Francisco J. García-Peñalvo,et al.  Exploring Student Interactions: Learning Analytics Tools for Student Tracking , 2015, HCI.

[3]  Francisco José García-Peñalvo,et al.  Students' knowledge sharing to improve learning in academic engineering courses , 2016 .

[4]  Kathryn A. Boys,et al.  Improving integration of human resources into quality management system standards , 2014 .

[5]  Pornpit Wongthongtham,et al.  Ontology based intercultural patient practitioner assistive communications from qualitative gap analysis , 2016, Inf. Technol. People.

[6]  Francisco J. García-Peñalvo,et al.  Competence gaps in software personnel: A multi-organizational study , 2013, Comput. Hum. Behav..

[7]  Alex Rayón,et al.  Supporting competency-assessment through a learning analytics approach using enriched rubrics , 2014, TEEM '14.

[8]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[9]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[10]  Fuensanta Medina-Dominguez,et al.  An agile framework definition for creating an engineering massive open online course from scratch: a case study , 2016 .

[11]  Francisco J. García-Peñalvo,et al.  A Knowledge Management System to Classify Social Educational Resources Within a Subject Using Teamwork Techniques , 2015, HCI.

[12]  Giner Alor-Hernández,et al.  BROSEMWEB: A brokerage service for e-Procurement using Semantic Web Technologies , 2014, Comput. Ind..

[13]  Carlos Delgado Kloos,et al.  GLASS: a learning analytics visualization tool , 2012, LAK '12.

[14]  Riccardo Mazza,et al.  GISMO: a Graphical Interactive Student Monitoring Tool for Course Management Systems , 2004 .

[15]  Francisco José García-Peñalvo,et al.  Una revisión actualizada del concepto de eLearning. Décimo Aniversario An updated review of the concept of eLearning. Tenth anniversary , 2015 .

[16]  Elizabeth Koh,et al.  A pedagogical framework for learning analytics in collaborative inquiry tasks: an example from a teamwork competency awareness program , 2016, LAK.

[17]  Chih-Hong Huang,et al.  Change discovery of learning performance in dynamic educational environments , 2016, Telematics Informatics.

[18]  Simone Braun,et al.  Semantic people tagging and ontology maturing: an enterprise social media approach to competence management , 2012, Int. J. Knowl. Learn..

[19]  Giner Alor-Hernández,et al.  Athena: A hybrid management system for multi‐device educational content , 2014, Comput. Appl. Eng. Educ..

[20]  Adam Marks,et al.  Learning Management Systems: A Shift Toward Learning and Academic Analytics , 2016, Int. J. Emerg. Technol. Learn..

[21]  Fatos Xhafa,et al.  A methodological approach for trustworthiness assessment and prediction in mobile online collaborative learning , 2016, Comput. Stand. Interfaces.

[22]  Giner Alor-Hernández,et al.  AthenaTV: an authoring tool of educational applications for TV using android-based interface design patterns , 2014, New Rev. Hypermedia Multim..

[23]  George Siemens,et al.  Learning Analytics , 2013 .

[24]  Vladimir Stantchev,et al.  Project Portfolio Management Systems: Business Services and Web Services , 2009, 2009 Fourth International Conference on Internet and Web Applications and Services.

[25]  Simon Buckingham Shum,et al.  Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics , 2012, International Conference on Learning Analytics and Knowledge.

[26]  Nelson Piedra,et al.  Consuming and producing linked open data: the case of OpenCourseWare , 2014, Program.

[27]  Marek Hatala,et al.  Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions , 2015, Internet High. Educ..

[28]  Chris Kimble,et al.  Competence management in knowledge intensive organizations using consensual knowledge and ontologies , 2016, Inf. Syst. Frontiers.

[29]  Vladimir Tarasov.  Ontology-based Approach to Competence Profile Management , 2012, J. Univers. Comput. Sci..

[30]  Sanjay Misra,et al.  Learning management systems and cloud file hosting services: A study on students' acceptance , 2014, Comput. Hum. Behav..

[31]  Javier Garcia,et al.  Measuring the influence of Cooperative Learning and Project Based Learning on problem solving skill , 2011 .

[32]  Jun Shen,et al.  Facilitating Social Collaboration in Mobile Cloud-Based Learning: A Teamwork as a Service (TaaS) Approach , 2014, IEEE Transactions on Learning Technologies.

[33]  Juan Manuel Dodero,et al.  Generative Instructional Engineering of Competence Development Programmes , 2007, J. Univers. Comput. Sci..

[34]  Almudena Sierra Alonso,et al.  Teamwork competence and academic motivation in computer science engineering studies , 2014, 2014 IEEE Global Engineering Education Conference (EDUCON).

[35]  Francisco J. García-Peñalvo,et al.  Evaluation of the CTMTC Methodology for Assessment of Teamwork Competence Development and Acquisition in Higher Education , 2016, HCI.

[36]  Francisco José García-Peñalvo,et al.  Monitoring indicators for CTMTC: Comprehensive Training Model of the Teamwork Competence in Engineering Domain , 2015 .

[37]  Daniela Giordano,et al.  Linked education: interlinking educational resources and the Web of data , 2012, SAC '12.

[38]  G. Seijts,et al.  The development of collective efficacy in teams: a multilevel and longitudinal perspective. , 2007, The Journal of applied psychology.

[39]  Francisco J. García-Peñalvo,et al.  Tap into visual analysis of customization of grouping of activities in eLearning , 2015, Comput. Hum. Behav..

[40]  A. Piscitelli.  El proyecto facebook y la posuniversidad: sistemas operativos sociales y entornos abiertos de aprendizaje , 2010 .

[41]  Nickolas J. G. Falkner,et al.  Using Learning Analytics to Visualise Computer Science Teamwork , 2015, ITiCSE.

[42]  Robert Meersman,et al.  Business semantics management: A case study for competency-centric HRM , 2010, Comput. Ind..

[43]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[44]  Miguel Ángel Conde González,et al.  Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning , 2014, Comput. Hum. Behav..

[45]  Maha Khemaja,et al.  Skill oriented Training Activity as a Service: An Approach based on the e-Competence Framework to overcome the Fast Changing IT Profession , 2014, Int. J. Hum. Cap. Inf. Technol. Prof..

[46]  Juan Ramón Pérez Pérez,et al.  The Procrastination Related Indicators in e-Learning Platforms , 2015, J. Univers. Comput. Sci..

[47]  Francisco J. García-Peñalvo,et al.  Informal learning recognition through a cloud ecosystem , 2014, Future Gener. Comput. Syst..

[48]  Francisco J. García-Peñalvo,et al.  Using Learning Analytics to improve teamwork assessment , 2015, Comput. Hum. Behav..

[49]  Miguel Ángel Conde González,et al.  Dealing with complexity: educational data and tools for learning analytics , 2014, TEEM '14.

[50]  António Trigo,et al.  I-Competere: Using applied intelligence in search of competency gaps in software project managers , 2012, Information Systems Frontiers.

[51]  Francisco J. García-Peñalvo,et al.  TRAILER Project (Tagging, Recognition, Acknowledgment of Informal Learning Experiences) A Methodology to Make Learners' Informal Learning Activities Visible to the Institutions , 2013, J. Univers. Comput. Sci..

[52]  Lilia Cheniti-Belcadhi,et al.  Semantic Models for Competence-Based Assessment , 2014, Int. J. Hum. Cap. Inf. Technol. Prof..

[53]  P. Sengottuvelan,et al.  A hybrid PSO with Naïve Bayes classifier for disengagement detection in online learning , 2016, Program.

[54]  Frank H. Selto,et al.  Research in managerial accounting: Learning from others' experiences , 1999 .

[55]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[56]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[57]  Fouad Zablith,et al.  Production and consumption of university Linked Data , 2015, Interact. Learn. Environ..

[58]  Ángel Francisco Agudo-Peregrina,et al.  Assessing the suitability of student interactions from Moodle data logs as predictors of cross-curricular competencies , 2015, Comput. Hum. Behav..

[59]  M. Rosenzweig,et al.  Learning by Doing and Learning from Others: Human Capital and Technical Change in Agriculture , 1995, Journal of Political Economy.

[60]  Francisco J. García-Peñalvo,et al.  Visual learning analytics techniques applied in software engineering subjects , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[61]  Patricia Ordóñez de Pablos,et al.  Publishing Statistical Data following the Linked Open Data Principles: The Web Index Project , 2013 .

[62]  Grégoire Pépiot,et al.  UECML: Unified Enterprise Competence Modelling Language , 2007, Comput. Ind..

[63]  Dolores Lerís,et al.  A comprehensive training model of the teamwork competence , 2014 .