Evaluation of the interactivity of students in virtual learning environments using a multicriteria approach and data mining

This work seeks to provide a new multicriteria approach to evaluate and classify the level of interactivity of students in learning management systems (LMS). We describe, step by step, the complete methodological development process of the evaluation model as well as detailing the results obtained when applying it to a higher education teaching experience. This research demonstrates that the combined use of multicriteria decision methodologies and data mining prove to be particularly suitable for identifying behavioural patterns of the users through the analysis of records generated in LMS. The results reveal that the behavioural patterns in LMS offer certain indicators as to students’ academic performance, although the study does not permit to state that those students who adopt passive attitudes in these spheres may necessarily produce low academic performance.

[1]  Hema Banati,et al.  Incorporating social opinion in content selection for an e-learning course , 2011, 2011 6th International Conference on Computer Science & Education (ICCSE).

[2]  Sebastián Ventura,et al.  Data mining in education , 2013, WIREs Data Mining Knowl. Discov..

[3]  Jesus Boticario,et al.  Towards Improvements on Domain-independent Measurements for Collaborative Assessment , 2011, EDM.

[4]  Dirk H. R. Spennemann,et al.  Patterns of user behavior in University on-line forums , 2004 .

[5]  Charles Juwah,et al.  Interactivity in computer-mediated college and university education: A recent review of the literature , 2004, J. Educ. Technol. Soc..

[6]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[7]  Maria-Iuliana Dascalu,et al.  A Recommender Engine for Advanced Personalized Feedback in e-Learning Environments , 2012 .

[8]  Alessio Ishizaka,et al.  How to derive priorities in AHP: a comparative study , 2006, Central Eur. J. Oper. Res..

[9]  Michael Eagle,et al.  The EDM Vis Tool , 2011, EDM.

[10]  Gurmak Singh,et al.  Implementing eLearning Programmes for Higher Education: A Review of the Literature , 2004, J. Inf. Technol. Educ..

[11]  Shih-Yi Kuo,et al.  The Study for selecting the consignment performance of E-learning of technology college , 2011, 2011 International Conference on Multimedia Technology.

[12]  Qiong Liu,et al.  E-Learning Platform Evaluation Using Fuzzy AHP , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[13]  Eduardo Peñalosa Castro Evaluación de los aprendizajes y estudio de la interactividad en entornos en línea : un modelo para la investigación , 2012 .

[14]  Zane L. Berge,et al.  Design Guidelines for Web-Based Courses , 2000 .

[15]  Tammy Schellens,et al.  Collaborative learning in asynchronous discussion groups: What about the impact on cognitive processing? , 2005, Comput. Hum. Behav..

[16]  Autar Kaw,et al.  Predicting Academic Performance Using a Rough Set Theory-Based Knowledge Discovery Methodology , 2011 .

[17]  Á. G. D. Dujo,et al.  Interacción virtual y aprendizaje cooperativo: un estudio cualitativo , 2011 .

[18]  Helga Stokes,et al.  La interactividad en la educación a distancia : evaluación de comunidades de aprendizaje , 2012 .

[19]  Thomas L. Saaty,et al.  The analytic hierarchy process : planning, priority setting, resource allocation , 1980 .

[20]  Kumiko Aoki,et al.  The Use of ICT and e-Learning in Higher Education in Japan , 2010 .

[21]  D. Garrison,et al.  Blended learning: Uncovering its transformative potential in higher education , 2004, Internet High. Educ..

[22]  Gwo-Hshiung Tzeng,et al.  Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL , 2007, Expert Syst. Appl..

[23]  Marta E. Zorrilla,et al.  E-learning Web Miner: A Data Mining Application to Help Instructors Involved in Virtual Courses , 2011, EDM.

[24]  Hangjung Zo,et al.  Critical success factors for e-learning in developing countries: A comparative analysis between ICT experts and faculty , 2012, Comput. Educ..

[25]  Kenneth M. Zeichner Teacher Education and the Struggle for Social Justice , 2009 .

[26]  Gabriela Cenich A Learning Proposal Based on a Project and Collaborative Work : An Online Course Experience , 2011 .

[27]  Kayleigh Carabajal,et al.  Critical Analysis of Models and Methods Used To Evaluate Online Learning Networks. , 2001 .

[28]  Anil K. Jain,et al.  Knowledge-Based Clustering , 1996 .

[29]  Laurie P. Dringus,et al.  Using data mining as a strategy for assessing asynchronous discussion forums , 2005, Comput. Educ..

[30]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Beverly Abbey,et al.  网络教育 : 教学与认知发展新视角 = Instructional and Cognitive Impacts of Web -Based Education , 1999 .

[32]  Cristina Conati,et al.  A Framework for Capturing Distinguishing User Interaction Behaviors in Novel Interfaces , 2011, EDM.

[33]  Chris Marshall,et al.  Design guidelines , 1987 .

[34]  Stefanie Seiler,et al.  Finding Groups In Data , 2016 .

[35]  Terry Anderson,et al.  E-Learning in the 21st Century: A Community of Inquiry Framework for Research and Practice , 2016 .

[36]  Tammy Schellens,et al.  Roles as a structuring tool in online discussion groups: The differential impact of different roles on social knowledge construction , 2010, Comput. Hum. Behav..

[37]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[38]  Hong Feng Lai,et al.  Determining the sustainability of virtual learning communities in E-learning platform , 2010, 2010 5th International Conference on Computer Science & Education.

[39]  Zehra Akyol,et al.  E-Learning in the 21st Century: A Framework for Research and Practice, Second Edition, D.R. Garrison. Routledge/Taylor and Francis, London (2011) , 2011 .

[40]  Geraldine Clarebout,et al.  Content Management Systems: Enriched learning opportunities for all? , 2012, Comput. Hum. Behav..

[41]  Moez Limayem,et al.  Predicting the continued use of Internet-based learning technologies: the role of habit , 2011, Behav. Inf. Technol..

[42]  Stuart Palmer,et al.  Modelling Engineering Student Academic Performance Using Academic Analytics , 2013 .

[43]  Tammy Schellens,et al.  Learning in asynchronous discussion groups: a multilevel approach to study the influence of student, group and task characteristics , 2007, Behav. Inf. Technol..

[44]  Chih-Kai Chang,et al.  Statistical model for predicting roles and effects in learning community , 2011, Behav. Inf. Technol..

[45]  Jesus Boticario,et al.  Clustering learners according to their collaboration , 2009, 2009 13th International Conference on Computer Supported Cooperative Work in Design.

[46]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[47]  Elena Gaudioso,et al.  Mining Student Data To Characterize Similar Behavior Groups In Unstructured Collaboration Spaces , 2004 .

[48]  C. W. Blackwell,et al.  Cyberteaming: developing the online educational team , 2000, SIGDOC.

[49]  Judith B. Pena-Shaff,et al.  Analyzing student interactions and meaning construction in computer bulletin board discussions , 2004, Comput. Educ..