Impact of students evaluation of teaching: a text analysis of the teachers qualities by gender

Today, modern educational models are concerned with the development of the teacher-student experience and the potential opportunities it presents. User-centric analyses are useful both in terms of the socio-technical perspective on data usage within the educational domain and the positive impact that data-driven methods have. Moreover, the use of information and communication technologies (ICT) in education and process innovation has emerged due to the strategic perspectives and the process monitoring that have shown to be missing within the traditional education curricula. This study shows that there is an unprecedented increase in the amount of text-based data in different activities within the educational processes, which can be leveraged to provide useful strategic intelligence and improvement insights. Educators can apply the resultant methods and technologies, process innovations, and contextual-based information for ample support and monitoring of the teaching-learning processes and decision making. To this effect, this paper proposes an Educational Process and Data Mining (EPDM) model that leverages the perspectives or opinions of the students to provide useful information that can be used to enhance the end-to-end processes within the educational domain. Theoretically, this study applies the model to determine how the students evaluate their teachers by considering the gender of the teachers. We analyzed the underlying patterns and determined the emotional valence of the students based on their comments in the Students Evaluation of Teaching (SET). Thus, this work implements the proposed EPDM model using SET comments captured in a setting of higher education.

[1]  Sue Sentance,et al.  Classroom-Based Research Projects for Computing Teachers , 2018, ACM Trans. Comput. Educ..

[2]  Carolyn J. Anderson,et al.  How do Gender, Learning Goals, and Forum Participation Predict Persistence in a Computer Science MOOC? , 2018, ACM Trans. Comput. Educ..

[3]  Rosa M. Carro,et al.  Sentiment analysis in Facebook and its application to e-learning , 2014, Comput. Hum. Behav..

[4]  M. L. Caliusco,et al.  Supporting self-regulated learning and personalization using ePortfolios: a semantic approach based on learning paths , 2019, International Journal of Educational Technology in Higher Education.

[5]  Masood A. Badri,et al.  Identifying Potential Biasing Variables in Student Evaluation of Teaching in a Newly Accredited Business Program in the UAE. , 2006 .

[6]  Juan F. Silva,et al.  Competencia digital docente en estudiantes de último año de Pedagogía de Chile y Uruguay , 2019 .

[7]  Matt Lingard,et al.  Using Twitter in (higher) education , 2010 .

[8]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[9]  Kyle M. L. Jones Learning analytics and higher education: a proposed model for establishing informed consent mechanisms to promote student privacy and autonomy , 2019, International Journal of Educational Technology in Higher Education.

[10]  De,et al.  Teacher ’ s digital competence among final year Pedagogy students in Chile and Uruguay Competencia digital docente en estudiantes de último año , 2019 .

[11]  César Domínguez,et al.  Incorporating Computing Professionals’ Know-how , 2019, ACM Trans. Comput. Educ..

[12]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[13]  Fatima Islahi,et al.  Who Make Effective Teachers, Men or Women? An Indian Perspective. , 2013 .

[14]  Hae-Deok Song,et al.  The roles of academic engagement and digital readiness in students’ achievements in university e-learning environments , 2019, International Journal of Educational Technology in Higher Education.

[15]  DIFFERENCES BETWEEN MALE AND FEMALE SECONDARY SCHOOL STUDENTS IN ASSESSING THEIR PHYSICAL AND HEALTH EDUCATION TEACHERS’ COMPETENCES , 2018 .

[16]  Carolyn Penstein Rosé,et al.  Sentiment Analysis in MOOC Discussion Forums: What does it tell us? , 2014, EDM.

[17]  Sheela Pandey,et al.  Applying Natural Language Processing Capabilities in Computerized Textual Analysis to Measure Organizational Culture , 2017 .

[18]  Jill Denner,et al.  Does Computer Game Design and Programming Benefit Children? A Meta-Synthesis of Research , 2019, ACM Trans. Comput. Educ..

[19]  Hongfei Lin,et al.  Opinion Mining in e-Learning System , 2007, 2007 IFIP International Conference on Network and Parallel Computing Workshops (NPC 2007).

[20]  Abby L. Ferber,et al.  The Impact of Gender on the Evaluation of Teaching: What We Know and What We Can Do , 2007 .

[21]  Victoria Marín-Juarros,et al.  Uso de Twitter en Educación Superior en España y Estados Unidos , 2017 .

[22]  M. Usart,et al.  Teacher’s digital competence among final year Pedagogy students in Chile and Uruguay , 2019, Comunicar.

[23]  J WestonTimothy,et al.  Predicting Women's Persistence in Computer Science- and Technology-Related Majors from High School to College , 2019 .

[24]  Lauren A. Rivera,et al.  Scaling Down Inequality: Rating Scales, Gender Bias, and the Architecture of Evaluation , 2019, American Sociological Review.

[25]  Paul Prinsloo,et al.  Fleeing from Frankenstein’s monster and meeting Kafka on the way: Algorithmic decision-making in higher education , 2017 .

[26]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[27]  Roy Williams,et al.  The ideals and reality of participating in a MOOC , 2010 .

[28]  Anne Boring,et al.  Gender biases in student evaluations of teaching , 2017 .

[29]  M.J. Gallego-Arrufat,et al.  Competencia de futuros docentes en el área de seguridad digital , 2019 .

[30]  S. Bianchini,et al.  Instructor characteristics and students’ evaluation of teaching effectiveness: evidence from an Italian engineering school , 2013 .

[31]  P. Stark,et al.  Student Evaluations of Teaching (Mostly) Do Not Measure Teaching Effectiveness , 2016 .

[32]  Erkki Sutinen,et al.  Exploiting sentiment analysis to track emotions in students' learning diaries , 2013, Koli Calling '13.

[33]  William G. Griswold,et al.  A Robust Machine Learning Technique to Predict Low-performing Students , 2019, ACM Trans. Comput. Educ..

[34]  Friederike Mengel,et al.  Gender Bias in Teaching Evaluations , 2017, SSRN Electronic Journal.

[35]  Qinghua Zheng,et al.  Mining patterns of e-Learner emotion communication in turn level of Chinese interactive texts: Experiments and findings , 2010, The 2010 14th International Conference on Computer Supported Cooperative Work in Design.

[36]  Ben Williamson The hidden architecture of higher education: building a big data infrastructure for the ‘smarter university’ , 2018, International Journal of Educational Technology in Higher Education.

[37]  B. Gardner,et al.  Staff and student views of lecture capture: a qualitative study , 2019, International Journal of Educational Technology in Higher Education.

[38]  Adrian. Payne,et al.  Handbook of CRM : archieving excellence in customer management , 2006 .

[39]  Maribel Yasmina Santos,et al.  Business intelligence in higher education: Enhancing the teaching-learning process with a SRM system , 2010, 5th Iberian Conference on Information Systems and Technologies.

[40]  Ben Daniel,et al.  Big Data and analytics in higher education: Opportunities and challenges , 2015, Br. J. Educ. Technol..

[41]  L. F. Jameson Boex,et al.  Attributes of Effective Economics Instructors: An Analysis of Student Evaluations , 2000 .

[42]  Maria Virvou,et al.  Sentiment analysis of Facebook statuses using Naive Bayes classifier for language learning , 2013, IISA 2013.

[43]  Colin M. Gray,et al.  Conceptions of design by transdisciplinary educators: disciplinary background and pedagogical engagement , 2019, International Journal of Technology and Design Education.

[44]  Nabeela Altrabsheh,et al.  Sentiment analysis on students' real-time feedback , 2016 .

[45]  Zied Kechaou,et al.  Improving e-learning with sentiment analysis of users' opinions , 2011, 2011 IEEE Global Engineering Education Conference (EDUCON).

[46]  Takehisa Kumakawa A Text Mining Examination of University Students’ Learning Program Posters , 2017 .

[47]  Diane J. Litman,et al.  Predicting Student Emotions in Computer-Human Tutoring Dialogues , 2004, ACL.

[48]  E. Barra,et al.  Effectiveness of MOOCs for teachers in safe ICT use training , 2019, Comunicar.

[49]  P. Prinsloo,et al.  Learning Analytics , 2013 .

[50]  Jim Moshinskie,et al.  How To Keep E-Learners from E-Scaping , 2001 .

[51]  Axel Rivas,et al.  Artificial intelligence in education : challenges and opportunities for sustainable development , 2019 .

[52]  A. Aelterman,et al.  Gender in teaching: a literature review , 2007 .

[53]  George Siemens,et al.  Learning Analytics and Educational Data Mining , 2016 .

[54]  Kin-Nam Lau,et al.  Text Mining for the Hotel Industry , 2005 .

[55]  Lubna Mahmoud Abu Zohair Prediction of Student’s performance by modelling small dataset size , 2019, International Journal of Educational Technology in Higher Education.

[56]  Bård Ketil Engen Understanding social and cultural aspects of teachers’ digital competencies , 2019, Comunicar.

[57]  C. Dine,et al.  Assessment of Gender-Based Linguistic Differences in Physician Trainee Evaluations of Medical Faculty Using Automated Text Mining , 2019, JAMA network open.

[58]  Zhenming Liu,et al.  Learning about Social Learning in MOOCs: From Statistical Analysis to Generative Model , 2013, IEEE Transactions on Learning Technologies.

[59]  Bård Ketil Engen Comprendiendo los aspectos culturales y sociales de las competencias digitales docentes , 2019 .

[60]  Rosalind W. Picard,et al.  An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[61]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[62]  Tomoya Kurokawa,et al.  A Multi-Modal Emotion-Diagnosis System to Support e-Learning , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[63]  Erika R. Gilmore,et al.  Interpersonal Skills Training: Online versus Instructor-Led Courses , 2001 .

[64]  Minjuan Wang,et al.  Affective e-Learning: Using "Emotional" Data to Improve Learning in Pervasive Learning Environment , 2009, J. Educ. Technol. Soc..

[65]  Aldo Gordillo,et al.  Efectividad de los MOOC para docentes en el uso seguro de las TIC , 2019 .

[66]  Alaa El-Halees,et al.  Mining Opinions in User-Generated Contents to Improve Course Evaluation , 2011, ICSECS.

[67]  Victoria Marín-Juarros,et al.  Using Twitter in Higher Education in Spain and the USA. , 2017 .

[68]  Secil Caskurlu,et al.  Comparing Computing Professionals’ Perceptions of Importance of Skills and Knowledge on the Job and Coverage in Undergraduate Experiences , 2018, ACM Trans. Comput. Educ..

[69]  Haji Binali,et al.  A new significant area: Emotion detection in E-learning using opinion mining techniques , 2009, 2009 3rd IEEE International Conference on Digital Ecosystems and Technologies.

[70]  Hanni Muukkonen,et al.  Learning Analytics in Education: Literature Review and Case Examples From Vocational Education , 2019, Scandinavian Journal of Educational Research.

[71]  Ben Williamson,et al.  The social life of Learning Analytics: cluster analysis and the ‘performance’ of algorithmic education , 2018 .

[72]  M.J. Gallego-Arrufat,et al.  Competence of future teachers in the digital security area , 2019, Comunicar.

[73]  M. Munro The complicity of digital technologies in the marketisation of UK higher education: exploring the implications of a critical discourse analysis of thirteen national digital teaching and learning strategies , 2018, International Journal of Educational Technology in Higher Education.

[74]  Margus Pedaste,et al.  The Academic, Social, and Professional Integration Profiles of Information Technology Students , 2018, ACM Trans. Comput. Educ..

[75]  Aman Yadav,et al.  Equitable Learning Environments in K-12 Computing , 2019, ACM Trans. Comput. Educ..

[76]  Chang Zhu,et al.  MOOC-based flipped learning in higher education: students’ participation, experience and learning performance , 2019, International Journal of Educational Technology in Higher Education.

[77]  Timothy J. Weston,et al.  Predicting Women's Persistence in Computer Science- and Technology-Related Majors from High School to College , 2019, ACM Trans. Comput. Educ..

[78]  H. Takemura,et al.  Evaluating a blended course for Japanese learners of English: why Quality Matters , 2019, International Journal of Educational Technology in Higher Education.

[79]  Arto Hellas,et al.  Transfer-Learning Methods in Programming Course Outcome Prediction , 2018, ACM Trans. Comput. Educ..