Deep Learning Adaptation with Word Embeddings for Sentiment Analysis on Online Course Reviews

Online educational platforms are enabling learners to consume a great variety of content and share opinions on their learning experience. The analysis of the sentiment behind such a collective intelligence represents a key element for supporting both instructors and learning institutions on shaping the offered educational experience. Combining Word Embedding representations and deep learning architectures has made possible to design sentiment analysis systems able to accurately measure the text polarity on several contexts. However, the application of such representations and architectures on educational data still appears limited. Therefore, considering the over-sensitiveness of the emerging models to the context where the training data is collected, conducting adaptation processes that target the e-learning context becomes crucial to unlock the full potential of a model. In this chapter, we describe a deep learning approach that, starting from Word Embedding representations, measures the sentiment polarity of textual reviews posted by learners after attending online courses. Then, we demonstrate how Word Embeddings trained on smaller e-learning-specific resources are more effective with respect to those trained on bigger general-purpose resources. Moreover, we show the benefits achieved by combining Word Embeddings representations with deep learning architectures instead of common machine learning models. We expect that this chapter will help stakeholders to get a clear view and shape the future research on this field.

[1]  Quan Pan,et al.  Learning Word Representations for Sentiment Analysis , 2017, Cognitive Computation.

[2]  Christopher Potts,et al.  Learning Word Vectors for Sentiment Analysis , 2011, ACL.

[3]  Harith Alani,et al.  Semantic Patterns for Sentiment Analysis of Twitter , 2014, SEMWEB.

[4]  Roberto Saia,et al.  Using neural word embeddings to model user behavior and detect user segments , 2016, Knowl. Based Syst..

[5]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[6]  Harald Sack,et al.  Semantic Web Challenges , 2016, Communications in Computer and Information Science.

[7]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[8]  Diego Reforgiato Recupero,et al.  COCO: Semantic-Enriched Collection of Online Courses at Scale with Experimental Use Cases , 2018, WorldCIST.

[9]  Yogesh Kumar Meena,et al.  Aspect-Based Sentiment Analysis of Students’ Feedback to Improve Teaching–Learning Process , 2018, Information and Communication Technology for Intelligent Systems.

[10]  Diego Reforgiato Recupero,et al.  Deep Learning and Sentiment Analysis for Human-Robot Interaction , 2018, ESWC.

[11]  Diego Reforgiato Recupero,et al.  Leveraging Cognitive Computing for Multi-class Classification of E-learning Videos , 2017, ESWC.

[12]  Carlos Alberto Ochoa Ortíz Zezzatti,et al.  A Sentiment Analysis Model to Analyze Students Reviews of Teacher Performance Using Support Vector Machines , 2017, DCAI.

[13]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[14]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[15]  Li Deng,et al.  A tutorial survey of architectures, algorithms, and applications for deep learning , 2014, APSIPA Transactions on Signal and Information Processing.

[16]  Seiji Isotani,et al.  Educational Data Mining: A review of evaluation process in the e-learning , 2018, Telematics Informatics.

[17]  Diego Reforgiato Recupero,et al.  Semantic Sentiment Analysis Challenge at ESWC2017 , 2017, SemWebEval@ESWC.

[18]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[19]  Santanu Kumar Rath,et al.  Classification of sentiment reviews using n-gram machine learning approach , 2016, Expert Syst. Appl..

[20]  J. Fernando Sánchez-Rada,et al.  Enhancing deep learning sentiment analysis with ensemble techniques in social applications , 2020 .

[21]  Mauro Dragoni,et al.  A Neural Word Embeddings Approach for Multi-Domain Sentiment Analysis , 2017, IEEE Transactions on Affective Computing.

[22]  Jeffrey Pennington,et al.  Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions , 2011, EMNLP.

[23]  Ming Zhou,et al.  Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification , 2014, ACL.

[24]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[25]  Erik Cambria,et al.  Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis , 2015, EMNLP.

[26]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[27]  Diego Reforgiato Recupero,et al.  Bridging learning analytics and Cognitive Computing for Big Data classification in micro-learning video collections , 2019, Comput. Hum. Behav..

[28]  Matthijs Douze,et al.  FastText.zip: Compressing text classification models , 2016, ArXiv.

[29]  Chris Dyer,et al.  Unsupervised POS Induction with Word Embeddings , 2015, NAACL.

[30]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[31]  Diego Reforgiato Recupero,et al.  Leveraging semantics for sentiment polarity detection in social media , 2019, Int. J. Mach. Learn. Cybern..

[32]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[33]  Patrick Pantel,et al.  From Frequency to Meaning: Vector Space Models of Semantics , 2010, J. Artif. Intell. Res..

[34]  Diego Reforgiato Recupero,et al.  Evaluating neural word embeddings created from online course reviews for sentiment analysis , 2019, SAC.

[35]  Ting Liu,et al.  Document Modeling with Gated Recurrent Neural Network for Sentiment Classification , 2015, EMNLP.

[36]  Diego Reforgiato Recupero,et al.  ESWC 15 Challenge on Concept-Level Sentiment Analysis , 2015, SemWebEval@ESWC.

[37]  Shuai Wang,et al.  Deep learning for sentiment analysis: A survey , 2018, WIREs Data Mining Knowl. Discov..

[38]  Pilar Rodríguez Marín,et al.  Extracting Emotions from Texts in E-Learning Environments , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[39]  Ming Zhou,et al.  Sentiment Embeddings with Applications to Sentiment Analysis , 2016, IEEE Transactions on Knowledge and Data Engineering.

[40]  Diego Reforgiato Recupero,et al.  Challenge on Fine-Grained Sentiment Analysis Within ESWC2016 , 2016, SemWebEval@ESWC.

[41]  Athena Vakali,et al.  Sentiment analysis leveraging emotions and word embeddings , 2017 .

[42]  Antonio Pietrosanto,et al.  E-learning and sentiment analysis: a case study , 2018 .

[43]  Dai Quoc Nguyen,et al.  NIHRIO at SemEval-2018 Task 3: A Simple and Accurate Neural Network Model for Irony Detection in Twitter , 2018, *SEMEVAL.

[44]  Zhihua Zhang,et al.  Learning sentiment-inherent word embedding for word-level and sentence-level sentiment analysis , 2015, 2015 International Conference on Asian Language Processing (IALP).

[45]  Karina L. Cela,et al.  Social Network Analysis in E-Learning Environments: A Preliminary Systematic Review , 2014, Educational Psychology Review.

[46]  Michael Sedlmair,et al.  More than Bags of Words: Sentiment Analysis with Word Embeddings , 2018 .