Opinion Mining for Predicting Peer Affective Feedback Helpfulness

Peer feedback has become increasingly popular since the advent of social networks, which has significantly changed the process of learning. Some of today’s e-learning systems enable students to communicate with peers (or co-learners) and ask or provide feedback. However, the highly variable nature of peer feedback makes it difficult for a learner who asked for help to notice and benefit from helpful feedback provided by his peers, especially if he is in emotional distress. Helpful feedback in affective context means positive, motivating and encouraging feedback while an unhelpful feedback is negative, bullying and demeaning feedback. In this paper, we propose an approach to predict the helpfulness of a given affective feedback for a learner based on the feedback content and the learner’s affective state. The proposed approach uses natural language processing techniques and machine learning algorithms to classify and predict the helpfulness of peers’ feedback in the context of an English learning forum. In order to seek the best accuracy possible, we have used several machine learning algorithms. Our results show that Naive-Bayes provides the best performance with a prediction accuracy of 87.19%.

[1]  Y. Trope,et al.  Counteractive evaluation: Asymmetric shifts in the implicit value of conflicting motivations , 2010 .

[2]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[3]  N. Law,et al.  Online peer assessment: effects of cognitive and affective feedback , 2011, Instructional Science.

[4]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[5]  José M. Perea,et al.  Opinion classification techniques applied to a Spanish corpus , 2011 .

[6]  Diane J. Litman,et al.  Understanding Differences in Perceived Peer-Review Helpfulness using Natural Language Processing , 2011, BEA@ACL.

[7]  Kenneth R. Koedinger,et al.  Noticing Relevant Feedback Improves Learning in an Intelligent Tutoring System for Peer Tutoring , 2012, ITS.

[8]  James Harland,et al.  Evaluating the quality of interaction in asynchronous discussion forums in fully online courses , 2012 .

[9]  Yue Lu Exploiting Social Context for Review Quality Prediction , 2010 .

[10]  Zoltán Prekopcsák,et al.  Radoop: Analyzing Big Data with RapidMiner and Hadoop , 2011 .

[11]  Jan Muntermann,et al.  AIS Electronic Library (AISeL) , 2000 .

[12]  Rosa M. Carro,et al.  Sentiment analysis in Facebook and its application to e-learning , 2014, Comput. Hum. Behav..

[13]  James C. Lester,et al.  Evaluating the consequences of affective feedback in intelligent tutoring systems , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.