Towards automated e-counselling system based on counsellors emotion perception

Emotions are a core semantic component of human communication. Since counsellors are humans we assume that their own state of emotions could affect their intuitional effort when taking decisions concerning their clients. Therefore, the accuracy of detected emotions by counsellors could be doubtful. And this highlights the need for complementing the intuitional effort of counsellors by computational approach. Therefore, ascertaining the efficacy of computational algorithm, there is the need to benchmark with humans. In this paper, we explore empirically, the extent to which counsellors own emotional states influence their perception of emotions expressed in text. This influence is investigated through the level of agreement among counsellors when annotating emotions expressed in students’ personal life’s stories. The result shows strong intra-counsellor annotation agreement of emotions while inter-counsellors annotation agreement was low. Furthermore, the intra-annotation agreement of emotions was found to be strongly correlated to the counsellors’ self-reported emotions. We speculate, based on the findings, that the emotional state of counsellors influences their emotion perception while tracking emotions in text. Based on the results, we discuss the advantages of using an automated e-counselling system for emotion analysis.

[1]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[2]  Kevor Mark-Oliver e-COUNSELING FOR INSTITUTIONS OF HIGHER LEARNING IN GHANA: WHAT ARE THE REQUIREMENTS? , 2013 .

[3]  Erkki Sutinen,et al.  Towards students' behavioral intention to adopt and use e-counseling: An empirical approach of using Unified Theory of Acceptance and Use of Technology model , 2015, AFRICON 2015.

[4]  Stan Szpakowicz,et al.  Identifying Expressions of Emotion in Text , 2007, TSD.

[5]  G. Loewenstein,et al.  The role of affect in decision making. , 2003 .

[6]  Erkki Sutinen,et al.  E-Counselling Implementation: Students' Life Stories and Counselling Technologies in Perspective , 2014 .

[7]  P. Ekman An argument for basic emotions , 1992 .

[8]  Victor Zue,et al.  Empirical evaluation of human performance and agreement in parsing discourse constituents in spoken dialogue , 1995, EUROSPEECH.

[9]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[10]  N. Srinivasan,et al.  Role of affect in decision making. , 2013, Progress in brain research.

[11]  Emily Mower Provost,et al.  Leveraging inter-rater agreement for audio-visual emotion recognition , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[12]  Erkki Sutinen,et al.  Using Unified Theory of Acceptance and Use of Technology Model to Predict Students’ Behavioral Intention to Adopt and Use E-Counseling in Ghana , 2015 .

[13]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[14]  Lorelei R. Vinluan The Use of ICT in School Guidance: Attitudes and Practices of Guidance Counselors in Metro Manila, the Philippines , 2011 .

[15]  Andrés Montoyo,et al.  Detecting Implicit Expressions of Sentiment in Text Based on Commonsense Knowledge , 2011, WASSA@ACL.

[16]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[17]  William Quisenberry,et al.  The Role of Uganda Securities Exchange in the Economic Growth of Uganda: An Econometric Analysis , 2015 .

[18]  Christopher K. Hsee,et al.  Risk as Feelings , 2001, Psychological bulletin.

[19]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[20]  Erkki Sutinen,et al.  Antisocial Behavior corpus for harmful language detection , 2013, 2013 Federated Conference on Computer Science and Information Systems.

[21]  Maria Eduarda Duarte,et al.  Life designing: A paradigm for career construction in the 21st century , 2009 .

[22]  Jonathan Gratch,et al.  Reading people's minds from emotion expressions in interdependent decision making. , 2014, Journal of personality and social psychology.

[23]  R. Plutchik,et al.  Emotion: Theory, Research, and Experience. Vol. 1. Theories of Emotion , 1981 .

[24]  A. J. Conger Integration and generalization of kappas for multiple raters. , 1980 .

[25]  Kevin Crowston,et al.  Machine learning and rule-based automated coding of qualitative data , 2010, ASIST.

[26]  T. Goetz,et al.  Academic Emotions in Students' Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research , 2002 .

[27]  Raoul Van Esbroeck,et al.  Career Guidance in a Global World , 2008 .

[28]  Chu-Ren Huang,et al.  A Text-driven Rule-based System for Emotion Cause Detection , 2010, HLT-NAACL 2010.

[29]  David A. van Leeuwen,et al.  Assessing agreement of observer- and self-annotations in spontaneous multimodal emotion data , 2008, INTERSPEECH.

[30]  An evaluation of the information and consultation services in the colleges of education in the Volta region of Ghana , 2013 .

[31]  Carlo Strapparava,et al.  Learning to identify emotions in text , 2008, SAC '08.

[32]  Michel Tuan Pham,et al.  All Negative Moods Are Not Equal: Motivational Influences of Anxiety and Sadness on Decision Making. , 1999, Organizational behavior and human decision processes.

[33]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[34]  Angela J. Yu,et al.  Emotion and decision-making: affect-driven belief systems in anxiety and depression , 2012, Trends in Cognitive Sciences.

[35]  Justin Zhijun Zhan,et al.  Sentiment analysis using product review data , 2015, Journal of Big Data.

[36]  R. Brooner,et al.  A randomized trial of Web-based videoconferencing for substance abuse counseling. , 2014, Journal of substance abuse treatment.

[37]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[38]  J. Lerner,et al.  Beyond valence: Toward a model of emotion-specific influences on judgement and choice , 2000 .

[39]  Xuren Wang,et al.  Text Emotion Classification Research Based on Improved Latent Semantic Analysis Algorithm , 2013 .

[40]  Deborah Miller,et al.  Engaging college science students and changing academic achievement with technology: A quasi-experimental preliminary investigation , 2009, Comput. Educ..

[41]  Erkki Sutinen,et al.  Serious storytelling – a first definition and review , 2017, Multimedia Tools and Applications.

[42]  Patricio Martínez-Barco,et al.  Emotion Detection from text: A Survey , 2014 .

[43]  I. Shochet,et al.  Opportunities and challenges : school guidance counsellors’ perceptions of counselling students online , 2013 .

[44]  R. I. Minub,et al.  Automatic Emotion Recognition and Classification , 2012 .

[45]  Robert H. Frank,et al.  Feelings and Emotions: Introducing Moral Emotions into Models of Rational Choice , 2004 .

[46]  Kaitlyn Mulcrone Detecting Emotion in Text , 2012 .

[47]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[48]  Chih-Hong Huang,et al.  Change discovery of learning performance in dynamic educational environments , 2016, Telematics Informatics.

[49]  Vasileios Lampos,et al.  The Expression of Emotions in 20th Century Books , 2013, PloS one.

[50]  Shiv Naresh Shivhare,et al.  Emotion Detection from Text , 2012, ArXiv.

[51]  N. Schwarz Emotion, cognition, and decision making , 2000 .

[52]  Erkki Sutinen,et al.  Exploiting sentiment analysis to track emotions in students' learning diaries , 2013, Koli Calling '13.

[53]  Walt Detmar Meurers,et al.  Emotional Perception of Fairy Tales: Achieving Agreement in Emotion Annotation of Text , 2010, HLT-NAACL 2010.

[54]  Ross Buck,et al.  Emotional Expressivity and Trustworthiness: The Role of Nonverbal Behavior in the Evolution of Cooperation , 2003 .

[55]  Ron Artstein,et al.  Survey Article: Inter-Coder Agreement for Computational Linguistics , 2008, CL.

[56]  P. Ekman Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life , 2003 .

[57]  Erkki Sutinen,et al.  Annotation Agreement of Emotions in Text: The Influence of Counsellors' Emotional State on their Emotion Perception , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[58]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[59]  K. Scherer,et al.  Evidence for universality and cultural variation of differential emotion response patterning. , 1994, Journal of personality and social psychology.

[60]  M. Selinger ICT and Classroom Management , 2002 .