Sensing Emotions in Text Messages: An Application and Deployment Study of EmotionPush

Instant messaging and push notifications play important roles in modern digital life. To enable robust sense-making and rich context awareness in computer mediated communications, we introduce EmotionPush, a system that automatically conveys the emotion of received text with a colored push notification on mobile devices. EmotionPush is powered by state-of-the-art emotion classifiers and is deployed for Facebook Messenger clients on Android. The study showed that the system is able to help users prioritize interactions.

[1]  Joan Morris DiMicco,et al.  Conductive Chat : Instant messaging with a skin conductivity channel , 2002 .

[2]  Chung-Hsien Wu,et al.  Emotion recognition from text using semantic labels and separable mixture models , 2006, TALIP.

[3]  Shaaron Ainsworth,et al.  Emotion understanding and performance during computer-supported collaboration , 2012, Comput. Hum. Behav..

[4]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[5]  J. Alfredo Sánchez,et al.  Towards mood-oriented interfaces for synchronous interaction , 2005, CLIHC '05.

[6]  Scott E. Hudson,et al.  The kinedit system: affective messages using dynamic texts , 2003, CHI '03.

[7]  Mathilde Pignol,et al.  Kinetic typography-based instant messaging , 2003, CHI Extended Abstracts.

[8]  Ming Zhou,et al.  Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification , 2014, ACL.

[9]  Erik Cambria,et al.  EmoSenticSpace: A novel framework for affective common-sense reasoning , 2014, Knowl. Based Syst..

[10]  Zhiquan Yeo,et al.  Emotional instant messaging with KIM , 2008, CHI Extended Abstracts.

[11]  Joonhwan Lee,et al.  Using kinetic typography to convey emotion in text-based interpersonal communication , 2006, DIS '06.

[12]  Yi-Hsuan Yang,et al.  Quantitative Study of Music Listening Behavior in a Social and Affective Context , 2013, IEEE Transactions on Multimedia.

[13]  Joseph Kaye,et al.  Understanding how bloggers feel: recognizing affect in blog posts , 2006, CHI Extended Abstracts.

[14]  Rada Mihalcea,et al.  Computational approaches to subjectivity and sentiment analysis: Present and envisaged methods and applications , 2014, Comput. Speech Lang..

[15]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[16]  Henry Lieberman,et al.  Visualizing the affective structure of a text document , 2003, CHI Extended Abstracts.

[17]  Stephen A. Brewster,et al.  Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion , 2016, CHI.

[18]  Hsin-Hsi Chen,et al.  Using Morphological and Syntactic Structures for Chinese Opinion Analysis , 2009, EMNLP.

[19]  Joost Broekens,et al.  AffectButton: Towards a standard for dynamic affective user feedback , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[20]  Darren Gergle,et al.  Effects of four computer-mediated communications channels on trust development , 2002, CHI.

[21]  Mitsuru Ishizuka,et al.  iFeel_IM! Emotion Enhancing Garment for Communication in Affect Sensitive Instant Messenger , 2009, HCI.

[22]  Jonathan Klein,et al.  This computer responds to user frustration: Theory, design, and results , 2002, Interact. Comput..

[23]  J. Alfredo Sánchez,et al.  Conveying mood and emotion in instant messaging by using a two-dimensional model for affective states , 2006, IHC '06.

[24]  Hsin-Hsi Chen,et al.  Predicting Opinion Dependency Relations for Opinion Analysis , 2011, IJCNLP.

[25]  Scott E. Hudson,et al.  The kinetic typography engine: an extensible system for animating expressive text , 2002, UIST '02.

[26]  R. Plutchik.  Emotion, a psychoevolutionary synthesis , 1980 .

[27]  Tao Chen,et al.  Word Embedding Composition for Data Imbalances in Sentiment and Emotion Classification , 2015, Cognitive Computation.

[28]  Peter Robinson,et al.  FAIM: integrating automated facial affect analysis in instant messaging , 2004, IUI '04.