Visual Analytics of Text Conversation Sentiment and Semantics

This paper describes the design and implementation of a web‐based system to visualize large collections of text conversations integrated into a hierarchical four‐level‐of‐detail design. Viewers can visualize conversations: (1) in a streamgraph topic overview for a user‐specified time period; (2) as emotion patterns for a topic chosen from the streamgraph; (3) as semantic sequences for a user‐selected emotion pattern, and (4) as an emotion‐driven conversation graph for a single conversation. We collaborated with the Live Chatcustomer service group at SAS Institute to design and evaluate our system's strengths and limitations.

[1]  Ernst Althaus,et al.  Computing Locally Coherent Discourses , 2004, ACL.

[2]  Qiang Zhang,et al.  TIARA: a visual exploratory text analytic system , 2010, KDD '10.

[3]  Xiaohua Sun,et al.  Whisper: Tracing the Spatiotemporal Process of Information Diffusion in Real Time , 2012, IEEE Transactions on Visualization and Computer Graphics.

[4]  Amy Beth Warriner,et al.  Norms of valence, arousal, and dominance for 13,915 English lemmas , 2013, Behavior Research Methods.

[5]  Shixia Liu,et al.  Topic- and Time-Oriented Visual Text Analysis , 2016, IEEE Computer Graphics and Applications.

[6]  Ross Maciejewski,et al.  The State‐of‐the‐Art in Predictive Visual Analytics , 2017, Comput. Graph. Forum.

[7]  Andreas Kerren,et al.  Text visualization techniques: Taxonomy, visual survey, and community insights , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[8]  Fei Wang,et al.  SocialHelix: visual analysis of sentiment divergence in social media , 2015, J. Vis..

[9]  Panagiotis Kouris,et al.  Abstractive Text Summarization Based on Deep Learning and Semantic Content Generalization , 2019, ACL.

[10]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[11]  Kwan-Liu Ma,et al.  Design Considerations for Optimizing Storyline Visualizations , 2012, IEEE Transactions on Visualization and Computer Graphics.

[12]  Saif M. Mohammad,et al.  Sentiment Analysis: Detecting Valence, Emotions, and Other Affectual States from Text , 2016, ArXiv.

[13]  Christopher G. Healey,et al.  A system for generating storyline visualizations using hierarchical task network planning , 2019, Comput. Graph..

[14]  Haitao Huang,et al.  Abstractive text summarization using LSTM-CNN based deep learning , 2018, Multimedia Tools and Applications.

[15]  Saif M. Mohammad,et al.  Challenges in Sentiment Analysis , 2017 .

[16]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[17]  ThelwallMike,et al.  Sentiment strength detection in short informal text , 2010 .

[18]  Giuseppe Carenini,et al.  ConVis: A Visual Text Analytic System for Exploring Blog Conversations , 2014, Comput. Graph. Forum.

[19]  J. Russell.  A circumplex model of affect. , 1980 .

[20]  Lucy T. Nowell,et al.  ThemeRiver: Visualizing Thematic Changes in Large Document Collections , 2002, IEEE Trans. Vis. Comput. Graph..

[21]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[22]  Daniel A. Keim,et al.  ThreadReconstructor: Modeling Reply‐Chains to Untangle Conversational Text through Visual Analytics , 2018, Comput. Graph. Forum.

[23]  R. Plutchik.  A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[24]  Nan Cao,et al.  Introduction to Text Visualization , 2016, Atlantis Briefs in Artificial Intelligence.

[25]  M. Sheelagh T. Carpendale,et al.  A Visual Backchannel for Large-Scale Events , 2010, IEEE Transactions on Visualization and Computer Graphics.

[26]  Regina Barzilay,et al.  Sentence Fusion for Multidocument News Summarization , 2005, CL.

[27]  Shuai Wang,et al.  Deep learning for sentiment analysis: A survey , 2018, WIREs Data Mining Knowl. Discov..

[28]  Johan Bollen,et al.  Between Conjecture and Memento: Shaping A Collective Emotional Perception of the Future , 2008, AAAI Spring Symposium: Emotion, Personality, and Social Behavior.

[29]  Arvid Kappas,et al.  Sentiment in short strength detection informal text , 2010, J. Assoc. Inf. Sci. Technol..

[30]  Andreas Kerren,et al.  StanceVis Prime: visual analysis of sentiment and stance in social media texts , 2020, J. Vis..

[31]  Saif Mohammad,et al.  Stance and Sentiment in Tweets , 2016, ACM Trans. Internet Techn..

[32]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[33]  Melanie Tory,et al.  Evaluating Visualizations: Do Expert Reviews Work? , 2005, IEEE Computer Graphics and Applications.

[34]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[35]  Charu C. Aggarwal,et al.  Mining Text Data , 2012, Springer US.

[36]  Christopher M. Danforth,et al.  Temporal Patterns of Happiness and Information in a Global Social Network: Hedonometrics and Twitter , 2011, PloS one.

[37]  J. Pennebaker,et al.  The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods , 2010 .

[38]  Bohn Stafleu van Loghum,et al.  Online … , 2002, LOG IN.

[39]  Lei Shi,et al.  Understanding text corpora with multiple facets , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[40]  GleicherMichael,et al.  The State-of-the-Art in Predictive Visual Analytics , 2017 .

[41]  Lei Zhang,et al.  A Survey of Opinion Mining and Sentiment Analysis , 2012, Mining Text Data.

[42]  A. Adithya.  Parallel Coordinates , 2015 .

[43]  J. Russell,et al.  Science Current Directions in Psychological the Structure of Current Affect : Controversies and Emerging Consensus on Behalf Of: Association for Psychological Science , 2022 .

[44]  Giuseppe Carenini,et al.  MultiConVis: A Visual Text Analytics System for Exploring a Collection of Online Conversations , 2016, IUI.

[45]  James T. Enns,et al.  Large Datasets at a Glance: Combining Textures and Colors in Scientific Visualization , 1999, IEEE Trans. Vis. Comput. Graph..

[46]  Richard Socher,et al.  Neural Text Summarization: A Critical Evaluation , 2019, EMNLP.

[47]  Martin Wattenberg,et al.  Studying cooperation and conflict between authors with history flow visualizations , 2004, CHI.

[48]  Daniel A. Keim,et al.  ConToVi: Multi‐Party Conversation Exploration using Topic‐Space Views , 2016, Comput. Graph. Forum.

[49]  Tamara Munzner,et al.  Design Study Methodology: Reflections from the Trenches and the Stacks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[50]  Andreas Kerren,et al.  The State of the Art in Sentiment Visualization , 2018, Comput. Graph. Forum.

[51]  Robert S. Laramee,et al.  SoS TextVis: An Extended Survey of Surveys on Text Visualization , 2019, Comput..

[52]  Philipp Klaus.  The case of Amazon.com: towards a conceptual framework of online customer service experience (OCSE) using the emerging consensus technique (ECT) , 2013 .

[53]  Fangzhao Wu,et al.  OpinionFlow: Visual Analysis of Opinion Diffusion on Social Media , 2014, IEEE Transactions on Visualization and Computer Graphics.

[54]  Trupti M. Kodinariya,et al.  Review on determining number of Cluster in K-Means Clustering , 2013 .

[55]  Shimei Pan,et al.  TIARA: Interactive, Topic-Based Visual Text Summarization and Analysis , 2012, TIST.

[56]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[57]  Peter D. Turney.  Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[58]  Syed Waqar Jaffry,et al.  Textual keyword extraction and summarization: State-of-the-art , 2019, Inf. Process. Manag..

[59]  Mengchen Liu,et al.  StoryFlow: Tracking the Evolution of Stories , 2013, IEEE Transactions on Visualization and Computer Graphics.

[60]  Kwan-Liu Ma,et al.  An Efficient Framework for Generating Storyline Visualizations from Streaming Data , 2015, IEEE Transactions on Visualization and Computer Graphics.

[61]  Jianyong Wang,et al.  A dirichlet multinomial mixture model-based approach for short text clustering , 2014, KDD.

[62]  Ross Maciejewski,et al.  A Visual Analytics Framework for Identifying Topic Drivers in Media Events , 2018, IEEE Transactions on Visualization and Computer Graphics.

[63]  Saif Mohammad,et al.  CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON , 2013, Comput. Intell..