Co-Bridges: Pair-wise Visual Connection and Comparison for Multi-item Data Streams

In various domains, there are abundant streams or sequences of multi-item data of various kinds, e.g. streams of news and social media texts, sequences of genes and sports events, etc. Comparison is an important and general task in data analysis. For comparing data streams involving multiple items (e.g., words in texts, actors or action types in action sequences, visited places in itineraries, etc.), we propose Co-Bridges, a visual design involving connection and comparison techniques that reveal similarities and differences between two streams. Co-Bridges use river and bridge metaphors, where two sides of a river represent data streams, and bridges connect temporally or sequentially aligned segments of streams. Commonalities and differences between these segments in terms of involvement of various items are shown on the bridges. Interactive query tools support the selection of particular stream subsets for focused exploration. The visualization supports both qualitative (common and distinct items) and quantitative (stream volume, amount of item involvement) comparisons. We further propose Comparison-of-Comparisons, in which two or more Co-Bridges corresponding to different selections are juxtaposed. We test the applicability of the Co-Bridges in different domains, including social media text streams and sports event sequences. We perform an evaluation of the users' capability to understand and use Co-Bridges. The results confirm that Co-Bridges is effective for supporting pair-wise visual comparisons in a wide range of applications.

[1]  Xin Tong,et al.  TextFlow: Towards Better Understanding of Evolving Topics in Text , 2011, IEEE Transactions on Visualization and Computer Graphics.

[2]  Daniel A. Keim,et al.  A Survey on Visual Analytics of Social Media Data , 2016, IEEE Transactions on Multimedia.

[3]  Min Chen,et al.  Glyph-based Visualization: Foundations, Design Guidelines, Techniques and Applications , 2013, Eurographics.

[4]  Xiaoru Yuan,et al.  Social Media Visual Analytics , 2017, Comput. Graph. Forum.

[5]  Huamin Qu,et al.  Towards Easy Comparison of Local Businesses Using Online Reviews , 2018, Comput. Graph. Forum.

[6]  Jonathan C. Roberts,et al.  Visual comparison for information visualization , 2011, Inf. Vis..

[7]  Tatiana von Landesberger,et al.  Insights by Visual Comparison: The State and Challenges , 2018, IEEE Computer Graphics and Applications.

[8]  Martin Wattenberg,et al.  Parallel Tag Clouds to explore and analyze faceted text corpora , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[9]  Thomas Ertl,et al.  TravelDiff: Visual comparison analytics for massive movement patterns derived from Twitter , 2016, 2016 IEEE Pacific Visualization Symposium (PacificVis).

[10]  Bongshin Lee,et al.  What's the Difference?: Evaluating Variations of Multi-Series Bar Charts for Visual Comparison Tasks , 2018, CHI.

[11]  Xiaohua Sun,et al.  Whisper: Tracing the Spatiotemporal Process of Information Diffusion in Real Time , 2012, IEEE Transactions on Visualization and Computer Graphics.

[12]  John T. Stasko,et al.  Visualizing Social Media Content with SentenTree , 2017, IEEE Transactions on Visualization and Computer Graphics.

[13]  Nan Cao,et al.  StreamExplorer: A Multi-Stage System for Visually Exploring Events in Social Streams , 2018, IEEE Transactions on Visualization and Computer Graphics.

[14]  Jie Li,et al.  Supporting Story Synthesis: Bridging the Gap between Visual Analytics and Storytelling , 2020, IEEE Transactions on Visualization and Computer Graphics.

[15]  Baining Guo,et al.  How ideas flow across multiple social groups , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[16]  Hai Lin,et al.  Visual exploration and comparison of word embeddings , 2018, J. Vis. Lang. Comput..

[17]  John T. Stasko,et al.  Dust & Magnet: Multivariate Information Visualization Using a Magnet Metaphor , 2005, Inf. Vis..

[18]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[19]  Yingcai Wu,et al.  EvoRiver: Visual Analysis of Topic Coopetition on Social Media , 2014, IEEE Transactions on Visualization and Computer Graphics.

[20]  Fei Wang,et al.  PEARL: An interactive visual analytic tool for understanding personal emotion style derived from social media , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[21]  Fangzhao Wu,et al.  OpinionFlow: Visual Analysis of Opinion Diffusion on Social Media , 2014, IEEE Transactions on Visualization and Computer Graphics.

[22]  William Ribarsky,et al.  LeadLine: Interactive visual analysis of text data through event identification and exploration , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[23]  Ke Xu,et al.  EventThread: Visual Summarization and Stage Analysis of Event Sequence Data , 2018, IEEE Transactions on Visualization and Computer Graphics.

[24]  Fei Wang,et al.  SocialHelix: visual analysis of sentiment divergence in social media , 2015, J. Vis..

[25]  F. Blattner,et al.  Mauve: multiple alignment of conserved genomic sequence with rearrangements. , 2004, Genome research.

[26]  Qiang Zhang,et al.  TIARA: a visual exploratory text analytic system , 2010, KDD '10.

[27]  Charles A. Sutton,et al.  Word storms: multiples of word clouds for visual comparison of documents , 2013, WWW.

[28]  David Gotz,et al.  DecisionFlow: Visual Analytics for High-Dimensional Temporal Event Sequence Data , 2014, IEEE Transactions on Visualization and Computer Graphics.

[29]  Jun Yuan,et al.  A survey of visual analytics techniques for machine learning , 2020, Computational Visual Media.

[30]  Xiaoru Yuan,et al.  E-Map: A Visual Analytics Approach for Exploring Significant Event Evolutions in Social Media , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[31]  Michael Gleicher,et al.  Task-Driven Comparison of Topic Models , 2016, IEEE Transactions on Visualization and Computer Graphics.

[32]  Wei Chen,et al.  RankExplorer: Visualization of Ranking Changes in Large Time Series Data , 2012, IEEE Transactions on Visualization and Computer Graphics.

[33]  Yu-Ru Lin,et al.  Episogram: Visual Summarization of Egocentric Social Interactions , 2016, IEEE Computer Graphics and Applications.

[34]  Rahul C. Basole,et al.  Duet: Helping Data Analysis Novices Conduct Pairwise Comparisons by Minimal Specification , 2018, IEEE Transactions on Visualization and Computer Graphics.

[35]  Michael Gleicher,et al.  Sequence Surveyor: Leveraging Overview for Scalable Genomic Alignment Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[36]  Giuseppe Carenini,et al.  OCTVis: Ontology-Based Comparison of Topic Models , 2019, 2019 IEEE Visualization Conference (VIS).

[37]  Tobias Schreck,et al.  Interactive visual comparison of multiple trees , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[38]  Yingcai Wu,et al.  Visual Analysis of Topic Competition on Social Media , 2013, IEEE Transactions on Visualization and Computer Graphics.

[39]  Stefan Bruckner,et al.  VAICo: Visual Analysis for Image Comparison , 2013, IEEE Transactions on Visualization and Computer Graphics.

[40]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[41]  Yang Wang,et al.  Patterns and Sequences: Interactive Exploration of Clickstreams to Understand Common Visitor Paths , 2017, IEEE Transactions on Visualization and Computer Graphics.

[42]  Steven Franconeri,et al.  Comparing averages in time series data , 2012, CHI.

[43]  Shuai Chen,et al.  R-Map: A Map Metaphor for Visualizing Information Reposting Process in Social Media , 2020, IEEE Transactions on Visualization and Computer Graphics.

[44]  Gennady L. Andrienko,et al.  Interactive maps for visual data exploration , 1999, Int. J. Geogr. Inf. Sci..

[45]  Yuanzhe Chen,et al.  Sequence Synopsis: Optimize Visual Summary of Temporal Event Data , 2018, IEEE Transactions on Visualization and Computer Graphics.

[46]  Steven Franconeri,et al.  Face to Face: Evaluating Visual Comparison , 2019, IEEE Transactions on Visualization and Computer Graphics.

[47]  Cláudio T. Silva,et al.  Genotet: An Interactive Web-based Visual Exploration Framework to Support Validation of Gene Regulatory Networks , 2014, IEEE Transactions on Visualization and Computer Graphics.

[48]  Mor Naaman,et al.  Social Media Visual Analytics for Events , 2011, Social Media Modeling and Computing.

[49]  Michael Gleicher,et al.  Considerations for Visualizing Comparison , 2018, IEEE Transactions on Visualization and Computer Graphics.

[50]  David Borland,et al.  Visual Analysis of High-Dimensional Event Sequence Data via Dynamic Hierarchical Aggregation , 2020, IEEE Transactions on Visualization and Computer Graphics.

[51]  Yu Zhang,et al.  BarcodeTree: Scalable Comparison of Multiple Hierarchies , 2020, IEEE Transactions on Visualization and Computer Graphics.

[52]  Kang Zhang,et al.  COPE: Interactive Exploration of Co-Occurrence Patterns in Spatial Time Series , 2019, IEEE Transactions on Visualization and Computer Graphics.

[53]  Judith S. Donath,et al.  PeopleGarden: creating data portraits for users , 1999, UIST '99.

[54]  Eduard Gröller,et al.  Comparative Visualization for Parameter Studies of Dataset Series , 2010, IEEE Transactions on Visualization and Computer Graphics.

[55]  Yifan Hu,et al.  GMap: Visualizing graphs and clusters as maps , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).