CommentSpace: structured support for collaborative visual analysis

Collaborative visual analysis tools can enhance sensemaking by facilitating social interpretation and parallelization of effort. These systems enable distributed exploration and evidence gathering, allowing many users to pool their effort as they discuss and analyze the data. We explore how adding lightweight tag and link structure to comments can aid this analysis process. We present CommentSpace, a collaborative system in which analysts comment on visualizations and websites and then use tags and links to organize findings and identify others'" contributions. In a pair of studies comparing CommentSpace to a system without support for tags and links, we find that a small, fixed vocabulary of tags (question, hypothesis, to-do) and links (evidence-for, evidence-against) helps analysts more consistently and accurately classify evidence and establish common ground. We also find that managing and incentivizing participation is important for analysts to progress from exploratory analysis to deeper analytical tasks. Finally, we demonstrate that tags and links can help teams complete evidence gathering and synthesis tasks and that organizing comments using tags and links improves analytic results.

[1]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[2]  Maneesh Agrawala,et al.  Perceptual interpretation of ink annotations on line charts , 2009, UIST '09.

[3]  P. Pirolli,et al.  Collaborative Intelligence Analysis with CACHE and its Effects on Information Gathering and Cognitive Bias , 2006 .

[4]  Yochai Benkler,et al.  Coase's Penguin, or Linux and the Nature of the Firm , 2001, ArXiv.

[5]  Mary Beth Rosson,et al.  Awareness and teamwork in computer-supported collaborations , 2006, Interact. Comput..

[6]  Robert Harper,et al.  Stories in GeoTime , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[7]  Ben Shneiderman,et al.  Systematic yet flexible discovery: guiding domain experts through exploratory data analysis , 2008, IUI '08.

[8]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[9]  Nikos I. Karacapilidis,et al.  The Zeno argumentation framework , 1997, ICAIL '97.

[10]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[11]  Martin Wattenberg,et al.  Voyagers and voyeurs: Supporting asynchronous collaborative visualization , 2009, CACM.

[12]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[13]  Paul Johns,et al.  Pathfinder: an online collaboration environment for citizen scientists , 2009, CHI.

[14]  Matt McKeon,et al.  Harnessing the Information Ecosystem with Wiki-based Visualization Dashboards , 2009, IEEE Transactions on Visualization and Computer Graphics.

[15]  Bernardo A. Huberman,et al.  Usage patterns of collaborative tagging systems , 2006, J. Inf. Sci..

[16]  Maarten Sierhuis,et al.  Hypermedia Support for Argumentation-Based Rationale , 2006 .

[17]  Ed H. Chi,et al.  Understanding the efficiency of social tagging systems using information theory , 2008, ICWSM.

[18]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[19]  Susan R. Fussell,et al.  Do visualizations improve synchronous remote collaboration? , 2008, CHI.

[20]  Martin Wattenberg,et al.  Visualizing Activity on Wikipedia with Chromograms , 2007, INTERACT.

[21]  Nicholas J. Pioch,et al.  POLESTAR: collaborative knowledge management and sensemaking tools for intelligence analysts , 2006, CIKM '06.

[22]  Martin Wattenberg,et al.  Harry Potter and the Meat-Filled Freezer: A Case Study of Spontaneous Usage  of Visualization Tools , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[23]  Yolanda Gil,et al.  User interfaces with semi-formal representations: a study of designing argumentation structures , 2005, IUI '05.

[24]  Irfan A. Essa,et al.  Videolyzer: quality analysis of online informational video for bloggers and journalists , 2009, CHI.

[25]  Alexander W. Skaburskis,et al.  The Sandbox for analysis: concepts and methods , 2006, CHI.

[26]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[27]  Pamela Effrein Sandstrom,et al.  Information Foraging Theory: Adaptive Interaction with Information , 2010, J. Assoc. Inf. Sci. Technol..