Interactive querying of temporal data using a comic strip metaphor

Finding patterns in temporal data is an important data analysis task in many domains. Static visualizations can help users easily see certain instances of patterns, but are not specially designed to support systematic analysis tasks, such as finding all instances of a pattern automatically. VizPattern is an interactive visual query environment that uses a comic strip metaphor to enable users to easily and quickly define and locate complex temporal patterns. Evaluations provide evidence that VizPattern is applicable in many domains, and that it enables a wide variety of users to answer questions about temporal data faster and with fewer errors than existing state-of-the-art visual analysis systems.

[1]  Heidrun Schumann,et al.  Axes-based visualizations with radial layouts , 2004, SAC '04.

[2]  Carol Traynor,et al.  Chapter Six End Users and GIS : A Demonstration Is Worth a Thousand Words , 2000 .

[3]  Jing Jin,et al.  QueryMarvel: A visual query language for temporal patterns using comic strips , 2009, 2009 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[4]  Heidrun Schumann,et al.  Visualizing time-oriented data - A systematic view , 2007, Comput. Graph..

[5]  Ben Shneiderman,et al.  LifeLines: visualizing personal histories , 1996, CHI.

[6]  Rajiv T. Maheswaran,et al.  VizScript: on the creation of efficient visualizations for understanding complex multi-agent systems , 2008, IUI '08.

[7]  Heidrun Schumann,et al.  Visual Methods for Analyzing Time-Oriented Data , 2008, IEEE Transactions on Visualization and Computer Graphics.

[8]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[9]  Luca Chittaro,et al.  Data mining on temporal data: a visual approach and its clinical application to hemodialysis , 2003, J. Vis. Lang. Comput..

[10]  Marc Alexa,et al.  Visualizing time-series on spirals , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[11]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[12]  Sanghyun Park,et al.  An Index-Based Method for Timestamped Event Sequence Matching , 2005, DEXA.

[13]  Ben Shneiderman,et al.  Interactive graphical querying of time series and linear sequence data sets , 2003 .

[14]  Lucy T. Nowell,et al.  ThemeRiver: visualizing theme changes over time , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[15]  Carol Traynor Chapter 6 – End Users and GIS: A Demonstration Is Worth a Thousand Words , 2001 .

[16]  Raghu Ramakrishnan,et al.  MIMSY: A System for Analyzing Time Series Data in the Stock Market Domain , 1993, Workshop on Programming with Logic Databases , ILPS.

[17]  Heidrun Schumann,et al.  3D information visualization for time dependent data on maps , 2005, Ninth International Conference on Information Visualisation (IV'05).

[18]  Martin Wattenberg,et al.  Sketching a graph to query a time-series database , 2001, CHI Extended Abstracts.

[19]  Wolfgang Jank,et al.  Similarity-Based Forecasting with Simultaneous Previews: A River Plot Interface for Time Series Forecasting , 2007, 2007 11th International Conference Information Visualization (IV '07).

[20]  Raghu Ramakrishnan,et al.  Database Management Systems , 1976 .

[21]  Chet Haase,et al.  Filthy Rich Clients: Developing Animated and Graphical Effects for Desktop Java Applications (The Java Series) , 2007 .

[22]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction (4th Edition) , 2004 .

[23]  I. N. Moraes,et al.  Introduction to scientific research , 1966 .

[24]  Ben Shneiderman,et al.  Designing the user interface - strategies for effective human-computer interaction, 3rd Edition , 1997 .

[25]  Judith S. Donath,et al.  PeopleGarden: creating data portraits for users , 1999, UIST '99.

[26]  Daniel A. Keim,et al.  Intelligent Visual Analytics Queries , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[27]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[28]  G. Niklas Norén,et al.  Temporal pattern discovery for trends and transient effects: its application to patient records , 2008, KDD.

[29]  Jeffrey P. Morrill Distributed recognition of patterns in time series data , 1998, CACM.

[30]  Michael D. Williams,et al.  RABBIT: An interface for database access , 1982, ACM '82.

[31]  Kevin McGee,et al.  Comic Strip Programs: Beyond Graphical Rewrite Rules , 2005, DMS.

[32]  Ben Shneiderman,et al.  Searching Electronic Health Records for Temporal Patterns in Patient Histories: A Case Study with Microsoft Amalga , 2008, AMIA.

[33]  Ben Shneiderman,et al.  Dynamic Query Tools for Time Series Data Sets: Timebox Widgets for Interactive Exploration , 2004, Inf. Vis..

[34]  Steven K. Feiner,et al.  Relaxed selection techniques for querying time-series graphs , 2009, UIST '09.

[35]  Janko Calic,et al.  Efficient Layout of Comic-Like Video Summaries , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Sanghyun Park,et al.  A multi-dimensional indexing approach for timestamped event sequence matching , 2007, Inf. Sci..

[37]  Tiziana Catarci,et al.  Visual query operators for temporal databases , 1997, Proceedings of TIME '97: 4th International Workshop on Temporal Representation and Reasoning.

[38]  Philip S. Yu,et al.  Indexing weighted-sequences in large databases , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[39]  Rajiv T. Maheswaran,et al.  Distributed coordination in uncertain multiagent systems , 2007, AAMAS '07.

[40]  Tiziana Catarci,et al.  Visualization of linear time-oriented data: a survey , 2000, Proceedings of the First International Conference on Web Information Systems Engineering.

[41]  Chunju Tseng,et al.  Visualization in law enforcement , 2005, DG.O.

[42]  Heidrun Schumann,et al.  Towards a conceptual framework for visual analytics of time and time-oriented data , 2007, 2007 Winter Simulation Conference.

[43]  Silvia Miksch,et al.  Connecting time-oriented data and information to a coherent interactive visualization , 2004, CHI.

[44]  Jun Rekimoto,et al.  Time-machine computing: a time-centric approach for the information environment , 1999, UIST '99.

[45]  David Kurlander,et al.  Chimera: example-based graphical editing , 1993 .

[46]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[47]  Giuseppe Psaila,et al.  Querying Shapes of Histories , 1995, VLDB.

[48]  Ben Shneiderman,et al.  Aligning temporal data by sentinel events: discovering patterns in electronic health records , 2008, CHI.

[49]  Ben Shneiderman,et al.  Interactive pattern search in time series , 2005, IS&T/SPIE Electronic Imaging.

[50]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction, 5 Edition , 2009 .

[51]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[52]  Stephen G. Eick,et al.  Displaying Trace Files , 1996, Softw. Pract. Exp..

[53]  Marian G. Williams,et al.  End Users and GIS , 2001, Your Wish is My Command.

[54]  Ben Shneiderman,et al.  Dynamic queries for visual information seeking , 1994, IEEE Software.

[55]  John Yen,et al.  Specification by Reformulation: A Paradigm for Building Integrated User Support Environments , 1988, AAAI.

[56]  Pat Hanrahan,et al.  Enhancing Visual Analysis of Network Traffic Using a Knowledge Representation , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[57]  Ben Shneiderman,et al.  A Visual Interface for Multivariate Temporal Data: Finding Patterns of Events across Multiple Histories , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[58]  Eamonn J. Keogh,et al.  Exact indexing of dynamic time warping , 2002, Knowledge and Information Systems.

[59]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[60]  Man Lung Yiu,et al.  Non-contiguous Sequence Pattern Queries , 2004, EDBT.

[61]  Elke A. Rundensteiner,et al.  A visual query language for identifying temporal trends in video data , 1995, Proceedings. International Workshop on Multi-Media Database Management Systems.