The Role of Latency and Task Complexity in Predicting Visual Search Behavior

Latency in a visualization system is widely believed to affect user behavior in measurable ways, such as requiring the user to wait for the visualization system to respond, leading to interruption of the analytic flow. While this effect is frequently observed and widely accepted, precisely how latency affects different analysis scenarios is less well understood. In this paper, we examine the role of latency in the context of visual search, an essential task in data foraging and exploration using visualization. We conduct a series of studies on Amazon Mechanical Turk and find that under certain conditions, latency is a statistically significant predictor of visual search behavior, which is consistent with previous studies. However, our results also suggest that task type, task complexity, and other factors can modulate the effect of latency, in some cases rendering latency statistically insignificant in predicting user behavior. This suggests a more nuanced view of the role of latency than previously reported. Building on these results and the findings of prior studies, we propose design guidelines for measuring and interpreting the effects of latency when evaluating performance on visual search tasks.

[1]  Steven Franconeri,et al.  Ranking Visualizations of Correlation Using Weber's Law , 2014, IEEE Transactions on Visualization and Computer Graphics.

[2]  Jock D. Mackinlay,et al.  The information visualizer, an information workspace , 1991, CHI.

[3]  Ethan V. Munson,et al.  40 Years of Searching for the Best Computer System Response Time , 2011, Interact. Comput..

[4]  Anoop Gupta,et al.  In the blink of an eye: investigating latency perception during stylus interaction , 2014, CHI.

[5]  Jeffrey Heer,et al.  Falcon: Balancing Interactive Latency and Resolution Sensitivity for Scalable Linked Visualizations , 2019, CHI.

[6]  Leilani Battle,et al.  Characterizing Exploratory Visual Analysis: A Literature Review and Evaluation of Analytic Provenance in Tableau , 2019, Comput. Graph. Forum.

[7]  D. Firth Bias reduction of maximum likelihood estimates , 1993 .

[8]  Christina Freytag,et al.  Designing And Engineering Time The Psychology Of Time Perception In Software , 2016 .

[9]  Michael Stonebraker,et al.  Position statement: The case for a visualization performance benchmark , 2017, 2017 IEEE Workshop on Data Systems for Interactive Analysis (DSIA).

[10]  Michael Stonebraker,et al.  Dynamic Prefetching of Data Tiles for Interactive Visualization , 2016, SIGMOD Conference.

[11]  Stephen A. Brewster,et al.  Towards the Temporally Perfect Virtual Button: Touch-Feedback Simultaneity and Perceived Quality in Mobile Touchscreen Press Interactions , 2014, TAP.

[12]  Jeffrey Heer,et al.  Beyond Weber's Law: A Second Look at Ranking Visualizations of Correlation , 2016, IEEE Transactions on Visualization and Computer Graphics.

[13]  Ben Shneiderman,et al.  Response time and display rate in human performance with computers , 1984, CSUR.

[14]  Mitchell Grossberg,et al.  An Experiment on Problem Solving with Delayed Computer Responses , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[15]  Carsten Binnig,et al.  Evaluating Visual Data Analysis Systems: A Discussion Report , 2018, HILDA@SIGMOD.

[16]  Rina A. Doherty,et al.  Keeping Users in the Flow: Mapping System Responsiveness with User Experience☆ , 2015 .

[17]  Alex Endert,et al.  Finding Waldo: Learning about Users from their Interactions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[18]  Jeffrey Heer,et al.  imMens: Real‐time Visual Querying of Big Data , 2013, Comput. Graph. Forum.

[19]  Tim Kraska,et al.  How Progressive Visualizations Affect Exploratory Analysis , 2017, IEEE Transactions on Visualization and Computer Graphics.

[20]  Robert B. Miller,et al.  Response time in man-computer conversational transactions , 1899, AFIPS Fall Joint Computing Conference.

[21]  Robert S. Allison,et al.  Tolerance of temporal delay in virtual environments , 2001, Proceedings IEEE Virtual Reality 2001.

[22]  Desney S. Tan,et al.  Benevolent deception in human computer interaction , 2013, CHI.

[23]  Mahadev Satyanarayanan,et al.  Quantifying interactive user experience on thin clients , 2006, Computer.

[24]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[25]  Daniel J. Wigdor,et al.  How fast is fast enough?: a study of the effects of latency in direct-touch pointing tasks , 2013, CHI.

[26]  Monica M. C. Schraefel,et al.  Trust me, i'm partially right: incremental visualization lets analysts explore large datasets faster , 2012, CHI.

[27]  Thomas J. Goodman,et al.  The effect of System Response Time on interactive computer aided problem solving , 1978, SIGGRAPH.

[28]  Colin Ware,et al.  Visual Thinking for Design , 2008 .

[29]  Carlos Eduardo Scheidegger,et al.  Nanocubes for Real-Time Exploration of Spatiotemporal Datasets , 2013, IEEE Transactions on Visualization and Computer Graphics.

[30]  Jeffrey Heer,et al.  The Effects of Interactive Latency on Exploratory Visual Analysis , 2014, IEEE Transactions on Visualization and Computer Graphics.

[31]  Zhiquan Yeo,et al.  Faster progress bars: manipulating perceived duration with visual augmentations , 2010, CHI.

[32]  Robert Bell,et al.  Rethinking the progress bar , 2007, UIST.