Visual Multiplexing

The majority of display devices used in visualization are 2D displays. Inevitably, it is often necessary to overlay one piece of visual information on top of another, especially in applications such as multi‐field visualization and geo‐spatial information visualization. In this paper, we present a conceptual framework for studying the mechanisms for overlaying multiple pieces of visual information while allowing users to recover occluded information. We adopt the term ‘multiplexing’ from tele‐ and data communication to encompass all such overlapping mechanisms. We establish 10 categories of visual multiplexing mechanisms. We draw support evidence from both perception literature and existing works in visualization to support this conceptual framework. We examine the relationships between multiplexing and information theoretic measures. This new conceptual categorization provides the much‐needed theory of visualization with an integral component.

[1]  T. Saito,et al.  Two-tone pseudo coloring: compact visualization for one-dimensional data , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[2]  B. E. Davis.  Gis a Visual Approach , 1996 .

[3]  Max J. Egenhofer,et al.  User Interfaces for Map Algebra , 1997 .

[4]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[5]  M. Sheelagh T. Carpendale,et al.  Bubble Sets: Revealing Set Relations with Isocontours over Existing Visualizations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[6]  Colin Ware,et al.  Designing a better weather display , 2013, Inf. Vis..

[7]  Min Chen,et al.  State of the Art Report on Video‐Based Graphics and Video Visualization , 2012, Comput. Graph. Forum.

[8]  Frederick P. Brooks,et al.  Multivariate data visualization with data-driven spots , 2003 .

[9]  G. Humphrey.  The Psychology of the Gestalt. , 1924 .

[10]  Emi Tanaka,et al.  Cortical dynamics of visual change detection based on sensory memory , 2010, NeuroImage.

[11]  D. Whitteridge.  Movements of the eyes R. H. S. Carpenter, Pion Ltd, London (1977), 420 pp., $27.00 , 1979, Neuroscience.

[12]  Robert S. Laramee,et al.  Asymmetric Tensor Field Visualization for Surfaces , 2011, IEEE Transactions on Visualization and Computer Graphics.

[13]  Mateu Sbert,et al.  Importance-Driven Focus of Attention , 2006, IEEE Transactions on Visualization and Computer Graphics.

[14]  James T. Enns,et al.  Large Datasets at a Glance: Combining Textures and Colors in Scientific Visualization , 1999, IEEE Trans. Vis. Comput. Graph..

[15]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[16]  ChenMin,et al.  Taxonomy-Based Glyph Design—with a Case Study on Visualizing Workflows of Biological Experiments , 2012 .

[17]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[18]  Jonathan E Campbell,et al.  Essentials of Geographic Information Systems , 2011 .

[19]  Jim Davies,et al.  Taxonomy-Based Glyph Design—with a Case Study on Visualizing Workflows of Biological Experiments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[20]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[21]  David H. Laidlaw,et al.  Visualizing diffusion tensor images of the mouse spinal cord , 1998 .

[22]  Niklas Elmqvist,et al.  Graphical Perception of Multiple Time Series , 2010, IEEE Transactions on Visualization and Computer Graphics.

[23]  Min Chen,et al.  An Information-theoretic Framework for Visualization , 2010, IEEE Transactions on Visualization and Computer Graphics.

[24]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[25]  Robert Michael Kirby,et al.  Visualizing multivalued data from 2D incompressible flows using concepts from painting , 1999, VIS '99.

[26]  Jonathan C. Roberts,et al.  Visual comparison for information visualization , 2011, Inf. Vis..

[27]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[28]  Alan M. MacEachren,et al.  How Maps Work - Representation, Visualization, and Design , 1995 .

[29]  Heidrun Schumann,et al.  A Design Space of Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[30]  John T. Stasko,et al.  Effectiveness of Animation in Trend Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[31]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[32]  Vivek Verma,et al.  Comparative flow visualization , 2004, IEEE Transactions on Visualization and Computer Graphics.

[33]  Min Chen,et al.  Temporal Visualization of Boundary‐based Geo‐information Using Radial Projection , 2011, Comput. Graph. Forum.

[34]  Maureen C. Stone,et al.  The Effect of Colour and Transparency on the Perception of Overlaid Grids , 2011, IEEE Transactions on Visualization and Computer Graphics.

[35]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[36]  D. Louis Collins,et al.  DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery , 2012, IEEE Transactions on Visualization and Computer Graphics.

[37]  Robert G. Bailey,et al.  Problems with using overlay mapping for planning and their implications for geographic information systems , 1988 .

[38]  Min Chen,et al.  Action-Based Multifield Video Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[39]  Jeffrey Heer,et al.  Animated Transitions in Statistical Data Graphics , 2007, IEEE Transactions on Visualization and Computer Graphics.

[40]  Michelle X. Zhou,et al.  Characterizing Users' Visual Analytic Activity for Insight Provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[41]  Christopher P Benton,et al.  The direction of measured face aftereffects. , 2008, Journal of vision.

[42]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[43]  J. Bransford,et al.  Abstraction of visual patterns. , 1971, Journal of experimental psychology.

[44]  Victoria Interrante,et al.  Weaving Versus Blending: a quantitative assessment of the information carrying capacities of two alternative methods for conveying multivariate data with color. , 2006, IEEE Transactions on Visualization and Computer Graphics.

[45]  Tobias Isenberg,et al.  Depth-Dependent Halos: Illustrative Rendering of Dense Line Data , 2009, IEEE Transactions on Visualization and Computer Graphics.

[46]  D. G. Tucker.  The early history of amplitude modulation, sidebands and frequency-division-multiplex , 1971 .

[47]  Jock D. Mackinlay,et al.  Cone Trees: animated 3D visualizations of hierarchical information , 1991, CHI.

[48]  Colin Ware,et al.  Motion coding for pattern detection , 2006, APGV '06.

[49]  Russell Taylor.  Visualizing Multiple Fields on the Same Surface , 2002, IEEE Computer Graphics and Applications.

[50]  William Stallings.  Wireless Communications and Networks , 2001 .

[51]  Carl-Fredrik Westin,et al.  Diffusion Tensor Visualization with Glyph Packing , 2006, IEEE Transactions on Visualization and Computer Graphics.

[52]  P. Kellman,et al.  Surface interpolation and 3D relatability. , 2008, Journal of vision.

[53]  Min Chen,et al.  Feature Aligned Volume Manipulation for Illustration and Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[54]  Colin Ware,et al.  Quantitative Texton Sequences for Legible Bivariate Maps , 2009, IEEE Transactions on Visualization and Computer Graphics.

[55]  Farhana Azim.  Design in Nature , 2014 .

[56]  Donald H. House,et al.  Grid With a View: Optimal Texturing for Perception of Layered Surface Shape , 2007, IEEE Transactions on Visualization and Computer Graphics.

[57]  L. R. Peterson,et al.  Short-term retention of individual verbal items. , 1959, Journal of experimental psychology.

[58]  Roger Crawfis,et al.  A scientific visualization synthesizer , 1991, Proceeding Visualization '91.

[59]  A D Baddeley,et al.  Short-term Memory for Word Sequences as a Function of Acoustic, Semantic and Formal Similarity , 1966, The Quarterly journal of experimental psychology.

[60]  Ennio Mingolla,et al.  Multiple mechanisms of illusory contour perception. , 2008, Journal of vision.

[61]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[62]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[63]  Evan M. Palmer,et al.  A theory of dynamic occluded and illusory object perception. , 2006, Journal of experimental psychology. General.

[64]  D Marr,et al.  Bandpass channels, zero-crossings, and early visual information processing. , 1979, Journal of the Optical Society of America.

[65]  Nancy Argüelles,et al.  Author ' s , 2008 .

[66]  R. Shepard.  Attention and the metric structure of the stimulus space. , 1964 .

[67]  Xiaoru Yuan,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Scalable Multivariate Volume Visualization and Analysis Based on Dimension Projection and Parallel Coordinates , 2022 .

[68]  David H. Laidlaw,et al.  Visualizing diffusion tensor images of the mouse spinal cord , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).