Psychological approaches to data visualisation

Abstract : The aim of data visualization is to display a body of information in a way which allows accurate and effortless human comprehension and analysis. Accordingly, the development of data visualization techniques should be constrained by an understanding of both human perception and cognition. This report develops and examines a psychological framework for the development of data visualization techniques based on the notion of similarity structure modelling. Through a series of case studies, a range of established approaches to data visualization is reviewed and evaluated within this framework, and a number of suggestions for the development of new techniques is made.

[1]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[2]  J. Lackner,et al.  The Psychological Representation of Speech Sounds , 1975, The Quarterly journal of experimental psychology.

[3]  R. Nosofsky.  American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[4]  Roger N. Shepard,et al.  Additive clustering: Representation of similarities as combinations of discrete overlapping properties. , 1979 .

[5]  R N Shepard,et al.  Multidimensional Scaling, Tree-Fitting, and Clustering , 1980, Science.

[6]  Patrick van der Smagt,et al.  Introduction to neural networks , 1995, The Lancet.

[7]  Jeanny Hérault,et al.  Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets , 1997, IEEE Trans. Neural Networks.

[8]  Georges G. Grinstein,et al.  Describing visual interactions to the database: closing the loop between user and data , 1996, Electronic Imaging.

[9]  J. Freyd.  Dynamic mental representations. , 1987, Psychological review.

[10]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[11]  Jean-Marc Nerson,et al.  Object-Oriented Analysis and Design , 1992, TOOLS.

[12]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[13]  R. Shepard.  The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[14]  H. Ritter,et al.  Self-organizing maps for internal representations , 1990, Psychological research.

[15]  Herman Chernoff,et al.  The Use of Faces to Represent Points in k- Dimensional Space Graphically , 1973 .

[16]  Michael D. Lee,et al.  Towards a dynamic connectionist model of memory , 1997, Behavioral and Brain Sciences.

[17]  A. Clark.  Philosophical issues in brain theory and connectionism , 1998 .

[18]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[19]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[20]  W Richards,et al.  Trajectory Mapping: A New Nonmetric Scaling Technique , 1995, Perception.

[21]  T. Cox,et al.  Multidimensional scaling on a sphere , 1991 .

[22]  A. Tversky.  Features of Similarity , 1977 .

[23]  Sougata Mukherjea,et al.  Glyphmaker: creating customized visualizations of complex data , 1994, Computer.

[24]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[25]  A. Tversky,et al.  Representations of qualitative and quantitative dimensions. , 1982, Journal of experimental psychology. Human perception and performance.

[26]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[27]  D. Vickers.  Decision processes in visual perception , 1979 .

[28]  R. Shepard.  The analysis of proximities: Multidimensional scaling with an unknown distance function. I. , 1962 .

[29]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[30]  J. W. Hutchinson,et al.  Nearest neighbor analysis of psychological spaces. , 1986 .

[31]  M. C. Escher,et al.  The Graphic Work , 1994 .

[32]  Adrian Cussins,et al.  The Connectionist Construction of Concepts , 1990, The Philosophy of Artificial Intelligence.

[33]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[34]  R. Shepard.  Representation of structure in similarity data: Problems and prospects , 1974 .

[35]  Jock D. Mackinlay.  Automatic design of graphical presentations , 1987 .

[36]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[37]  Matthew Chalmers,et al.  Domesticating Bead: adapting an information visualization system to a financial institution , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[38]  Douglas Stott Parker.  Aesthetics-Based Graph Layout for Human Consumption , 1996, Softw. Pract. Exp..

[39]  Joshua B. Tenenbaum,et al.  Learning the Structure of Similarity , 1995, NIPS.

[40]  D. Hofstadter.  Metamagical Themas: Questing for the Essence of Mind and Pattern , 1985 .

[41]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[42]  M. Leyton.  Symmetry, Causality, Mind , 1999 .

[43]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[44]  Edward E. Smith.  Concepts and induction , 1989 .

[45]  M Damashek,et al.  Gauging Similarity with n-Grams: Language-Independent Categorization of Text , 1995, Science.

[46]  Stephen M. Kosslyn,et al.  Elements of graph design , 1993 .

[47]  L. Komatsu.  Recent views of conceptual structure , 1992 .

[48]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[49]  E. Rothkopf.  A measure of stimulus similarity and errors in some paired-associate learning tasks. , 1957, Journal of experimental psychology.

[50]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[51]  T. Caelli,et al.  Constant curvature Riemannian scaling , 1978 .

[52]  David E. Rumelhart,et al.  The architecture of mind: a connectionist approach , 1989 .

[53]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[54]  Stephen A. Gilbert,et al.  Structuring information with mental models: a tour of Boston , 1996, CHI.

[55]  Michael D. Lee,et al.  The Connectionist Construction of Psychological Spaces , 1997, Connect. Sci..

[56]  A. Grafstein.  MIT Encyclopedia of the Cognitive Sciences , 2000 .

[57]  M. Lee.  An Extraction and Regularization Approach to Additive Clustering , 1999 .

[58]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988, Journal of experimental psychology. General.

[59]  Alan L. Yuille,et al.  Constrained optimization and the elastic net , 1998 .

[60]  R. Shepard.  Ecological constraints on internal representation: resonant kinematics of perceiving, imagining, thinking, and dreaming. , 1984, Psychological review.

[61]  Wilbur Schramm,et al.  How accurately are different kinds of graphs read? , 1954 .

[62]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[63]  R. Shepard.  Integrality versus separability of stimulus dimensions: From an early convergence of evidence to a p , 1991 .

[64]  Stephan Lewandowsky,et al.  Visual detection of clusters in statistical maps , 1996 .

[65]  Michael D. Lee,et al.  Neural Feature Abstraction from Judgments of Similarity , 1998, Neural Computation.

[66]  R. Nosofsky.  Similarity Scaling and Cognitive Process Models , 1992 .

[67]  William M. Smith,et al.  A Study of Thinking , 1956 .

[68]  S. Lewandowsky,et al.  Discriminating strata in scatterplots , 1989 .

[69]  Anil K. Jain,et al.  Artificial neural networks for feature extraction and multivariate data projection , 1995, IEEE Trans. Neural Networks.

[70]  Arthur Flexer,et al.  Limitations of Self-organizing Maps for Vector Quantization and Multidimensional Scaling , 1996, NIPS.

[71]  W. R. Garner.  The Processing of Information and Structure , 1974 .

[72]  Jonathan D. Cohen,et al.  Drawing graphs to convey proximity: an incremental arrangement method , 1997, TCHI.

[73]  R. Shepard.  Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space , 1957 .

[74]  Roger N. Shepard,et al.  The perceptual organization of colors: An adaptation to regularities of the terrestrial world? , 1992 .

[75]  P. Churchland.  A neurocomputational perspective , 1989 .

[76]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[77]  R. Shepard,et al.  Psychologically simple motions as geodesic paths. part I. Asymmetric objects , 1990 .

[78]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[79]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[80]  Alexander J. Smola,et al.  Neural Information Processing Systems , 1997, NIPS 1997.

[81]  D L Medin,et al.  Concepts and conceptual structure. , 1989, The American psychologist.

[82]  S. Lewandowsky,et al.  Displaying proportions and percentages , 1991 .

[83]  Robert McGill,et al.  Graphical Perception: The Visual Decoding of Quantitative Information on Graphical Displays of Data , 1987 .

[84]  H. Charles Romesburg,et al.  Cluster analysis for researchers , 1984 .

[85]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[86]  David Travis,et al.  Effective Color Displays: Theory and Practice , 1991 .

[87]  B. Mirkin.  Additive clustering and qualitative factor analysis methods for similarity matrices , 1989 .

[88]  Andrew R. Webb,et al.  Multidimensional scaling by iterative majorization using radial basis functions , 1995, Pattern Recognit..

[89]  Roger N. Shepard,et al.  Maximum Entropy Inference and Stimulus Generalization , 1996 .

[90]  J. Fodor.  Psychosemantics: The Problem of Meaning in the Philosophy of Mind , 1988 .

[91]  Robert L. Goldstone.  Similarity, interactive activation, and mapping , 1994 .

[92]  Geoffrey E. Hinton,et al.  Schemata and Sequential Thought Processes in PDP Models , 1986 .

[93]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[94]  Steven Todd,et al.  Three-Dimensional Displays: Perception, Implementation, and Applications , 1989 .

[95]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[96]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[97]  P. Arabie,et al.  Mapclus: A mathematical programming approach to fitting the adclus model , 1980 .

[98]  G E Legge,et al.  Efficiency of graphical perception , 1991, Perception & psychophysics.

[99]  David K. Simkin,et al.  An Information-Processing Analysis of Graph Perception , 1987 .

[100]  James Martin,et al.  Object-oriented analysis and design , 1992 .

[101]  D J Willshaw,et al.  An evaluation of the use of multidimensional scaling for understanding brain connectivity. , 1995, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[102]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[103]  Paul Slovic,et al.  Graphic Representation of Judgmental Information , 1986, SGCH.

[104]  John M. Chambers,et al.  Graphical Methods for Data Analysis , 1983 .

[105]  R. Shepard,et al.  The internal representation of numbers , 1975, Cognitive Psychology.

[106]  J. Carroll,et al.  An alternating combinatorial optimization approach to fitting the INDCLUS and generalized INDCLUS models , 1994 .

[107]  A. Tversky,et al.  Additive similarity trees , 1977 .

[108]  Multidimensional differences in public and academic perceptions of nations. , 1967, Journal of personality and social psychology.

[109]  P. Smolensky.  On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[110]  J. R. Pomerantz,et al.  The Perception of Structure: Essays in Honor of Wendell R. Garner , 1991 .

[111]  R. Wille.  Concept lattices and conceptual knowledge systems , 1992 .

[112]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[113]  I. Borg.  Multidimensional similarity structure analysis , 1987 .

[114]  P. Bentler,et al.  A comparison of two latent variable causal models for adolescent drug use. , 1981, Journal of personality and social psychology.

[115]  D. Cohen.  Visual detection and perceptual independence: Assessing color and form , 1997, Perception & psychophysics.

[116]  John C. Baird,et al.  Psychophysical analysis of visual space , 1974 .

[117]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[118]  H. Chernoff,et al.  Effect on Classification Error of Random Permutations of Features in Representing Multivariate Data by Faces , 1975 .