Chapter 3 – Multidimensional Scaling

Publisher Summary Multidimensional Scaling (MDS), a very important part of experimental psychology, is a technique which encompasses a geometrical model representing the data. The thrust of discussion in this chapter is on the link between MDS and its underpinnings resulting in the formation of new methodological developments in MDS, and the theory addressing important issues like the effect of a particular stimulus on spatial models. This has led to opening up of new discussions on the nature of the multidimensional stimulus space and its metrics. The three way algorithms are given more attention in comparison with two way algorithms and models. Spatial distance models form an integral part of the chapter. Applications and theoretical investigations of the Euclidean and Minkowski p Metrics (for One-Mode Two-Way Symmetric Data) is discussed at length precisely analyzing its various aspects. Understanding of visual displays and MDS Solutions focused around procrustes rotations, biplots, and visualization is an important part of the study. MDS has now been made a part of almost all statistical literature. Further research can bring about improvements and increase its acceptability.

[1]  Richard Degerman,et al.  Multidimensional analysis of complex structure: Mixtures of class and quantitative variation , 1970 .

[2]  J. Kruskal.  More factors than subjects, tests and treatments: An indeterminacy theorem for canonical decomposition and individual differences scaling , 1976 .

[3]  Paul E. Green,et al.  Multidimensional Scaling: Concepts and Applications , 1989 .

[4]  Jacques J. F. Commandeur,et al.  Orthogonal Procrustes rotation for matrices with missing values , 1993 .

[5]  J. Kruskal.  Analysis of Factorial Experiments by Estimating Monotone Transformations of the Data , 1965 .

[6]  Rashi Glazer,et al.  Cognitive Geometry: An Analysis of Structure Underlying Representations of Similarity , 1991 .

[7]  J. Ramsay,et al.  Analysis of pairwise preference data using integrated B-splines , 1981 .

[8]  P. Arabie,et al.  Mapclus: A mathematical programming approach to fitting the adclus model , 1980 .

[9]  Pieter M. Kroonenberg,et al.  Three-mode principal component analysis : theory and applications , 1983 .

[10]  George W. Furnas,et al.  The estimation of ultrametric and path length trees from rectangular proximity data , 1984 .

[11]  Yoshio Takane,et al.  Multidimensional scaling models for reaction times and same-different judgments , 1983 .

[12]  J. Gower.  Generalized procrustes analysis , 1975 .

[13]  W J Levelt,et al.  Triadic comparisons of musical intervals. , 1966, The British journal of mathematical and statistical psychology.

[14]  Naohito Chino,et al.  A GRAPHICAL TECHNIQUE FOR REPRESENTING THE ASYMMETRIC RELATIONSHIPS BETWEEN N OBJECTS , 1978 .

[15]  Willem J. Heiser,et al.  Constrained Multidimensional Scaling, Including Confirmation , 1983 .

[16]  R. Shepard.  The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[17]  Akinori Okada,et al.  Nonmetric Multidimensional Scaling of Asymmetric Proximities , 1987 .

[18]  S. C. Johnson.  Hierarchical clustering schemes , 1967, Psychometrika.

[19]  Lawrence Hubert,et al.  Combinatorial data analysis: Association and partial association , 1985 .

[20]  Herbert F. Weisberg,et al.  Dimensionland: An Excursion into Spaces , 1974 .

[21]  Willem J. Heiser,et al.  Models for asymmetric proximities , 1996 .

[22]  Willem J. Heiser,et al.  Analyzing rectangular tables by joint and constrained multidimensional scaling , 1983 .

[23]  Lawrence Hubert,et al.  Evaluating the symmetry of a proximity matrix , 1979 .

[24]  Patrick J. F. Groenen,et al.  The majorization approach to multidimensional scaling : some problems and extensions , 1993 .

[25]  Ajay K. Manrai,et al.  Tscale: A new multidimensional scaling procedure based on tversky's contrast model , 1992 .

[26]  Peter M. Bentler,et al.  Restricted multidimensional scaling models for asymmetric proximities , 1982 .

[27]  J. Carroll,et al.  Fitting of the Latent Class model via iteratively reweighted least squares CANDECOMP with nonnegativity constraints , 1989 .

[28]  Shizuhiko Nishisato,et al.  Gleaning in the field of dual scaling , 1996 .

[29]  E. Holman.  The relation between hierarchical and euclidean models for psychological distances , 1972 .

[30]  Willem J. Heiser,et al.  Analysis of asymmetry by a slide-vector , 1993 .

[31]  W. Torgerson.  Multidimensional scaling: I. Theory and method , 1952 .

[32]  Rudolf Mathar,et al.  Least Squares Multidimensional Scaling with Transformed Distances , 1996 .

[33]  L. Hubert.  Assignment methods in combinatorial data analysis , 1986 .

[34]  P. Arabie,et al.  Indclus: An individual differences generalization of the adclus model and the mapclus algorithm , 1983 .

[35]  Amos Tversky,et al.  On the relation between common and distinctive feature models , 1987 .

[36]  Jan de Leeuw,et al.  Correctness of Kruskal's algorithms for monotone regression with ties , 1977 .

[37]  J. W. Hutchinson.  Netscal: A network scaling algorithm for nonsymmetric proximity data , 1989 .

[38]  C. Coombs.  A theory of data. , 1965, Psychology Review.

[39]  Ingwer Borg,et al.  A direct approach to individual differences scaling using increasingly complex transformations , 1978 .

[40]  K. Shiina.  A maximum likelihood, nonmetric multidimensional scaling procedure for word sequences obtained in free-recall experiments , 1986 .

[41]  Y. Takane,et al.  A generalization of GIPSCAL for the analysis of nonsymmetric data , 1994 .

[42]  Takayuki Saito,et al.  ANALYSIS OF ASYMMETRIC PROXIMITY MATRIX BY A MODEL OF DISTANCE AND ADDITIVE TERMS , 1991 .

[43]  Wayne S. DeSarbo,et al.  Tree Representations of Rectangular Proximity Matrices , 1984 .

[44]  Sharon L. Weinberg,et al.  The Recovery of Structure in Linear and Ordinal Data: INDSCAL versus ALSCAL , 1993 .

[45]  J. Ramsay.  Monotonic weighted power transformations to additivity , 1977 .

[46]  João A. Branco,et al.  Multidimensional scaling for n-tuples , 1991 .

[47]  P. Groenen,et al.  The majorization approach to multidimensional scaling for Minkowski distances , 1995 .

[48]  R. Mcdonald.  A note on monotone polygons fitted to bivariate data , 1976 .

[49]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[50]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[51]  A. Tversky,et al.  Additive similarity trees , 1977 .

[52]  J. Ramsay.  Maximum likelihood estimation in multidimensional scaling , 1977 .

[53]  R. Shepard.  Representation of structure in similarity data: Problems and prospects , 1974 .

[54]  J. Ramsay.  Monotone Regression Splines in Action , 1988 .

[55]  L. Hubert.  Generalized proximity function comparisons , 1978 .

[56]  G. N. Lance,et al.  A General Theory of Classificatory Sorting Strategies: 1. Hierarchical Systems , 1967, Comput. J..

[57]  J. Hartigan.  REPRESENTATION OF SIMILARITY MATRICES BY TREES , 1967 .

[58]  H. D. Brunk,et al.  AN EMPIRICAL DISTRIBUTION FUNCTION FOR SAMPLING WITH INCOMPLETE INFORMATION , 1955 .

[59]  L. Hubert,et al.  Confirmatory inference and geometric models. , 1979 .

[60]  James E. Corter,et al.  A graph-theoretic method for organizing overlapping clusters into trees, multiple trees, or extended trees , 1995 .

[61]  Sandra Pruzansky,et al.  Representing Proximities Data by Discrete, Continuous or “Hybrid” Models , 1983 .

[62]  Phipps Arabie,et al.  Was euclid an unnecessarily sophisticated psychologist? , 1991 .

[63]  Yoshio Takane,et al.  Nonmetric maximum likelihood multidimensional scaling from directional rankings of similarities , 1981 .

[64]  P. Arabie,et al.  Overlapping Clustering: A New Method for Product Positioning , 1981 .

[65]  Karl Christoph Klauer,et al.  A comparison of two approaches to fitting directed graphs to nonsymmetric proximity measures , 1991 .

[66]  Michael Greenacre,et al.  Unfolding a symmetric matrix , 1996 .

[67]  Shizuhiko Nishisato,et al.  Elements of Dual Scaling: An Introduction To Practical Data Analysis , 1993 .

[68]  J. Douglas Carroll,et al.  Toward a new paradigm for the study of multiattribute choice behavior: Spatial and discrete modeling of pairwise preferences. , 1991 .

[69]  Terence J. G. Tracey,et al.  Prediger's dimensional representation of Holland's RIASEC circumplex. , 1993 .

[70]  J. Ramsay.  Confidence regions for multidimensional scaling analysis , 1978 .

[71]  Forrest W. Young,et al.  Nonmetric individual differences multidimensional scaling: An alternating least squares method with optimal scaling features , 1977 .

[72]  J. Carroll,et al.  Chapter 12 – MULTIDIMENSIONAL PERCEPTUAL MODELS AND MEASUREMENT METHODS , 1974 .

[73]  J. Meulman.  The integration of multidimensional scaling and multivariate analysis with optimal transformations , 1992 .

[74]  George W. Furnas,et al.  Metric family portraits , 1989 .

[75]  Kevin F. Miller,et al.  Geometric Methods in Developmental Research , 1987 .

[76]  R. Clarke,et al.  Theory and Applications of Correspondence Analysis , 1985 .

[77]  Points of view analysis revisited: Fitting multidimensional structures to optimal distance components with cluster restrictions on the variables , 1993 .

[78]  L. Hubert,et al.  Evaluating order hypotheses within proximity matrices. , 1987 .

[79]  Phipps Arabie,et al.  Concerning Monte Carlo evaluations of nonmetric multidimensional scaling algorithms , 1973 .

[80]  J. Berge,et al.  Generalized approaches to the maxbet problem and the maxdiff problem, with applications to canonical correlations , 1988 .

[81]  Reginald G. Golledge,et al.  A heuristic method for the comparison of related structures , 1981 .

[82]  F ATTNEAVE,et al.  Dimensions of similarity. , 1950, The American journal of psychology.

[83]  C. Cuadras,et al.  Representation of Statistical Structures, Classification and Prediction Using Multidimensional Scaling , 1996 .

[84]  J. Carroll,et al.  Spatial, non-spatial and hybrid models for scaling , 1976 .

[85]  Kenneth Mullen,et al.  A multidimensional stochastic theory of similiarity , 1988 .

[86]  Ajay K. Manrai,et al.  A New Multidimensional Scaling Methodology for the Analysis of Asymmetric Proximity Data in Marketing Research , 1992 .

[87]  L. Hubert,et al.  Multidimensional scaling in the city-block metric: A combinatorial approach , 1992 .

[88]  J. Kruskal.  Nonmetric multidimensional scaling: A numerical method , 1964 .

[89]  J. Ramsay.  Some Statistical Approaches to Multidimensional Scaling Data , 1982 .

[90]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[91]  J. Berge,et al.  Perceptual Mapping Based on Idiosyncratic Sets of Attributes , 1994 .

[92]  Lawrence Hubert,et al.  Combinatorial data analysis: Confirmatory comparisons between sets of matrices , 1989 .

[93]  Naohito Chino,et al.  A GENERALIZED INNER PRODUCT MODEL FOR THE ANALYSIS OF ASYMMETRY , 1990 .

[94]  Terence J. G. Tracey,et al.  Evaluating Holland's and Gati's Vocational-Interest Models: A Structural Meta-Analysis , 1993 .

[95]  P. Duncombe,et al.  Multivariate Descriptive Statistical Analysis: Correspondence Analysis and Related Techniques for Large Matrices , 1985 .

[96]  Willem J. Heiser,et al.  13 Theory of multidimensional scaling , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[97]  Geert De Soete,et al.  Tree and other network models for representing proximity data , 1996 .

[98]  Moonja P. Kim,et al.  The Method of Sorting as a Data-Gathering Procedure in Multivariate Research. , 1975, Multivariate behavioral research.

[99]  A D Gordon,et al.  The construction and assessment of mental maps. , 1989, The British journal of mathematical and statistical psychology.

[100]  A. Tversky,et al.  Spatial versus tree representations of proximity data , 1982 .

[101]  Willem J. Heiser,et al.  Order Invariant Unfolding Analysis Under Smoothness Restrictions , 1989 .

[102]  L. Hubert,et al.  Correspondence analysis and optimal structural representations , 1992 .

[103]  M. P. Friedman,et al.  HANDBOOK OF PERCEPTION , 1977 .

[104]  Suzanne Winsberg,et al.  Monotone spline transformations for dimension reduction , 1983 .

[105]  R. M. Johnson,et al.  A simple method for pairwise monotone regression , 1975 .

[106]  J. Douglas Carroll,et al.  An equivalence relation between correspondence analysis and classical metric multidimensional scaling for the recovery of Euclidean distances , 1997 .

[107]  M. Hill,et al.  NONLINEAR MULTIVARIATE ANALYSIS , 1990 .

[108]  W. Heiser.  A generalized majorization method for least souares multidimensional scaling of pseudodistances that may be negative , 1991 .

[109]  J. Leeuw,et al.  Principal component analysis of three-mode data by means of alternating least squares algorithms , 1980 .

[110]  Yoshio Takane.  MDSORT: A special-purpose multidimensional scaling program for sorting data , 1981 .

[111]  Shizuhiko Nishisato,et al.  An Overview and Recent Developments in Dual Scaling , 1996 .

[112]  Yoshio Takane,et al.  THE METHOD OF TRIADIC COMBINATIONS: A NEW TREATMENT AND ITS APPLICATION , 1982 .

[113]  G. Furnas,et al.  Pictures of relevance: a geometric analysis of similarity measures , 1987 .

[114]  L. Hubert,et al.  Quadratic assignment as a general data analysis strategy. , 1976 .

[115]  Wayne S. DeSarbo,et al.  Three-Way Multivariate Conjoint Analysis , 1982 .

[116]  John C. Gower,et al.  A general theory of biplots , 1995 .

[117]  Phipps Arabie,et al.  AN OVERVIEW OF COMBINATORIAL DATA ANALYSIS , 1996 .

[118]  L. Hubert,et al.  The approximation of two-mode proximity matrices by sums of order-constrained matrices , 1995 .

[119]  W. Heiser,et al.  Nonlinear Biplots for Nonlinear Mappings , 1993 .

[120]  Roger N. Shepard,et al.  Additive clustering: Representation of similarities as combinations of discrete overlapping properties. , 1979 .

[121]  R. Shepard.  Attention and the metric structure of the stimulus space. , 1964 .

[122]  Dirk L. Knol,et al.  Orthogonal rotations to maximal agreement for two or more matrices of different column orders , 1984 .

[123]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[124]  J. Douglas Carroll,et al.  Multidimensional Scaling: An Overview with Applications in Educational Research , 1992 .

[125]  E. Holman.  Completely nonmetric multidimensional scaling , 1978 .

[126]  Boris Mirkin,et al.  Mathematical Classification and Clustering , 1996 .

[127]  Nonmetric Method for Extended Indscal Model , 1980 .

[128]  John C. Gower,et al.  Orthogonal and projection procrustes analysis , 1995 .

[129]  Joseph B. Keller,et al.  Factorization of matrices by least-squares , 1962 .

[130]  Roger N. Shepard,et al.  Toward a Universal Law of Generalization , 1988, Science.

[131]  J. Douglas Carroll,et al.  Chapter 13 – APPLICATIONS OF INDIVIDUAL DIFFERENCES SCALING TO STUDIES OF HUMAN PERCEPTION AND JUDGMENT , 1974 .

[132]  K. Gabriel,et al.  The biplot graphic display of matrices with application to principal component analysis , 1971 .

[133]  Michael Greenacre,et al.  An efficient alternating least-squares algorithm to perform multidimensional unfolding , 1986 .

[134]  Lee G. Cooper,et al.  Market-Share Analysis , 1988 .

[135]  Geert De Soete,et al.  Ultrametric tree representations of three-way three-mode data , 1989 .

[136]  R. Nosofsky.  Similarity Scaling and Cognitive Process Models , 1992 .

[137]  Suzanne Winsberg,et al.  Fitting an extended INDSCAL model to three-way proximity data , 1995 .

[138]  Bernard Fichet,et al.  Dimensionality problems in L 1 -norm representations , 1994 .

[139]  A. Tellegen,et al.  Occupational interests, leisure time interests and personality: Three domains or one? Findings from the Minnesota Twin Registry: New concepts, methods, and findings , 1995 .

[140]  L. Tucker.  Relations between multidimensional scaling and three-mode factor analysis , 1972 .

[141]  Forrest W. Young.  Methods for describing ordinal data with cardinal models , 1975 .

[142]  L. M. Blumenthal,et al.  Studies in geometry , 1972 .

[143]  A new multidimensional scaling technique based upon associations of triple objects—Pijk and its application to the analysis of geochemical data , 1991 .

[144]  L. Hubert,et al.  Multidimensional Scaling: Some Possibilities for Counseling Psychology. , 1987 .

[145]  Henk A. L. Kiers,et al.  Majorization as a tool for optimizing a class of matrix functions , 1990 .

[146]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[147]  Sharon L. Weinberg,et al.  Confidence regions for INDSCAL using the jackknife and bootstrap techniques , 1984 .

[148]  James O. Ramsay,et al.  Some small sample results for maximum likelihood estimation in multidimensional scaling , 1980 .

[149]  R. MacCallum,et al.  Effects of conditionality on INDSCAL and ALSCAL weights , 1977 .

[150]  W. Tobler.  Estimation of Attractivities from Interactions , 1979 .

[151]  W. DeSarbo,et al.  The representation of three-way proximity data by single and multiple tree structure models , 1984 .

[152]  F. Rohlf,et al.  Extensions of the Procrustes Method for the Optimal Superimposition of Landmarks , 1990 .

[153]  V. Srinivasan,et al.  Linear Programming Computational Procedures for Ordinal Regression , 1976, J. ACM.

[154]  W. DeSarbo,et al.  Three-way metric unfolding via alternating weighted least squares , 1985 .

[155]  Akinori Okada,et al.  Asymmetric multidimensional scaling of two-mode three-way proximities , 1997 .

[156]  P. Bentler,et al.  Functional relations in multidimensional scaling , 1980 .

[157]  R. Shanmugam.  Multivariate Analysis: Part 1: Distributions, Ordination and Inference , 1994 .

[158]  Jan de Leeuw,et al.  A special Jackknife for Multidimensional Scaling , 1986 .

[159]  J. Ramsay.  MULTISCALE: A Multidimensional Scaling Program , 1983 .

[160]  W. DeSarbo.  Gennclus: New models for general nonhierarchical clustering analysis , 1982 .

[161]  J. Douglas Carroll,et al.  A quasi-nonmetric method for multidimensional scaling VIA an extended euclidean model , 1989 .

[162]  Wilhelmus Petrus Krijnen,et al.  The analysis of three-way arrays by constrained parafac methods , 1993 .

[163]  Wayne S. DeSarbo,et al.  Three-Way Metric Unfolding , 1981 .

[164]  Frank Critchley,et al.  The partial order by inclusion of the principal classes of dissimilarity on a finite set, and some of their basic properties , 1994 .

[165]  Lawrence Hubert,et al.  Linear and circular unidimensional scaling for symmetric proximity matrices , 1997 .

[166]  J. Leeuw.  Convergence of the majorization method for multidimensional scaling , 1988 .

[167]  Keith T. Poole.  Least squares metric, unidimensional scaling of multivariate linear models , 1990 .

[168]  J. Carroll,et al.  An alternating combinatorial optimization approach to fitting the INDCLUS and generalized INDCLUS models , 1994 .

[169]  Bruce Bloxom,et al.  Constrained multidimensional scaling inN spaces , 1978 .

[170]  Akinori Okada,et al.  A Generalization of Asymmetric Multidimensional Scaling , 1990 .

[171]  R. Nosofsky.  Stimulus bias, asymmetric similarity, and classification , 1991, Cognitive Psychology.

[172]  J. Gower.  Some distance properties of latent root and vector methods used in multivariate analysis , 1966 .

[173]  V. Pliner.  Metric unidimensional scaling and global optimization , 1996 .

[174]  L. Hubert,et al.  Iterative projection strategies for the least-squares fitting of tree structures to proximity data , 1995 .

[175]  Roger N. Shepard,et al.  Multidimensional scaling : theory and applications in the behavioral sciences , 1974 .

[176]  S. Joly,et al.  Three-way distances , 1995 .

[177]  Phipps Arabie,et al.  Three-way scaling and clustering. , 1987 .

[178]  J. Gower.  Three-dimensional biplots , 1990 .

[179]  J. Berge,et al.  Orthogonal procrustes rotation for two or more matrices , 1977 .

[180]  Lawrence Hubert,et al.  The analysis of proximity matrices through sums of matrices having (anti‐)Robinson forms , 1994 .

[181]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[182]  A. Tversky.  Features of Similarity , 1977 .

[183]  Yoshio Takane,et al.  IDEAL POINT DISCRIMINANT ANALYSIS AND ORDERED RESPONSE CATEGORIES , 1989 .

[184]  G. Soete.  A least squares algorithm for fitting additive trees to proximity data , 1983 .

[185]  Karl Christoph Klauer,et al.  A mathematical programming approach to fitting general graphs , 1989 .

[186]  Gregory Ashby,et al.  On the Dangers of Averaging Across Subjects When Using Multidimensional Scaling or the Similarity-Choice Model , 1994 .

[187]  Boris Mirkin,et al.  CLUSTERING AND MULTIDIMENSIONAL SCALING IN RUSSIA (1960–1990): A REVIEW , 1996 .

[188]  J. Gower,et al.  The interpretation of Generalized Procrustes Analysis and allied methods , 1991 .

[189]  E. Holman.  Monotonic models for asymmetric proximities , 1979 .

[190]  Takayuki Saito,et al.  MULTIDIMENSIONAL SCALING OF ASYMMETRIC PROXIMITY: MODEL AND METHOD , 1990 .

[191]  J. Ramsay,et al.  Monotonic transformations to additivity using splines , 1980 .

[192]  S. S. Stevens,et al.  A neural quantum in sensory discrimination. , 1972, Science.

[193]  J. Daws.  The analysis of free-sorting data: Beyond pairwise cooccurrences , 1996 .

[194]  C. Krumhansl.  Concerning the Applicability of Geometric Models to Similarity Data : The Interrelationship Between Similarity and Spatial Density , 2005 .

[195]  W. Heiser.  Joint Ordination of Species and Sites: The Unfolding Technique , 1987 .

[196]  J. Berge,et al.  Minimization of a class of matrix trace functions by means of refined majorization , 1992 .

[197]  L. Guttman.  A general nonmetric technique for finding the smallest coordinate space for a configuration of points , 1968 .

[198]  R W Rodieck,et al.  Metric of color borders. , 1977, Science.

[199]  L. Hubert,et al.  Methods for Evaluating Vocational Interest Structural Hypotheses. , 1992 .

[200]  Henry E. Brady.  Statistical consistency and hypothesis testing for nonmetric multidimensional scaling , 1985 .

[201]  A. Tversky,et al.  Extended similarity trees , 1986 .

[202]  Y. Takane,et al.  Ideal point discriminant analysis , 1987 .

[203]  Berrie Zielman,et al.  Directional Analysis of Three-Way Skew-Symmetric Matrices , 1993 .

[204]  Tarow Indow,et al.  An approach to geometry of visual space with no a priori mapping functions: Multidimensional mapping according to Riemannian metrics , 1982 .

[205]  R. M. Boynton,et al.  A line, not a space, represents visual distinctness of borders formed by different colors. , 1976, Science.