Generalized Non-metric Multidimensional Scaling

We consider the non-metric multidimensional scaling problem: given a set of dissimilarities ∆, find an embedding whose inter-point Euclidean distances have the same ordering as ∆. In this paper, we look at a generalization of this problem in which only a set of order relations of the form dij < dkl are provided. Unlike the original problem, these order relations can be contradictory and need not be specified for all pairs of dissimilarities. We argue that this setting is more natural in some experimental settings and propose an algorithm based on convex optimization techniques to solve this problem. We apply this algorithm to human subject data from a psychophysics experiment concerning how reflectance properties are perceived. We also look at the standard NMDS problem, where a dissimilarity matrix ∆ is provided as input, and show that we can always find an orderrespecting embedding of ∆.

[1]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[2]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. I. , 1962 .

[3]  J. Kruskal Nonmetric multidimensional scaling: A numerical method , 1964 .

[4]  J. Kruskal Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[5]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[6]  R. Forthofer,et al.  Rank Correlation Methods , 1981 .

[7]  R. Dykstra An Algorithm for Restricted Least Squares Regression , 1983 .

[8]  Shih-Ping Han,et al.  A successive projection method , 1988, Math. Program..

[9]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  M. Kendall,et al.  Rank Correlation Methods , 1949 .

[11]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[12]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[13]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[14]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[15]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[16]  Ivor W. Tsang,et al.  Distance metric learning with kernels , 2003 .

[17]  Thorsten Joachims,et al.  Learning a Distance Metric from Relative Comparisons , 2003, NIPS.

[18]  Stephen P. Boyd,et al.  Rank minimization and applications in system theory , 2004, Proceedings of the 2004 American Control Conference.

[19]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.