A Fast Matrix Majorization-Projection Method for Penalized Stress Minimization With Box Constraints

Kruskal's stress minimization, though nonconvex and nonsmooth, has been a major computational model for dissimilarity data in multidimensional scaling. Semidefinite programming (SDP) relaxation (by dropping the rank constraint) would lead to a high number of SDP cone constraints. This has rendered the SDP approach computationally challenging even for problems of small size. In this paper, we reformulate the stress optimization as an Euclidean distance matrix (EDM) optimization with box constraints. A key element in our approach is the conditional positive-semidefinite cone with rank cut. Although nonconvex, this geometric object allows a fast computation of the projection onto it, and it naturally leads to a majorization-minimization algorithm with the minimization step having a closed-form solution. Moreover, we prove that our EDM optimization follows a continuously differentiable path, which greatly facilitated the analysis of the convergence to a stationary point. The superior performance of the proposed algorithm is demonstrated against some of the state-of-the-art solvers in the field of sensor network localization and molecular conformation.

[1]  A. Householder,et al.  Discussion of a set of points in terms of their mutual distances , 1938 .

[2]  Alexander M. Bronstein,et al.  Fast Multidimensional Scaling using Vector Extrapolation , 2008 .

[3]  Xiaoming Yuan,et al.  Computing the nearest Euclidean distance matrix with low embedding dimensions , 2014, Math. Program..

[4]  Ying Zhang,et al.  Localization from mere connectivity , 2003, MobiHoc '03.

[5]  Patrick Mair,et al.  Multidimensional Scaling Using Majorization: SMACOF in R , 2008 .

[6]  Xiaoming Yuan,et al.  A Lagrangian Dual Approach to the Single-Source Localization Problem , 2013, IEEE Transactions on Signal Processing.

[7]  Martin Vetterli,et al.  Euclidean Distance Matrices: Essential theory, algorithms, and applications , 2015, IEEE Signal Processing Magazine.

[8]  R. Mathar,et al.  A cyclic projection algorithm via duality , 1989 .

[9]  Xing Fu,et al.  Investigation on Solutions of Cubic Equations with One Unknown , 2003 .

[10]  J. Kruskal Nonmetric multidimensional scaling: A numerical method , 1964 .

[11]  Hongyang Chen,et al.  Distributed Wireless Sensor Network Localization Via Sequential Greedy Optimization Algorithm , 2010, IEEE Transactions on Signal Processing.

[12]  João M. F. Xavier,et al.  Simple and Fast Convex Relaxation Method for Cooperative Localization in Sensor Networks Using Range Measurements , 2014, IEEE Transactions on Signal Processing.

[13]  Houduo Qi,et al.  Tackling the flip ambiguity in wireless sensor network localization and beyond , 2016, Digit. Signal Process..

[14]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[15]  Henry Wolkowicz,et al.  Solving Euclidean Distance Matrix Completion Problems Via Semidefinite Programming , 1999, Comput. Optim. Appl..

[16]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[17]  Tomaso Erseghe,et al.  Cooperative Localization in WSNs: A Hybrid Convex/Nonconvex Solution , 2018, IEEE Transactions on Signal and Information Processing over Networks.

[18]  João M. F. Xavier,et al.  Robust Localization of Nodes and Time-Recursive Tracking in Sensor Networks Using Noisy Range Measurements , 2011, IEEE Transactions on Signal Processing.

[19]  Kim-Chuan Toh,et al.  Solving Nuclear Norm Regularized and Semidefinite Matrix Least Squares Problems with Linear Equality Constraints , 2013 .

[20]  Ligang Liu,et al.  An as-rigid-as-possible approach to sensor network localization , 2010, TOSN.

[21]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[22]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[23]  Prabhu Babu,et al.  Majorization-Minimization Algorithms in Signal Processing, Communications, and Machine Learning , 2017, IEEE Transactions on Signal Processing.

[24]  Ting Kei Pong Edge-based semidefinite programming relaxation of sensor network localization with lower bound constraints , 2012, Comput. Optim. Appl..

[25]  S. Lewandowsky,et al.  Robust multidimensional scaling , 1989 .

[26]  Houduo Qi,et al.  A Semismooth Newton Method for the Nearest Euclidean Distance Matrix Problem , 2013, SIAM J. Matrix Anal. Appl..

[27]  Masakazu Kojima,et al.  Algorithm 920: SFSDP: A Sparse Version of Full Semidefinite Programming Relaxation for Sensor Network Localization Problems , 2012, TOMS.

[28]  Stephen P. Boyd,et al.  Further Relaxations of the Semidefinite Programming Approach to Sensor Network Localization , 2008, SIAM J. Optim..

[29]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[30]  Amin Karbasi,et al.  Robust Localization From Incomplete Local Information , 2013, IEEE/ACM Transactions on Networking.

[31]  João M. F. Xavier,et al.  Distributed, simple and stable network localization , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[32]  W. Glunt,et al.  An alternating projection algorithm for computing the nearest euclidean distance matrix , 1990 .

[33]  Kim-Chuan Toh,et al.  Semidefinite Programming Approaches for Sensor Network Localization With Noisy Distance Measurements , 2006, IEEE Transactions on Automation Science and Engineering.

[34]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[35]  J. Leeuw Applications of Convex Analysis to Multidimensional Scaling , 2000 .

[36]  Christian Kanzow,et al.  A QP-free constrained Newton-type method for variational inequality problems , 1999, Math. Program..

[37]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[38]  Nathan Krislock,et al.  Sensor network localization, euclidean distance matrix completions, and graph realization , 2008, MELT '08.

[39]  Chao Ding,et al.  Convex optimization learning of faithful Euclidean distance representations in nonlinear dimensionality reduction , 2014, Mathematical Programming.

[40]  Marcos Raydan,et al.  Molecular conformations from distance matrices , 1993, J. Comput. Chem..

[41]  Nathan Krislock,et al.  Explicit Sensor Network Localization using Semidefinite Representations and Facial Reductions , 2010, SIAM J. Optim..

[42]  Yinyu Ye,et al.  Semidefinite programming for ad hoc wireless sensor network localization , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[43]  I. J. Schoenberg,et al.  Metric spaces and positive definite functions , 1938 .

[44]  Constantine Kotropoulos,et al.  Robust Multidimensional Scaling Using a Maximum Correntropy Criterion , 2017, IEEE Transactions on Signal Processing.

[45]  W. Torgerson Multidimensional scaling: I. Theory and method , 1952 .

[46]  Georgios B. Giannakis,et al.  Sparsity-Exploiting Robust Multidimensional Scaling , 2012, IEEE Transactions on Signal Processing.

[47]  Grace Wahba,et al.  Distance shrinkage and Euclidean embedding via regularized kernel estimation , 2014, 1409.5009.

[48]  T. N. Bhat,et al.  The Protein Data Bank , 2000, Nucleic Acids Res..