Rectangular maximum-volume submatrices and their applications

Abstract We introduce a definition of the volume of a general rectangular matrix, which is equivalent to an absolute value of the determinant for square matrices. We generalize results of square maximum-volume submatrices to the rectangular case, show a connection of the rectangular volume with an optimal experimental design and provide estimates for a growth of coefficients and an approximation error in spectral and Chebyshev norms. Three promising applications of such submatrices are presented: recommender systems, finding maximal elements in low-rank matrices and preconditioning of overdetermined linear systems. The code is available online.

[1]  Iain S. Duff,et al.  Preconditioning Linear Least-Squares Problems by Identifying a Basis Matrix , 2015, SIAM J. Sci. Comput..

[2]  S. Goreinov,et al.  How to find a good submatrix , 2010 .

[3]  Hon Tat Hui,et al.  Global and Fast Receiver Antenna Selection for MIMO Systems , 2010, IEEE Transactions on Communications.

[4]  Ioan Mackenzie James,et al.  The topology of Stiefel manifolds , 1976 .

[5]  S. Goreinov,et al.  The maximum-volume concept in approximation by low-rank matrices , 2001 .

[6]  F. Hoog,et al.  Subset selection for matrices , 2007 .

[7]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[8]  J. Kiefer.  Optimum Experimental Designs V, with Applications to Systematic and Rotatable Designs , 1961 .

[9]  Toby J. Mitchell,et al.  An algorithm for the construction of “ D -optimal” experimental designs , 2000 .

[10]  O. Dykstra.  The Augmentation of Experimental Data to Maximize [X′X] , 1971 .

[11]  John J. Bartholdi,et al.  A good submatrix is hard to find , 1982, Oper. Res. Lett..

[12]  S. Goreinov,et al.  A Theory of Pseudoskeleton Approximations , 1997 .

[13]  Chao Liu,et al.  Wisdom of the better few: cold start recommendation via representative based rating elicitation , 2011, RecSys '11.

[14]  N. Zamarashkin,et al.  New accuracy estimates for pseudoskeleton approximations of matrices , 2016 .

[15]  Is Duff,et al.  Preconditioning of linear least-squares problems by identifying basic variables , 2014 .

[16]  E. Tyrtyshnikov,et al.  TT-cross approximation for multidimensional arrays , 2010 .