The Picasso Algorithm for Bayesian Localization Via Paired Comparisons in a Union of Subspaces Model

We develop a framework for localizing an unknown point w using paired comparisons of the form "w is closer to point xi than to xj" when the points lie in a union of known subspaces. This model, which extends a broad class of existing methods to exploit union of subspaces structure, provides a powerful framework for using the types of structure found in many practical applications. We divide the problem into two phases: (1) determining which subspace w lies in, and (2) localizing w within the identified subspace using existing techniques. We introduce two algorithms for determining the subspace in which an unknown point lies: the first admits a sample complexity guarantee demonstrating the advantage of the union of subspaces model, and the second improves performance in practice using an adaptive Bayesian strategy. We demonstrate the efficacy of our method with experiments on synthetic data and in an image search application.

[1]  Laura Balzano,et al.  Leveraging Union of Subspace Structure to Improve Constrained Clustering , 2017, ICML.

[2]  Martin J. Wainwright,et al.  Estimation from Pairwise Comparisons: Sharp Minimax Bounds with Topology Dependence , 2015, J. Mach. Learn. Res..

[3]  Christopher J. Rozell,et al.  Active Embedding Search via Noisy Paired Comparisons , 2019, 2020 Information Theory and Applications Workshop (ITA).

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Mark A. Davenport,et al.  As you like it: Localization via paired comparisons , 2018, J. Mach. Learn. Res..

[6]  Nebojsa Jojic,et al.  Efficient Ranking from Pairwise Comparisons , 2013, ICML.

[7]  David Maxwell Chickering,et al.  Here or there: preference judgments for relevance , 2008 .

[8]  Mark A. Davenport,et al.  Joint Estimation of Trajectory and Dynamics from Paired Comparisons , 2019, 2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[9]  Brian Eriksson,et al.  Learning to Top-K Search using Pairwise Comparisons , 2013, AISTATS.

[10]  Robert D. Nowak,et al.  Compressive distilled sensing: Sparse recovery using adaptivity in compressive measurements , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[11]  Mark A. Davenport,et al.  The geometry of random paired comparisons , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Robert D. Nowak,et al.  Active Ranking using Pairwise Comparisons , 2011, NIPS.

[13]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[14]  Devavrat Shah,et al.  Iterative ranking from pair-wise comparisons , 2012, NIPS.

[15]  Nir Ailon,et al.  Active Learning Ranking from Pairwise Preferences with Almost Optimal Query Complexity , 2011, NIPS.

[16]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[17]  Eyke Hüllermeier,et al.  Label ranking by learning pairwise preferences , 2008, Artif. Intell..