Fourier Theoretic Probabilistic Inference over Permutations

Permutations are ubiquitous in many real-world problems, such as voting, ranking, and data association. Representing uncertainty over permutations is challenging, since there are n! possibilities, and typical compact and factorized probability distribution representations, such as graphical models, cannot capture the mutual exclusivity constraints associated with permutations. In this paper, we use the "low-frequency" terms of a Fourier decomposition to represent distributions over permutations compactly. We present Kronecker conditioning, a novel approach for maintaining and updating these distributions directly in the Fourier domain, allowing for polynomial time bandlimited approximations. Low order Fourier-based approximations, however, may lead to functions that do not correspond to valid distributions. To address this problem, we present a quadratic program defined directly in the Fourier domain for projecting the approximation onto a relaxation of the polytope of legal marginal distributions. We demonstrate the effectiveness of our approach on a real camera-based multi-person tracking scenario.

[1]  R. H. Makar On the Analysis of the Kronecker Product of Irreducible Representations of the Symmetric Group , 1949 .

[2]  C. L. Mallows NON-NULL RANKING MODELS. I , 1957 .

[3]  U. Grenander Probabilities on Algebraic Structures , 1964 .

[4]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[5]  K. G. Murty An Algorithm for Ranking All the Assignment in Order of Increasing Cost , 1968 .

[6]  Katta G. Murty,et al.  Letter to the Editor - An Algorithm for Ranking all the Assignments in Order of Increasing Cost , 1968, Oper. Res..

[7]  D. Reid An algorithm for tracking multiple targets , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[8]  Alan S. Willsky,et al.  On the Algebraic Structure of Certain Partially Observable Finite-State Markov Processes , 1978, Inf. Control..

[9]  D. Critchlow Metric Methods for Analyzing Partially Ranked Data , 1986 .

[10]  M. Fligner,et al.  Distance Based Ranking Models , 1986 .

[11]  Y. Bar-Shalom Tracking and data association , 1988 .

[12]  P. Diaconis Group representations in probability and statistics , 1988 .

[13]  Jin-quan Chen Group Representation Theory For Physicists , 1989 .

[14]  M. Trick,et al.  Voting schemes for which it can be difficult to tell who won the election , 1989 .

[15]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[16]  P. Diaconis A Generalization of Spectral Analysis with Application to Ranked Data , 1989 .

[17]  T. Inui,et al.  The Symmetric Group , 1990 .

[18]  Richard M. Wilson,et al.  A course in combinatorics , 1992 .

[19]  J. B. Collins,et al.  Efficient gating in data association with multivariate Gaussian distributed states , 1992 .

[20]  M. Clausen,et al.  Fast Fourier transforms for symmetric groups : theory and implementation , 1993 .

[21]  Zixue Cheng,et al.  A Distributed Algorithm for Dice Tossing , 1996, PDPTA.

[22]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  A. Vershik,et al.  A new approach to representation theory of symmetric groups , 1996 .

[24]  David Keith Maslen,et al.  The efficient computation of Fourier transforms on the symmetric group , 1998, Math. Comput..

[25]  Yoram Singer,et al.  An Efficient Boosting Algorithm for Combining Preferences by , 2013 .

[26]  Xavier Boyen,et al.  Tractable Inference for Complex Stochastic Processes , 1998, UAI.

[27]  D. Rockmore,et al.  Nonlinear approximation theory on finite groups , 1999 .

[28]  A. Terras Fourier Analysis on Finite Groups and Applications: Index , 1999 .

[29]  C. Loan The ubiquitous Kronecker product , 2000 .

[30]  Daniel N. Rockmore,et al.  The FFT: an algorithm the whole family can use , 2000, Comput. Sci. Eng..

[31]  B. Sagan The Symmetric Group , 2001 .

[32]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[33]  Leonidas J. Guibas,et al.  A Distributed Algorithm for Managing Multi-target Identities in Wireless Ad-hoc Sensor Networks , 2003, IPSN.

[34]  H. Balakrishnan,et al.  Polynomial approximation algorithms for belief matrix maintenance in identity management , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[35]  Songhwai Oh,et al.  Markov chain Monte Carlo data association for general multiple-target tracking problems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[36]  Daniel N. Rockmore,et al.  Two-dimensional wreath product group-based image processing , 2004, J. Symb. Comput..

[37]  A. Vershik,et al.  A New Approach to the Representation Theory of the Symmetric Groups. II , 2005 .

[38]  Kunle Olukotun,et al.  The Information-Form Data Association Filter , 2005, NIPS.

[39]  S. Sastry,et al.  A polynomial-time approximation algorithm for joint probabilistic data association , 2005, Proceedings of the 2005, American Control Conference, 2005..

[40]  Leonidas J. Guibas,et al.  Lazy inference on object identities in wireless sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[41]  Kunle Olukotun,et al.  The Identity Management Kalman Filter (IMKF) , 2006, Robotics: Science and Systems.

[42]  Leonidas J. Guibas,et al.  Efficient Inference for Distributions on Permutations , 2007, NIPS.

[43]  Manfred K. Warmuth,et al.  Learning Permutations with Exponential Weights , 2007, COLT.

[44]  Yi Mao,et al.  Non-parametric Modeling of Partially Ranked Data , 2007, NIPS.

[45]  Jeff A. Bilmes,et al.  Consensus ranking under the exponential model , 2007, UAI.

[46]  Tony Jebara,et al.  Multi-object tracking with representations of the symmetric group , 2007, AISTATS.

[47]  Randall R. Holmes Linear Representations of Finite Groups , 2008 .

[48]  Karsten M. Borgwardt,et al.  The skew spectrum of graphs , 2008, ICML '08.

[49]  G. James,et al.  The Representation Theory of the Symmetric Group , 2009 .

[50]  Leonidas J. Guibas,et al.  Exploiting Probabilistic Independence for Permutations , 2009, AISTATS.