Directional Statistics on Permutations

Distributions over permutations arise in applications ranging from multi-object tracking to ranking. The difficulty in dealing with these distributions is caused by the size of their domain, which is factorial in the number of entities (n!). The direct definition of a multinomial distribution over the permutation space is impractical for all but a very small n. In this work we propose an embedding of all n! permutations for a given n in a surface of a hypersphere defined in R(n−1) 2 . As a result, we acquire the ability to define continuous distributions over a hypersphere with all the benefits of directional statistics. We provide polynomial time projections between the continuous hypersphere representation and the n!-element permutation space. The framework provides a way to use continuous directional probability densities and the methods developed thereof for establishing densities over permutations. As a demonstration of the benefits of the framework we derive an inference procedure for a state-space model over permutations. We demonstrate the approach with applications and comparisons to existing models.

[1]  Ralph E. Gomory,et al.  Outline of an Algorithm for Integer Solutions to Linear Programs and An Algorithm for the Mixed Integer Problem , 2010, 50 Years of Integer Programming.

[2]  M. Fligner,et al.  Distance Based Ranking Models , 1986 .

[3]  D. West Introduction to Graph Theory , 1995 .

[4]  T. Raghavan,et al.  Nonnegative Matrices and Applications , 1997 .

[5]  W J Lentz,et al.  Generating bessel functions in mie scattering calculations using continued fractions. , 1976, Applied optics.

[6]  Tommi S. Jaakkola,et al.  Learning Bayesian Network Structure using LP Relaxations , 2010, AISTATS.

[7]  S. R. Jammalamadaka,et al.  Directional Statistics, I , 2011 .

[8]  Leonidas J. Guibas,et al.  Efficient Inference for Distributions on Permutations , 2007, NIPS.

[9]  Jeff A. Bilmes,et al.  Consensus ranking under the exponential model , 2007, UAI.

[10]  Tony Jebara,et al.  Multi-object tracking with representations of the symmetric group , 2007, AISTATS.

[11]  James R. Munkres,et al.  Topology; a first course , 1974 .

[12]  Alessandro Chiuso,et al.  Visual tracking of points as estimation on the unit sphere , 1997, Block Island Workshop on Vision and Control.

[13]  E. Kreyszig Introductory Functional Analysis With Applications , 1978 .

[14]  Kunle Olukotun,et al.  The Information-Form Data Association Filter , 2005, NIPS.

[15]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[16]  Leonidas J. Guibas,et al.  Fourier Theoretic Probabilistic Inference over Permutations , 2009, J. Mach. Learn. Res..

[17]  Gregory D. Hager,et al.  Probabilistic Data Association Methods for Tracking Complex Visual Objects , 2001, IEEE Trans. Pattern Anal. Mach. Intell..