Large-scale Multi-dimensional Assignment: Problem Formulations and GPU Accelerated Solutions

In this paper, we present alternate integer programming formulations for the multi-dimensional assignment problem, which is typically employed for multi-sensor fusion, multi-target tracking (MTT) or data association in general. The first formulation is the Axial Multidimensional Assignment Problem with Decomposable Costs (MDADC). The decomposable costs comes from the fact that there are only pairwise costs between stages or scans of a target tracking problem or corpuses of a data association context. The difficulty with this formulation is the large number of transitivity or triangularity constraints that ensure if entity $A$ is associated to entity $B$ and entity $B$ is associated with entity $C$, then it must also be that entity $A$ is associated to entity $C$. The second formulation uses both pairs and triplets of observations, which offer more accurate representation for kinematic tracking of targets. This formulation avoids the large number of transitivity constraints but significantly increases the number of variables due to triples. Solution to large-scale problems has alluded researchers and practitioners alike. We present solution methods based on Lagrangian Relaxation and massively parallel algorithms that are implemented on Graphics Processing Units (GPUs). We test the problem formulations and solution algorithms on MTT problems. The triples formulation tends to be more accurate for tracking measures and the MDADC solver can solve much larger problems in reasonable computational time.

[1]  Rakesh Nagi,et al.  A map-reduce lagrangian heuristic for multidimensional assignment problems with decomposable costs , 2013, Parallel Comput..

[2]  Frits C. R. Spieksma,et al.  Approximation Algorithms for Multi-Dimensional Assignment Problems with Decomposable Costs , 1994, Discret. Appl. Math..

[3]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[4]  Monique Guignard-Spielberg,et al.  A level-2 reformulation-linearization technique bound for the quadratic assignment problem , 2007, Eur. J. Oper. Res..

[5]  Rakesh Nagi,et al.  GPU-accelerated Hungarian algorithms for the Linear Assignment Problem , 2016, Parallel Comput..

[6]  Anna Freud,et al.  Design And Analysis Of Modern Tracking Systems , 2016 .

[7]  Francesco Papi,et al.  Multi-Sensor d-GLMB Filter for Multi-Target Tracking using Doppler only Measurements , 2015, 2015 European Intelligence and Security Informatics Conference.

[8]  Aubrey B. Poore,et al.  A New Lagrangian Relaxation Based Algorithm for a Class of Multidimensional Assignment Problems , 1997, Comput. Optim. Appl..

[9]  Chee-Yee Chong,et al.  Forty Years of Multiple Hypothesis Tracking - A Review of Key Developments , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[10]  Rakesh Nagi,et al.  The graph association problem: Mathematical models and a lagrangian heuristic , 2013 .

[11]  Rakesh Nagi,et al.  Tracking Multiple Maneuvering Targets Using Integer Programming and Spline Interpolation , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[12]  Aubrey B. Poore,et al.  Multidimensional assignment formulation of data association problems arising from multitarget and multisensor tracking , 1994, Comput. Optim. Appl..

[13]  Frits C. R. Spieksma,et al.  Local search heuristics for multi-index assignment problems with decomposable costs , 2004, J. Oper. Res. Soc..

[14]  Aubrey B. Poore,et al.  A Lagrangian Relaxation Algorithm for Multidimensional Assignment Problems Arising from Multitarget Tracking , 1993, SIAM J. Optim..

[15]  Sushant S. Khopkar,et al.  Data association and graph analytical processing of hard and soft intelligence data , 2013, Proceedings of the 16th International Conference on Information Fusion.

[16]  Aubrey B. Poore,et al.  Multidimensional Assignment Problems Arising in Multitarget and Multisensor Tracking , 2000 .

[17]  Rakesh Nagi,et al.  GPU-accelerated Lagrangian heuristic for multidimensional assignment problems with decomposable costs , 2020, Parallel Comput..

[18]  Warren P. Adams,et al.  Improved Linear Programming-based Lower Bounds for the Quadratic Assignment Proglem , 1993, Quadratic Assignment and Related Problems.

[19]  Robert T. Collins,et al.  Multi-target Tracking by Lagrangian Relaxation to Min-cost Network Flow , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  J. Bather,et al.  Tracking and data fusion , 2001 .

[21]  Ronald P. S. Mahler,et al.  Advances in Statistical Multisource-Multitarget Information Fusion , 2014 .

[22]  Amir Globerson,et al.  Higher Order Matching for Consistent Multiple Target Tracking , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Giorgio Battistelli,et al.  Optimal Flow Models for Multiscan Data Association , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[24]  Ba-Ngu Vo,et al.  Multi-Scan Generalized Labeled Multi-Bernoulli Filter , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[25]  Hanif D. Sherali,et al.  Linearization Strategies for a Class of Zero-One Mixed Integer Programming Problems , 1990, Oper. Res..

[26]  Konrad Schindler,et al.  Globally Optimal Multi-target Tracking on a Hexagonal Lattice , 2010, ECCV.

[27]  Rakesh Nagi,et al.  Test and evaluation of data association algorithms in hard+soft data fusion , 2014, 17th International Conference on Information Fusion (FUSION).

[28]  Ba-Ngu Vo,et al.  Labeled Random Finite Sets and Multi-Object Conjugate Priors , 2013, IEEE Transactions on Signal Processing.

[29]  Cor J. Veenman,et al.  Resolving Motion Correspondence for Densely Moving Points , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Panos M. Pardalos,et al.  Integer programming models for the multidimensional assignment problem with star costs , 2014, Eur. J. Oper. Res..

[31]  Tomomi Matsui,et al.  An approximation algorithm for multidimensional assignment problems minimizing the sum of squared errors , 2009, Discret. Appl. Math..

[32]  Stuart C. Shapiro,et al.  Systemic test and evaluation of a hard+soft information fusion framework: Challenges and current approaches , 2014, 17th International Conference on Information Fusion (FUSION).