Assignment flows for data labeling on graphs: convergence and stability

The assignment flow recently introduced in the J. Math. Imaging and Vision 58/2 (2017) constitutes a high-dimensional dynamical system that evolves on a statistical product manifold and performs contextual labeling (classification) of data given in a metric space. Vertices of an underlying corresponding graph index the data points and define a system of neighborhoods. These neighborhoods together with nonnegative weight parameters define the regularization of the evolution of label assignments to data points, through geometric averaging induced by the affine e-connection of information geometry. From the point of view of evolutionary game dynamics, the assignment flow may be characterized as a large system of replicator equations that are coupled by geometric averaging. This paper establishes conditions on the weight parameters that guarantee convergence of the continuous-time assignment flow to integral assignments (labelings), up to a negligible subset of situations that will not be encountered when working with real data in practice. Furthermore, we classify attractors of the flow and quantify corresponding basins of attraction. This provides convergence guarantees for the assignment flow which are extended to the discrete-time assignment flow that results from applying a Runge–Kutta–Munthe–Kaas scheme for the numerical geometric integration of the assignment flow. Several counter-examples illustrate that violating the conditions may entail unfavorable behavior of the assignment flow regarding contextual data classification.

[1]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[2]  Freddie Åström,et al.  Image Labeling by Assignment , 2016, Journal of Mathematical Imaging and Vision.

[3]  Christoph Schnörr,et al.  Learning Linear Assignment Flows for Image Labeling via Exponential Integration , 2021, SSVM.

[4]  Christoph Schnörr,et al.  Learning Adaptive Regularization for Image Labeling Using Geometric Assignment , 2020, Journal of Mathematical Imaging and Vision.

[5]  Sebastian Nowozin,et al.  A Comparative Study of Modern Inference Techniques for Structured Discrete Energy Minimization Problems , 2014, International Journal of Computer Vision.

[6]  Neil Fenichel Geometric singular perturbation theory for ordinary differential equations , 1979 .

[7]  Christoph Schnörr,et al.  Learning Linearized Assignment Flows for Image Labeling , 2021, ArXiv.

[8]  Christoph Schnörr,et al.  Continuous-domain assignment flows , 2019, European Journal of Applied Mathematics.

[9]  Tobias Galla,et al.  Complex dynamics in learning complicated games , 2011, Proceedings of the National Academy of Sciences.

[10]  C. Schnörr Assignment Flows , 2020, Handbook of Variational Methods for Nonlinear Geometric Data.

[11]  Gabriele Steidl,et al.  Iterative Multiplicative Filters for Data Labeling , 2016, International Journal of Computer Vision.

[12]  C. Loan The ubiquitous Kronecker product , 2000 .

[13]  Christoph Schnörr,et al.  Unsupervised Assignment Flow: Label Learning on Feature Manifolds by Spatially Regularized Geometric Assignment , 2019, Journal of Mathematical Imaging and Vision.

[14]  H. Gintis,et al.  Game Theory in Action: An Introduction to Classical and Evolutionary Models , 2016 .

[15]  Andrew L. Beam,et al.  Adversarial attacks on medical machine learning , 2019, Science.

[16]  L. Perko Differential Equations and Dynamical Systems , 1991 .

[17]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  A. Kelley The stable, center-stable, center, center-unstable, unstable manifolds , 1967 .

[19]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[20]  Douglas Heaven,et al.  Why deep-learning AIs are so easy to fool , 2019, Nature.

[21]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[23]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  E. Akin,et al.  Dynamics of games and genes: Discrete versus continuous time , 1983 .

[25]  John W. Cain,et al.  Ordinary Differential Equations: Basics and Beyond , 2016 .

[26]  Stefania Petra,et al.  Geometric numerical integration of the assignment flow , 2018, Inverse Problems.

[27]  S. Amari Information geometry , 2021, Japanese Journal of Mathematics.

[28]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[29]  G. Belitskii,et al.  ON THE GROBMAN-HARTMAN THEOREM IN α-HÖLDER CLASS FOR BANACH SPACES , 2011 .

[30]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  G. Teschl Ordinary Differential Equations and Dynamical Systems , 2012 .

[32]  Christoph Schnörr,et al.  Self-Assignment Flows for Unsupervised Data Labeling on Graphs , 2020, SIAM J. Imaging Sci..

[33]  Immanuel M. Bomze,et al.  Regularity versus Degeneracy in Dynamics, Games, and Optimization: A Unified Approach to Different Aspects , 2002, SIAM Rev..

[34]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..