Multiway k-Cut in Static and Dynamic Graphs: A Maximum Entropy Principle Approach

This work presents a maximum entropy principle based algorithm for solving minimum multiway k-cut problem defined over static and dynamic digraphs. A multiway k-cut problem requires partitioning the set of nodes in a graph into k subsets, such that each subset contains one prespecified node, and the corresponding total cut weight is minimized. These problems arise in many applications and are computationally complex (NP-hard). In the static setting this article presents an approach that uses a relaxed multiway k-cut cost function; we show that the resulting algorithm converges to a local minimum. This iterative algorithm is designed to avoid poor local minima with its run-time complexity as ~ O(kIN3), where N is the number of vertices and I is the number of iterations. In the dynamic setting, the edge-weight matrix has an associated dynamics with some of the edges in the graph capable of being influenced by an external input. The objective is to design the dynamics of the controllable edges so that multiway k-cut value remains small (or decreases) as the graph evolves under the dynamics. Also it is required to determine the time-varying partition that defines the minimum multiway k-cut value. Our approach is to choose a relaxation of multiway k-cut value, derived using maximum entropy principle, and treat it as a control Lyapunov function to design control laws that affect the weight dynamics. Simulations on practical examples of interactive foreground-background segmentation, minimum multiway k-cut optimization for non-planar graphs and dynamically evolving graphs that demonstrate the efficacy of the algorithm, are presented.

[1]  Kenneth Rose,et al.  Design of robust HMM speech recognizers using deterministic annealing , 1997, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings.

[2]  Mihalis Yannakakis,et al.  The Complexity of Multiterminal Cuts , 1994, SIAM J. Comput..

[3]  László A. Székely,et al.  On weighted multiway cuts in trees , 1994, Math. Program..

[4]  T. H. Gronwall Note on the Derivatives with Respect to a Parameter of the Solutions of a System of Differential Equations , 1919 .

[5]  Eduardo Sontag A Lyapunov-Like Characterization of Asymptotic Controllability , 1983, SIAM Journal on Control and Optimization.

[6]  Gruia Calinescu,et al.  Multiway Cut , 2008, Encyclopedia of Algorithms.

[7]  Yuval Rabani,et al.  An improved approximation algorithm for multiway cut , 1998, STOC '98.

[8]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[9]  Yunwen Xu,et al.  Clustering and Coverage Control for Systems With Acceleration-Driven Dynamics , 2014, IEEE Transactions on Automatic Control.

[10]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[11]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[12]  Mayank Baranwal,et al.  Multiple traveling salesmen and related problems: A maximum-entropy principle based approach , 2017, 2017 American Control Conference (ACC).

[13]  Dániel Marx,et al.  A Tight Lower Bound for Planar Multiway Cut with Fixed Number of Terminals , 2012, ICALP.

[14]  Yunwen Xu,et al.  Aggregation of Graph Models and Markov Chains by Deterministic Annealing , 2014, IEEE Transactions on Automatic Control.

[15]  Sunanda Mitra,et al.  An adaptive deterministic annealing approach for medical image segmentation , 2000, PeachFuzz 2000. 19th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.00TH8500).

[16]  Joseph Naor,et al.  A 2-Approximation Algorithm for the Directed Multiway Cut Problem , 2001, SIAM J. Comput..

[17]  Dongmin Seo,et al.  Review on Graph Clustering and Subgraph Similarity Based Analysis of Neurological Disorders , 2016, International journal of molecular sciences.

[18]  Harold S. Stone,et al.  Multiprocessor Scheduling with the Aid of Network Flow Algorithms , 1977, IEEE Transactions on Software Engineering.

[19]  Eduardo Sontag A universal construction of Artstein's theorem on nonlinear stabilization , 1989 .

[20]  Mrdjan J. Jankovic,et al.  Constructive Nonlinear Control , 2011 .