Learning Discontinuous Piecewise Affine Fitting Functions using Mixed Integer Programming for Segmentation and Denoising

Piecewise affine functions are widely used to approximate nonlinear and discontinuous functions. However, most, if not all existing models only deal with fitting continuous functions. In this paper, we investigate the problem of fitting a discontinuous piecewise affine function to given data that lie in an orthogonal grid, where no restriction on the partition is enforced (i.e., its geometric shape can be nonconvex). This is useful for segmentation and denoising when data corresponding to images. We propose a novel Mixed Integer Program (MIP) formulation for the piecewise affine fitting problem, where binary variables determine the location of break-points. To obtain consistent partitions (i.e. image segmentation), we include multi-cut constraints in the formulation. Since the resulting problem is $\mathcal{NP}$-hard, two techniques are introduced to improve the computation. One is to add facet-defining inequalities to the formulation and the other to provide initial integer solutions using a special heuristic algorithm. We conduct extensive experiments by some synthetic images as well as real depth images, and the results demonstrate the feasibility of our model.

[1]  Fuquan Zhang,et al.  Piecewise Linear Regression Based on Plane Clustering , 2019, IEEE Access.

[2]  Gerhard Reinelt,et al.  Discrete Potts Model for Generating Superpixels on Noisy Images , 2018, ArXiv.

[3]  Michael Unser,et al.  Fast Piecewise-Affine Motion Estimation Without Segmentation , 2018, IEEE Transactions on Image Processing.

[4]  Xuming He,et al.  Boundary-Aware Instance Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Edoardo Amaldi,et al.  Discrete optimization methods to fit piecewise affine models to data points , 2016, Comput. Oper. Res..

[6]  Michael S. Brown,et al.  Fast and Effective L0 Gradient Minimization by Region Fusion , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  Bjoern Andres,et al.  Analysis and Optimization of Graph Decompositions by Lifted Multicuts , 2015, ICML.

[9]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Gerhard Reinelt,et al.  Towards Efficient and Exact MAP-Inference for Large Scale Discrete Computer Vision Problems via Combinatorial Optimization , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Gerhard Reinelt,et al.  Higher-order segmentation via multicuts , 2013, Comput. Vis. Image Underst..

[12]  Alejandro Toriello,et al.  Fitting piecewise linear continuous functions , 2012, Eur. J. Oper. Res..

[13]  Antonio Ortega,et al.  Signal compression in wireless sensor networks , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[14]  Ullrich Köthe,et al.  Probabilistic image segmentation with closedness constraints , 2011, 2011 International Conference on Computer Vision.

[15]  Gerhard Reinelt,et al.  Globally Optimal Image Partitioning by Multicuts , 2011, EMMCVPR.

[16]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Marco Muselli,et al.  A New Learning Method for Piecewise Linear Regression , 2002, ICANN.

[18]  Manfred Morari,et al.  A clustering technique for the identification of piecewise affine systems , 2001, Autom..

[19]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[20]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  H. Seal,et al.  Studies in the History of Probability and Statistics. XV The historical development of the Gauss linear model , 1967 .

[22]  M. Kendall Studies in the History of Probability and Statistics. XII. The Book of Fate , 1961 .

[23]  R. B. Potts Some generalized order-disorder transformations , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[24]  Xue-Cheng Tai,et al.  Iterative Image Restoration Combining Total Variation Minimization and a Second-Order Functional , 2005, International Journal of Computer Vision.