Nonlocal Discrete Regularization on Weighted Graphs: A Framework for Image and Manifold Processing

We introduce a nonlocal discrete regularization framework on weighted graphs of the arbitrary topologies for image and manifold processing. The approach considers the problem as a variational one, which consists of minimizing a weighted sum of two energy terms: a regularization one that uses a discrete weighted -Dirichlet energy and an approximation one. This is the discrete analogue of recent continuous Euclidean nonlocal regularization functionals. The proposed formulation leads to a family of simple and fast nonlinear processing methods based on the weighted -Laplace operator, parameterized by the degree of regularity, the graph structure and the graph weight function. These discrete processing methods provide a graph-based version of recently proposed semi-local or nonlocal processing methods used in image and mesh processing, such as the bilateral filter, the TV digital filter or the nonlocal means filter. It works with equal ease on regular 2-D and 3-D images, manifolds or any data. We illustrate the abilities of the approach by applying it to various types of images, meshes, manifolds, and data represented as graphs.

[1]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[2]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[3]  Ulrich Pinkall,et al.  Computing Discrete Minimal Surfaces and Their Conjugates , 1993, Exp. Math..

[4]  Abderrahim Elmoataz,et al.  Image Smoothing and Segmentation by Graph Regularization , 2005, ISVC.

[5]  A. Elmoataz,et al.  Nonlocal Anisotropic Discrete Regularization for Image, Data Filtering and Clustering , 2007 .

[6]  Ronen Basri,et al.  Fast multiscale image segmentation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[8]  Hans-Peter Seidel,et al.  Smoothing by Example: Mesh Denoising by Averaging with Similarity-Based Weights , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[9]  Ulrike von Luxburg,et al.  Graph Laplacians and their Convergence on Random Neighborhood Graphs , 2006, J. Mach. Learn. Res..

[10]  Abderrahim Elmoataz,et al.  Discrete Regularization on Weighted Graphs for Image and Mesh Filtering , 2007, SSVM.

[11]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Abderrahim Elmoataz,et al.  Parameterless Discrete Regularization on Graphs for Color Image Filtering , 2007, ICIAR.

[13]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[14]  Danny Barash,et al.  A Fundamental Relationship between Bilateral Filtering, Adaptive Smoothing, and the Nonlinear Diffusion Equation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  R. Coifman,et al.  A general framework for adaptive regularization based on diffusion processes on graphs , 2006 .

[16]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  Yutaka Ohtake,et al.  Mesh regularization and adaptive smoothing , 2001, Comput. Aided Des..

[18]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[19]  Ronald R. Coifman,et al.  Geometries of sensor outputs, inference, and information processing , 2006, SPIE Defense + Commercial Sensing.

[20]  Gabriel Peyré,et al.  Manifold models for signals and images , 2009, Comput. Vis. Image Underst..

[21]  Bernhard Schölkopf,et al.  Regularization on Discrete Spaces , 2005, DAGM-Symposium.

[22]  Ronald R. Coifman,et al.  Data Fusion and Multicue Data Matching by Diffusion Maps , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  R. Coifman Perspectives and Challenges to Harmonic Analysis and Geometry in High Dimensions: Geometric Diffusions as a Tool for Harmonic Analysis and Structure Definition of Data , 2005 .

[24]  Abderrahim Elmoataz,et al.  Graph regularization for color image processing , 2007, Comput. Vis. Image Underst..

[25]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[26]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[27]  Stanley J. Osher,et al.  Digitized PDE Method for Data Restoration , 2000, Handbook of Analytic-Computational Methods in Applied Mathematics.

[28]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[29]  Joachim Weickert,et al.  Coherence-enhancing diffusion of colour images , 1999, Image Vis. Comput..

[30]  B. Schölkopf,et al.  A Regularization Framework for Learning from Graph Data , 2004, ICML 2004.

[31]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[32]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[33]  Tony F. Chan,et al.  The digital TV filter and nonlinear denoising , 2001, IEEE Trans. Image Process..

[34]  D. J. Newman,et al.  UCI Repository of Machine Learning Database , 1998 .

[35]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Jérôme Darbon,et al.  Exact Optimization of Discrete Constrained Total Variation Minimization Problems , 2004, IWCIA.

[37]  Gert Vegter,et al.  In handbook of discrete and computational geometry , 1997 .

[38]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[39]  A. Bensoussan,et al.  Difference equations on weighted graphs , 2005 .

[40]  Mikhail Belkin,et al.  Tikhonov regularization and semi-supervised learning on large graphs , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[41]  Matthias Hein,et al.  Manifold Denoising , 2006, NIPS.

[42]  Stanley Osher,et al.  Deblurring and Denoising of Images by Nonlocal Functionals , 2005, Multiscale Model. Simul..

[43]  Mark Meyer,et al.  Anisotropic Feature-Preserving Denoising of Height Fields and Bivariate Data , 2000, Graphics Interface.

[44]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.

[45]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[46]  C. B. García,et al.  Fixed points : algorithms and applications , 1977 .

[47]  Fan Chung,et al.  Eigenvalues and the Laplacian of a graph (Chapter 1) , 1996 .

[48]  Bd. Maréchal Juin Graphs Regularization for Data Sets and Images : Filtering and Semi-Supervised Classification , 2007 .

[49]  Antonin Chambolle,et al.  Total Variation Minimization and a Class of Binary MRF Models , 2005, EMMCVPR.

[50]  Ann B. Lee,et al.  Diffusion maps and coarse-graining: a unified framework for dimensionality reduction, graph partitioning, and data set parameterization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Gabriel Taubin,et al.  Geometric Signal Processing on Polygonal Meshes , 2000, Eurographics.

[52]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[53]  Frédo Durand,et al.  Non-iterative, feature-preserving mesh smoothing , 2003, ACM Trans. Graph..

[54]  Rachid Deriche,et al.  Vector-valued image regularization with PDEs: a common framework for different applications , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Jean-Philippe Pons,et al.  Generalized Surface Flows for Mesh Processing , 2007 .

[56]  O. Lezoray,et al.  A new method of morphological hierarchical segmentation , 2007 .

[57]  Mikhail Belkin,et al.  Regularization and Semi-supervised Learning on Large Graphs , 2004, COLT.

[58]  Abderrahim Elmoataz,et al.  Multi-scale image segmentation in a hierarchy of partitions , 2006, 2006 14th European Signal Processing Conference.

[59]  Chandrajit L. Bajaj,et al.  Anisotropic diffusion of surfaces and functions on surfaces , 2003, TOGS.

[60]  S. Osher,et al.  Total variation and level set methods in image science , 2005, Acta Numerica.

[61]  J. Friedman,et al.  Wave equations for graphs and the edge-based Laplacian , 2004 .

[62]  Qing Pan,et al.  Discrete surface modelling using partial differential equations , 2006, Comput. Aided Geom. Des..

[63]  Konrad Polthier,et al.  Anisotropic Filtering of Non‐Linear Surface Features , 2004, Comput. Graph. Forum.

[64]  Mark Meyer,et al.  Implicit fairing of irregular meshes using diffusion and curvature flow , 1999, SIGGRAPH.

[65]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.