Locally adapted hierarchical basis preconditioning

This paper develops locally adapted hierarchical basis functions for effectively preconditioning large optimization problems that arise in computer graphics applications such as tone mapping, gradient-domain blending, colorization, and scattered data interpolation. By looking at the local structure of the coefficient matrix and performing a recursive set of variable eliminations, combined with a simplification of the resulting coarse level problems, we obtain bases better suited for problems with inhomogeneous (spatially varying) data, smoothness, and boundary constraints. Our approach removes the need to heuristically adjust the optimal number of preconditioning levels, significantly outperforms previously proposed approaches, and also maps cleanly onto data-parallel architectures such as modern GPUs.

[1]  Edward L. Wilson,et al.  Numerical methods in finite element analysis , 1976 .

[2]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[3]  Richard M. Stern,et al.  Fast Computation of the Difference of Low-Pass Transform , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[5]  Tomaso A. Poggio.  Early vision: From computational structure to algorithms and parallel hardware , 1985, Comput. Vis. Graph. Image Process..

[6]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[8]  H. Yserentant.  On the multi-level splitting of finite element spaces , 1986 .

[9]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[10]  I. Duff,et al.  Direct Methods for Sparse Matrices , 1987 .

[11]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[12]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Daphna Weinshall,et al.  The MIT vision machine , 1988 .

[14]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[15]  Richard Szeliski,et al.  Fast shape from shading , 1990, CVGIP Image Underst..

[16]  Richard Szeliski,et al.  Fast Surface Interpolation Using Hierarchical Basis Functions , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  C. Brand.  An incomplete-factorization preconditioning using repeated red-black ordering , 1992 .

[18]  Alex Pentland,et al.  Interpolation Using Wavelet Bases , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Wen-Thong Chang,et al.  Fast Surface Interpolation using Multiresolution Wavelet Transform , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Michael F. Cohen,et al.  Hierarchical and variational geometric modeling with wavelets , 1995, I3D '95.

[21]  Peter Schröder,et al.  Spherical wavelets: efficiently representing functions on the sphere , 1995, SIGGRAPH.

[22]  Wim Sweldens,et al.  The lifting scheme: a construction of second generation wavelets , 1998 .

[23]  Y. Notay,et al.  A Nearly Optimal Preconditioning based on Recursive Red-black Orderings , 1997 .

[24]  Shang-Hong Lai,et al.  Physically Based Adaptive Preconditioning for Early Vision , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Peter Schröder,et al.  A multiresolution framework for variational subdivision , 1998, TOGS.

[26]  Kunibert G. Siebert,et al.  ALBERT: An adaptive hierarchical nite element toolbox , 2000 .

[27]  William L. Briggs,et al.  A multigrid tutorial, Second Edition , 2000 .

[28]  Steven M. Seitz,et al.  Single-view modelling of free-form scenes , 2002, Comput. Animat. Virtual Worlds.

[29]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[30]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[31]  Ruigang Yang,et al.  Multi-resolution real-time stereo on commodity graphics hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[32]  Eitan Grinspun,et al.  Natural hierarchical refinement for finite element methods , 2003 .

[33]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[34]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[35]  Shang-Hua Teng,et al.  Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems , 2003, STOC '04.

[36]  Sivan Toledo,et al.  Maximum‐weight‐basis preconditioners , 2004, Numer. Linear Algebra Appl..

[37]  Richard Szeliski,et al.  Bayesian modeling of uncertainty in low-level vision , 2011, International Journal of Computer Vision.

[38]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[39]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[40]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[41]  Burak Aksoylu,et al.  AN ODYSSEY INTO LOCAL REFINEMENT AND MULTILEVEL PRECONDITIONING II: STABILIZING HIERARCHICAL BASIS METHODS , 2005 .

[42]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, SIGGRAPH 2005.

[43]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[44]  Dimitri Van De Ville,et al.  An orthogonal family of quincunx wavelets with continuously adjustable order , 2005, IEEE Transactions on Image Processing.

[45]  Patrick Ciarlet,et al.  Repeated Red-Black ordering: a new approach , 1994, Numerical Algorithms.

[46]  P. Schröder,et al.  Sparse matrix solvers on the GPU: conjugate gradients and multigrid , 2003, SIGGRAPH Courses.

[47]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, SIGGRAPH 2006.

[48]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.