Locally adapted hierarchical basis preconditioning

This paper develops locally adapted hierarchical basis functions for effectively preconditioning large optimization problems that arise in computer graphics applications such as tone mapping, gradient-domain blending, colorization, and scattered data interpolation. By looking at the local structure of the coefficient matrix and performing a recursive set of variable eliminations, combined with a simplification of the resulting coarse level problems, we obtain bases better suited for problems with inhomogeneous (spatially varying) data, smoothness, and boundary constraints. Our approach removes the need to heuristically adjust the optimal number of preconditioning levels, significantly outperforms previously proposed approaches, and also maps cleanly onto data-parallel architectures such as modern GPUs.

[1]  Edward L. Wilson,et al.  Numerical methods in finite element analysis , 1976 .

[2]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[3]  Richard M. Stern,et al.  Fast Computation of the Difference of Low-Pass Transform , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[5]  Tomaso A. Poggio.  Early vision: From computational structure to algorithms and parallel hardware , 1985, Comput. Vis. Graph. Image Process..

[6]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[8]  Harry Yserentant,et al.  On the multi-level splitting of finite element spaces , 1986 .

[9]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[10]  I. Duff,et al.  Direct Methods for Sparse Matrices , 1987 .

[11]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[12]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Daphna Weinshall,et al.  The MIT vision machine , 1988 .

[14]  Richard Szeliski,et al.  Fast Surface Interpolation Using Hierarchical Basis Functions , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Richard Szeliski,et al.  Fast shape from shading , 1990, CVGIP Image Underst..

[16]  C. Brand.  An incomplete-factorization preconditioning using repeated red-black ordering , 1992 .

[17]  Alex Pentland,et al.  Interpolation Using Wavelet Bases , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Michael F. Cohen,et al.  Hierarchical and variational geometric modeling with wavelets , 1995, I3D '95.

[19]  Peter Schröder,et al.  Spherical wavelets: efficiently representing functions on the sphere , 1995, SIGGRAPH.

[20]  Wim Sweldens,et al.  The lifting scheme: a construction of second generation wavelets , 1998 .

[21]  Y. Notay,et al.  A Nearly Optimal Preconditioning based on Recursive Red-black Orderings , 1997 .

[22]  Shang-Hong Lai,et al.  Physically Based Adaptive Preconditioning for Early Vision , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  S. Lai,et al.  Physically-based Adaptive Preconditioning for Early Vision 1 , 1997 .

[24]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[25]  Peter Schröder,et al.  A multiresolution framework for variational subdivision , 1998, TOGS.

[26]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[28]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[29]  Ruigang Yang,et al.  Multi-resolution real-time stereo on commodity graphics hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[30]  Eitan Grinspun,et al.  Sparse matrix solvers on the GPU: conjugate gradients and multigrid , 2003, SIGGRAPH Courses.

[31]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[32]  Shang-Hua Teng,et al.  Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems , 2003, STOC '04.

[33]  Sivan Toledo,et al.  Maximum‐weight‐basis preconditioners , 2004, Numer. Linear Algebra Appl..

[34]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[35]  Richard Szeliski,et al.  Bayesian modeling of uncertainty in low-level vision , 2011, International Journal of Computer Vision.

[36]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[37]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[38]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[39]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[40]  Dimitri Van De Ville,et al.  An orthogonal family of quincunx wavelets with continuously adjustable order , 2005, IEEE Transactions on Image Processing.

[41]  Patrick Ciarlet,et al.  Repeated Red-Black ordering: a new approach , 1994, Numerical Algorithms.

[42]  Amit K. Agrawal,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, ACM Trans. Graph..

[43]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[44]  R. Szeliski.  Locally adapted hierarchical basis preconditioning , 2006, SIGGRAPH 2006.

[45]  Rama Chellappa,et al.  What Is the Range of Surface Reconstructions from a Gradient Field? , 2006, ECCV.

[46]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[47]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.