Distributed gradient-domain processing of planar and spherical images

Gradient-domain processing is widely used to edit and combine images. In this article we extend the framework in two directions. First, we adapt the gradient-domain approach to operate on a spherical domain, to enable operations such as seamless stitching, dynamic-range compression, and gradient-based sharpening over spherical imagery. An efficient streaming computation is obtained using a new spherical parameterization with bounded distortion and localized boundary constraints. Second, we design a distributed solver to efficiently process large planar or spherical images. The solver partitions images into bands, streams through these bands in parallel within a networked cluster, and schedules computation to hide the necessary synchronization latency. We demonstrate our contributions on several datasets including the Digitized Sky Survey, a terapixel spherical scan of the night sky.

[1]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[2]  Nancy S. Pollard,et al.  Real-time gradient-domain painting , 2008, ACM Trans. Graph..

[3]  Andrew Chi-Sing Leung,et al.  The Rhombic Dodecahedron Map: An Efficient Scheme for Encoding Panoramic Video , 2009, IEEE Transactions on Multimedia.

[4]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[6]  Daniel B. Szyld,et al.  Weighted max norms, splittings, and overlapping additive Schwarz iterations , 1999, Numerische Mathematik.

[7]  Michael F. Cohen,et al.  Fourier Analysis of the 2D Screened Poisson Equation for Gradient Domain Problems , 2008, ECCV.

[8]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[9]  Michael F. Cohen,et al.  Capturing and viewing gigapixel images , 2007, ACM Trans. Graph..

[10]  Peter Schröder,et al.  Spherical wavelets: efficiently representing functions on the sphere , 1995, SIGGRAPH.

[11]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[12]  James McCann.  Recalling the single-FFT direct Poisson solve , 2008, SIGGRAPH '08.

[13]  Barry Smith,et al.  Multigrid and multilevel methods for quadratic spline collocation , 1997 .

[14]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[15]  Jinchao Xu,et al.  Iterative Methods by Space Decomposition and Subspace Correction , 1992, SIAM Rev..

[16]  土橋 一仁.  Digitized Sky Survey I を利用した暗黒星雲の全天探査 , 2002 .

[17]  Adam Finkelstein,et al.  Digital bas-relief from 3D scenes , 2007, ACM Trans. Graph..

[18]  Aseem Agarwala.  Efficient gradient-domain compositing using quadtrees , 2007, SIGGRAPH 2007.

[19]  K. Gorski,et al.  HEALPix: A Framework for High-Resolution Discretization and Fast Analysis of Data Distributed on the Sphere , 2004, astro-ph/0409513.

[20]  Hugues Hoppe,et al.  Spherical parametrization and remeshing , 2003, ACM Trans. Graph..

[21]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..

[22]  Edmond Chow,et al.  A Survey of Parallelization Techniques for Multigrid Solvers , 2006, Parallel Processing for Scientific Computing.

[23]  Barbara Cutler,et al.  Parallel ODETLAP for terrain compression and reconstruction , 2008, GIS '08.

[24]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[25]  Michael M. Kazhdan,et al.  Streaming multigrid for gradient-domain operations on large images , 2008, ACM Trans. Graph..

[26]  Barry F. Smith,et al.  Domain Decomposition: Parallel Multilevel Methods for Elliptic Partial Differential Equations , 1996 .

[27]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[28]  Aniruddha R. Thakar,et al.  The Hierarchical Triangular Mesh , 2001 .

[29]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[30]  William L. Briggs,et al.  A multigrid tutorial, Second Edition , 2000 .

[31]  Hugues Hoppe,et al.  Spherical parametrization and remeshing , 2003, ACM Trans. Graph..

[32]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[33]  Yoko NISHIMURA,et al.  Google Earth , 2008, Encyclopedia of GIS.

[34]  Adam Finkelstein,et al.  Digital bas-relief from 3D scenes , 2007, ACM Trans. Graph..

[35]  M.F. Adams,et al.  A Distributed Memory Unstructured Gauss-Seidel Algorithm for Multigrid Smoothers , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[36]  Michael Cohen,et al.  Capturing and viewing gigapixel images , 2007, SIGGRAPH 2007.

[37]  F. Gyorgy,et al.  Rendering and managing spherical data with sphere quadtrees , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[38]  K. Hohn,et al.  Determining Lightness from an Image , 2004 .

[39]  Reinhard Nabben,et al.  Comparisons between multiplicative and additive Schwarz iterations in domain decomposition methods , 2003, Numerische Mathematik.

[40]  Gyorgy Fekete,et al.  Rendering and managing spherical data with sphere quadtrees , 1990, VIS '90.

[41]  Aseem Agarwala,et al.  Efficient gradient-domain compositing using quadtrees , 2007, ACM Trans. Graph..

[42]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, ACM Trans. Graph..

[43]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[44]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[45]  William H. Press,et al.  Numerical recipes , 1990 .

[46]  Erik Hagersten,et al.  Multigrid and Gauss-Seidel smoothers revisited: parallelization on chip multiprocessors , 2006, ICS '06.