Variational Method on Riemann Surfaces using Conformal Parameterization and its Applications to Image Processing

Variational method is a useful mathematical tool in various areas of research, espe- cially in image processing. Recently, solving image processing problems on general manifolds using variational techniques has become an important research topic. In this paper, we solve several image processing problems on general Riemann surfaces using variational models defined on surfaces. We propose an explicit method to solve variational problems on general Riemann surfaces, using the conformal parameterization and covariant derivatives defined on the surface. To simplify the com- putation, the surface is firstly mapped conformally to the two dimensional rectangular domains, by computing the holomorphic 1-form on the surface. It is well known that the Jacobian of a conformal map is simply the scalar multiplication of the conformal factor. Therefore with the conformal para- meterization, the covariant derivatives on the parameter domain are similar to the usual Euclidean differential operators, except for the scalar multiplication. As a result, any variational problem on the surface can be formulated to a 2D problem with a simple formula and efficiently solved by well developed numerical scheme on the 2D domain. With the proposed method, we solve various image processing problems on surfaces using different variational models, which include image segmen- tation, surface denoising, surface inpainting, texture extraction and automatic landmark tracking. Experimental results show that our method can effectively solve variational problems and tackle image processing tasks on general Riemann surfaces.

[1]  T. Chan,et al.  Genus zero surface conformal mapping and its application to brain surface mapping. , 2004, IEEE transactions on medical imaging.

[2]  Lok Ming Lui,et al.  Solving PDEs on Manifolds with Global Conformal Parametriazation , 2005, VLSM.

[3]  Ulrich Pinkall,et al.  Computing Discrete Minimal Surfaces and Their Conjugates , 1993, Exp. Math..

[4]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[5]  Martin Rumpf,et al.  Surface processing methods for point sets using finite elements , 2004, Comput. Graph..

[6]  O. Faugeras,et al.  The Inverse EEG and MEG Problems : The Adjoint State Approach I: The Continuous Case , 1999 .

[7]  Kai Hormann,et al.  Surface Parameterization: a Tutorial and Survey , 2005, Advances in Multiresolution for Geometric Modelling.

[8]  Anil N. Hirani,et al.  Discrete exterior calculus for variational problems in computer vision and graphics , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[9]  Ron Kimmel,et al.  Enhancing Images Painted on Manifolds , 2005, Scale-Space.

[10]  Ron Kikinis,et al.  On the Laplace-Beltrami operator and brain surface flattening , 1999, IEEE Transactions on Medical Imaging.

[11]  Martin Rumpf,et al.  Anisotropic Diffusion in Vector Field Visualization on Euclidean Domains and Surfaces , 2000, IEEE Trans. Vis. Comput. Graph..

[12]  Alan C. Evans,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2000, Nature.

[13]  Tony DeRose,et al.  Multiresolution analysis of arbitrary meshes , 1995, SIGGRAPH.

[14]  David Salesin,et al.  Rendering parametric surfaces in pen and ink , 1996, SIGGRAPH.

[15]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[16]  A. Voigt,et al.  PDE's on surfaces---a diffuse interface approach , 2006 .

[17]  R. Woods,et al.  Mathematical/computational challenges in creating deformable and probabilistic atlases of the human brain , 2000, Human brain mapping.

[18]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[19]  Guillermo Sapiro,et al.  Inpainting surface holes , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[20]  Lok Ming Lui,et al.  Brain Surface Conformal Parameterization Using Riemann Surface Structure , 2007, IEEE Transactions on Medical Imaging.

[21]  Guillermo Sapiro,et al.  Variational Problems and Partial Differential Equations on Implicit Surfaces: Bye Bye Triangulated Surfaces? , 2003 .

[22]  Rachid Deriche,et al.  The Beltrami Flow over Triangulated Manifolds , 2004, ECCV Workshops CVAMIA and MMBIA.

[23]  Tony F. Chan,et al.  Active Contours without Edges for Vector-Valued Images , 2000, J. Vis. Commun. Image Represent..

[24]  JinMiao,et al.  Conformal Geometry and Its Applications on 3D Shape Matching, Recognition, and Stitching , 2007 .

[25]  Andrew Witkin,et al.  Reaction-diffusion textures , 1991, SIGGRAPH.

[26]  Robert B. Fisher,et al.  Non-parametric 3D surface completion , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[27]  P Hanrahan,et al.  Digital materials and virtual weathering. , 2000, Scientific American.

[28]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[29]  Guillermo Sapiro,et al.  Conformal Surface Parameterization for Texture Mapping , 1999 .

[30]  Steven J. Ruuth,et al.  A simple embedding method for solving partial differential equations on surfaces , 2008, J. Comput. Phys..

[31]  Jos Stam,et al.  Flows on surfaces of arbitrary topology , 2003, ACM Trans. Graph..

[32]  Direct Geometric Texture Synthesis and Transfer on 3D Meshes , 2006 .

[33]  Lok Ming Lui,et al.  Automatic Landmark Tracking and its Application to the Optimization of Brain Conformal Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[34]  A. Mondino.  ON RIEMANNIAN MANIFOLDS , 1999 .

[35]  M. Burger.  Finite element approximation of elliptic partial differential equations on implicit surfaces , 2009 .

[36]  Lok Ming Lui,et al.  BRAIN ANATOMICAL FEATURE DETECTION BY SOLVING PARTIAL DIFFERENTIAL EQUATIONS ON GENERAL MANIFOLDS , 2007 .

[37]  Jos Stam,et al.  Stable fluids , 1999, SIGGRAPH.

[38]  Tony F. Chan,et al.  Variational Restoration of Nonflat Image Features: Models and Algorithms , 2001, SIAM J. Appl. Math..

[39]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[40]  Guillermo Sapiro,et al.  Diffusion of General Data on Non-Flat Manifolds via Harmonic Maps Theory: The Direction Diffusion Case , 2000, International Journal of Computer Vision.

[41]  R. Bellman.  Calculus of Variations (L. E. Elsgolc) , 1963 .

[42]  Greg Turk,et al.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991, SIGGRAPH.