Inpainting d’Images Couleurs par Lissage Anisotrope et Synthèse de Textures Color Image Inpainting by Anisotropic Smoothing and Texture Synthesis

We are interested in the reconstruction of missing data in color images, by the means of spatial interpolations that preserve textures. This so-called ”inpainting” process has several applications in the field of image processing. We propose a two-step algorithm for this purpose : first, we reconstruct the image isophotes in missing data regions using multi-valued PDE’s that perform anisotropic smoothing. Then, we synthetize the missing textures therein using a smart bloc matching scheme. Finally, we illustrate our algorithm for real objects removal in color photographs.

[1]  David Tschumperlé,et al.  LIC-based regularization of multi-valued images , 2005, IEEE International Conference on Image Processing 2005.

[2]  Rachid Deriche,et al.  Vector-valued image regularization with PDEs: a common framework for different applications , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[4]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[5]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[6]  Alfred M. Bruckstein,et al.  Diffusions and Confusions in Signal and Image Processing , 2001, Journal of Mathematical Imaging and Vision.

[7]  Jean-Michel Morel,et al.  An axiomatic approach to image interpolation , 1997, Proceedings of International Conference on Image Processing.

[8]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[9]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[10]  Jean-Michel Morel,et al.  Level lines based disocclusion , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[11]  G. Aubert,et al.  Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations (Applied Mathematical Sciences) , 2006 .

[12]  D. Tschumperlé.  PDE's based regularization of multivalued images and applications , 2002 .

[13]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[14]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[15]  Joachim Weickert,et al.  Coherence-enhancing diffusion of colour images , 1999, Image Vis. Comput..

[16]  G. Sapiro,et al.  Geometric partial differential equations and image analysis [Book Reviews] , 2001, IEEE Transactions on Medical Imaging.

[17]  Baining Guo,et al.  Chaos Mosaic: Fast and Memory Efficient Texture Synthesis , 2000 .

[18]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Tony F. Chan,et al.  Variational Restoration of Nonflat Image Features: Models and Algorithms , 2001, SIAM J. Appl. Math..

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Guillermo Sapiro,et al.  Anisotropic diffusion of color images , 1996, Electronic Imaging.

[22]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..

[23]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[24]  Ron Kimmel,et al.  Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images , 2000, International Journal of Computer Vision.

[25]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[26]  Chi-Keung Tang,et al.  Image repairing: robust image synthesis by adaptive ND tensor voting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[28]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[29]  David Tschumperlé,et al.  Fast Anisotropic Smoothing of Multi-Valued Images using Curvature-Preserving PDE's , 2006, International Journal of Computer Vision.

[30]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[31]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[33]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[34]  Li-Tien Cheng,et al.  Variational Problems and Partial Differential Equations on Implicit Surfaces: The Framework and Exam , 2000 .