Highly Corrupted Image Inpainting Through Hypoelliptic Diffusion

We present a new biomimetic image inpainting algorithm, the Averaging and Hypoelliptic Evolution (AHE) algorithm, inspired by the one presented in Boscain et al. (SIAM J. Imaging Sci. 7(2):669–695, 2014) and based upon a semi-discrete variation of the Citti–Petitot–Sarti model of the primary visual cortex V1. The AHE algorithm is based on a suitable combination of sub-Riemannian hypoelliptic diffusion and ad hoc local averaging techniques. In particular, we focus on highly corrupted images (i.e., where more than the 80% of the image is missing), for which we obtain high-quality reconstructions.

[1]  Jean-Paul Gauthier,et al.  Image Processing in the Semidiscrete Group of Rototranslations , 2015, GSI.

[2]  Tony F. Chan,et al.  Euler's Elastica and Curvature-Based Inpainting , 2003, SIAM J. Appl. Math..

[3]  Frédéric Jean,et al.  Sub-Riemannian Geometry , 2022 .

[4]  Jean-Paul Gauthier,et al.  Hypoelliptic Diffusion and Human Vision: A Semidiscrete New Twist , 2014, SIAM J. Imaging Sci..

[5]  R. Duits,et al.  The explicit solutions of linear left-invariant second order stochastic evolution equations on the 2D-Euclidean motion group , 2007 .

[6]  H. Wässle,et al.  Size, scatter and coverage of ganglion cell receptive field centres in the cat retina. , 1979, The Journal of physiology.

[7]  Giovanna Citti,et al.  Image Completion Using a Diffusion Driven Mean Curvature Flowin A Sub-Riemannian Space , 2008, VISAPP.

[8]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[9]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  M. Gromov.  Carnot-Carathéodory spaces seen from within , 1996 .

[11]  Remco Duits,et al.  Association Fields via Cuspless Sub-Riemannian Geodesics in SE(2) , 2013, Journal of Mathematical Imaging and Vision.

[12]  Giovanna Citti,et al.  A Cortical Based Model of Perceptual Completion in the Roto-Translation Space , 2006, Journal of Mathematical Imaging and Vision.

[13]  Nikolay N. Ponomarenko,et al.  Self-Similarity Measure for Assessment of Image Visual Quality , 2011, ACIVS.

[14]  Abbas Fazly,et al.  Analysis of craquelure patterns for content-based retrieval , 2004 .

[15]  King Ngi Ngan,et al.  An efficient framework for image/video inpainting , 2013, Signal Process. Image Commun..

[16]  Jean-Paul Gauthier,et al.  Anthropomorphic Image Reconstruction via Hypoelliptic Diffusion , 2010, SIAM J. Control. Optim..

[17]  R. Duits,et al.  Left-invariant parabolic evolutions on SE(2) and contour enhancement via invertible orientation scores. Part II: Non-linear left-invariant diffusions on invertible orientation scores , 2010 .

[18]  R. Strichartz.  Corrections to: ``Sub-Riemannian geometry'' , 1989 .

[19]  Giovanna Citti,et al.  Sub-Riemannian Mean Curvature Flow for Image Processing , 2015, SIAM J. Imaging Sci..

[20]  Francesco Rossi,et al.  Existence of planar curves minimizing length and curvature , 2009, 0906.5290.

[21]  Guillermo Sapiro,et al.  Exemplar-Based Interpolation of Sparsely Sampled Images , 2009, EMMCVPR.

[22]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[23]  Fan Zhang,et al.  Limitation and challenges of image quality measurement , 2010, Visual Communications and Image Processing.

[24]  Simon Masnou,et al.  Disocclusion: a variational approach using level lines , 2002, IEEE Trans. Image Process..

[25]  R. Montgomery.  A Tour of Subriemannian Geometries, Their Geodesics and Applications , 2006 .

[26]  Jean-Paul Gauthier,et al.  A semidiscrete version of the Petitot model as a plausible model for anthropomorphic image reconstruction and pattern recognition , 2017, ArXiv.

[27]  Remco Duits,et al.  Curve cuspless reconstruction via sub-Riemannian geometry , 2012, 1203.3089.

[28]  Joel H. Ferziger,et al.  Computational methods for fluid dynamics , 1996 .

[29]  L. Hörmander.  Hypoelliptic second order differential equations , 1967 .

[30]  R. Duits,et al.  Left-invariant parabolic evolutions on SE(2) and contour enhancement via invertible orientation scores. Part I: Linear left-invariant diffusion equations on SE(2) , 2010 .

[31]  Guillermo Sapiro,et al.  A Comprehensive Framework for Image Inpainting , 2010, IEEE Transactions on Image Processing.

[32]  Guang-Ren Duan,et al.  A Lyapunov Inequality Characterization of and a Riccati Inequality Approach to LINFINITY and L2 Low Gain Feedback , 2012, SIAM J. Control. Optim..

[33]  G. Marchuk.  Methods of Numerical Mathematics , 1982 .

[34]  Jean-Michel Morel,et al.  Level lines based disocclusion , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[35]  A. Bellaïche.  The tangent space in sub-riemannian geometry , 1994 .

[36]  Karen O. Egiazarian,et al.  No-reference visual quality assessment for image inpainting , 2015, Electronic Imaging.

[37]  Scott D. Pauls,et al.  Minimal Surfaces in the Roto-Translation Group with Applications to a Neuro-Biological Image Completion Model , 2009, Journal of Mathematical Imaging and Vision.

[38]  Frédéric Bouchara,et al.  Fourier Descriptors Based on the Structure of the Human Primary Visual Cortex with Applications to Object Recognition , 2015, Journal of Mathematical Imaging and Vision.

[39]  Aleksandra Pizurica,et al.  Crack detection and inpainting for virtual restoration of paintings: The case of the Ghent Altarpiece , 2013, Signal Process..

[40]  J. Petitot.  The neurogeometry of pinwheels as a sub-Riemannian contact structure , 2003, Journal of Physiology-Paris.

[41]  Thomas S. Huang,et al.  A fast two-dimensional median filtering algorithm , 1979 .

[42]  Jean-Paul Gauthier,et al.  Image reconstruction via non-isotropic diffusion in Dubins/Reed-Shepp-like control systems , 2014, 53rd IEEE Conference on Decision and Control.