Oriented texture completion by AM-FM reaction-diffusion

We provide an automated method to repair broken, occluded oriented image textures. Our approach is based on partial differential equations (PDEs) and AM-FM image modeling. Reconstruction of the texture occurs via simultaneous PDE-generated diffusion and reaction. In the diffusion process, the image is adaptively smoothed, preserving important boundaries and features. The reaction process produces the reconstructed textural information in the occluded image regions. Gabor (1946) filters are designed and used in the reaction process using an AM-FM dominant component analysis. An AM-FM model of the texture image is constructed, making it possible to localize the reaction filters spatio-spectrally. In contrast to previous disocclusion techniques that depend on interpolation, on continuity of the connected components within the image level sets, or on texture estimation, the reaction-diffusion process proposed here yields a seamless transition between the recreated region and the unoccluded image regions. Using AM-FM dominant component analysis, we avoid the ad hoc parameter selection typified with other reaction-diffusion approaches. As a useful example, we focus on the repair of broken, occluded fingerprints. We also treat several exemplary natural textures to demonstrate the technique's generality.

[1]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  H. Meinhardt Models of biological pattern formation , 1982 .

[3]  Andrew P. Witkin,et al.  Analyzing Oriented Patterns , 1985, IJCAI.

[4]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  A. Oosterlinck,et al.  Image enhancement and analysis with reaction-diffusion paradigm , 1990 .

[6]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[8]  Mark A. Poletti Instantaneous frequency and conditional moments in the time-frequency plane , 1991, IEEE Trans. Signal Process..

[9]  Alan C. Bovik,et al.  Analysis of multichannel narrow-band filters for image texture segmentation , 1991, IEEE Trans. Signal Process..

[10]  Andrew Witkin,et al.  Reaction-diffusion textures , 1991, SIGGRAPH.

[11]  Leon Cohen,et al.  What is a multicomponent signal? , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[13]  Petros Maragos,et al.  AM-FM energy detection and separation in noise using multiband energy operators , 1993, IEEE Trans. Signal Process..

[14]  David Mumford,et al.  Filtering, Segmentation and Depth , 1993, Lecture Notes in Computer Science.

[15]  Petros Maragos,et al.  On amplitude and frequency demodulation using energy operators , 1993, IEEE Trans. Signal Process..

[16]  Petros Maragos,et al.  Image demodulation using multidimensional energy separation , 1995 .

[17]  Anil C. Kokaram,et al.  Detection of missing data in image sequences , 1995, IEEE Trans. Image Process..

[18]  Anil C. Kokaram,et al.  Interpolation of missing data in image sequences , 1995, IEEE Trans. Image Process..

[19]  Anil C. Kokaram,et al.  A System for Reconstruction of Missing Data in Image Sequences Using Sampled 3D AR Models and MRF Motion Priors , 1996, ECCV.

[20]  Alan C. Bovik,et al.  The multicomponent AM-FM image representation , 1996, IEEE Trans. Image Process..

[21]  A.S. Sherstinsky,et al.  M-lattice: from morphogenesis to image processing , 1996, IEEE Trans. Image Process..

[22]  Shan Lu,et al.  Demodulators for AM-FM models of speech signals: a comparison , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[23]  Alan C. Bovik,et al.  Discrete quasi-eigenfunction approximation for AM-FM image analysis , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[24]  Alan C. Bovik,et al.  The analytic image , 1997, Proceedings of International Conference on Image Processing.

[25]  Joseph P. Havlicek,et al.  The Evolution of Modern Texture Processing , 1997, Turkish Journal of Electrical Engineering and Computer Sciences.

[26]  Rachid Deriche,et al.  Nonlinear operators in image restoration , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Song-Chun Zhu,et al.  Prior Learning and Gibbs Reaction-Diffusion , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Alan C. Bovik,et al.  Limits on discrete modulated signals , 1997, IEEE Trans. Signal Process..

[29]  Scott T. Acton,et al.  Morphological anisotropic diffusion , 1997, Proceedings of International Conference on Image Processing.

[30]  Alan C. Bovik,et al.  Multicomponent Multidimensional Signals , 1998, Multidimens. Syst. Signal Process..

[31]  Jean-Michel Morel,et al.  Level lines based disocclusion , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[32]  A. Bovik,et al.  On the instantaneous frequencies of multicomponent AM-FM signals , 1998, IEEE Signal Processing Letters.

[33]  Alan C. Bovik,et al.  Skewed 2D Hilbert transforms and computed AM-FM models , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[34]  Anil C. Kokaram,et al.  Motion picture restoration - digital algorithms for artefact suppression in degraded motion picture film and video , 2001 .

[35]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[37]  Rachid Deriche,et al.  Geodesic active regions for supervised texture segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Alan C. Bovik,et al.  Multidimensional quasi-eigenfunction approximations and multicomponent AM-FM models , 2000, IEEE Trans. Image Process..