Image Sequence Restoration: A PDE Based Coupled Method for Image Restoration and Motion Segmentation

This article deals with the problem of restoring and segmenting noisy image sequences with a static background. Usually, motion segmentation and image restoration are tackled separately in image sequence restoration. Moreover, segmentation is often noise sensitive. In this article, the motion segmentation and the image restoration parts are performed in a coupled way, allowing the motion segmentation part to positively influence the restoration part and vice-versa. This is the key of our approach that allows to deal simultaneously with the problem of restoration and motion segmentation. To this end, we propose a theoretically justified optimization problem that permits to take into account both requirements. A suitable numerical scheme based on half quadratic minimization is then proposed and its stability demonstrated. Experimental results obtained on noisy synthetic data and real images will illustrate the capabilities of this original and promising approach.

[1]  L. Evans.  Measure theory and fine properties of functions , 1992 .

[2]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[3]  Ramesh C. Jain,et al.  Motion detection in spatio-temporal space , 1989, Comput. Vis. Graph. Image Process..

[4]  Robin D. Morris,et al.  Image Sequence Restoration Using Gibbs Distributions , 1995 .

[5]  Wenyuan Xu,et al.  Analysis and design of anisotropic diffusion for image processing , 1994, Proceedings of 1st International Conference on Image Processing.

[6]  Jill Macdonald Boyce,et al.  Noise reduction of image sequences using adaptive motion compensated frame averaging , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Norbert Diehl,et al.  Object-oriented motion estimation and segmentation in image sequences , 1991, Signal Process. Image Commun..

[8]  Anil C. Kokaram.  Reconstruction of Severely Degraded Image Sequences , 1997, ICIAP.

[9]  Anil C. Kokaram,et al.  A System for Reconstruction of Missing Data in Image Sequences Using Sampled 3D AR Models and MRF Motion Priors , 1996, ECCV.

[10]  Stanley Osher,et al.  Total variation based image restoration with free local constraints , 1994, Proceedings of 1st International Conference on Image Processing.

[11]  Guillermo Sapiro,et al.  Experiments on geometric image enhancement , 1994, Proceedings of 1st International Conference on Image Processing.

[12]  James A. Sethian,et al.  Image Processing: Flows under Min/Max Curvature and Mean Curvature , 1996, CVGIP Graph. Model. Image Process..

[13]  Rachid Deriche,et al.  Nonlinear operators in image restoration , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Donald Geman,et al.  A nonlinear filter for film restoration and other problems in image processing , 1992, CVGIP Graph. Model. Image Process..

[15]  Rachid Deriche,et al.  Image coupling, restoration and enhancement via PDE's , 1997, Proceedings of International Conference on Image Processing.

[16]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Til Aach,et al.  Bayesian algorithms for adaptive change detection in image sequences using Markov random fields , 1995, Signal Process. Image Commun..

[19]  L. Vese,et al.  A Variational Method in Image Recovery , 1997 .

[20]  L. Álvarez,et al.  Signal and image restoration using shock filters and anisotropic diffusion , 1994 .

[21]  Eric Dubois,et al.  Noise Reduction in Image Sequences Using Motion-Compensated Temporal Filtering , 1984, IEEE Trans. Commun..

[22]  Deterioration detection for digital film restoration , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[24]  R. Deriche,et al.  Les EDP en traitement des images et vision par ordinateur , 1995 .

[25]  L. Vese.  Problemes variationnels et edp pour l'analyse d'images et l'evolution de courbes , 1996 .

[26]  Niklas Nordström,et al.  Biased anisotropic diffusion: a unified regularization and diffusion approach to edge detection , 1990, Image Vis. Comput..

[27]  Rachid Deriche,et al.  A PDE-based level-set approach for detection and tracking of moving objects , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[28]  Edward J. Delp,et al.  Discontinuity preserving regularization of inverse visual problems , 1994, IEEE Trans. Syst. Man Cybern..

[29]  Luc Van Gool,et al.  Coupled Geometry-Driven Diffusion Equations for Low-Level Vision , 1994, Geometry-Driven Diffusion in Computer Vision.