Spatio-temporal segmentation of image sequences for object-oriented low bit-rate image coding

A method for coding of video sequences based on semantic decomposition into motion homogeneous regions is presented. The set of regions-the spatio-temporal segmentation-is intitialized for the first couple of frames of the sequence and then, tracked along the time axis, that allows to maintain its stability. Based on the spatio-temporal segmentation a predictive coding scheme is developed. Motion parameter vector and boundary description are encoded for each spatio temporal region. The bit-rate obtained for motion parameters is very low (<0.01 bits/pixel). The bit-rate for the boundary description strongly depends on the stability of the segmentation and varies around 0.1 bits/pixel. A costless transmission mode is choosen to encode the boundary component. The high visual quality of predicted frames with almost absolute absence of artifacts and a specific structure of prediction error allows the use of a selective coding of error signal.

[1]  Federico Girosi,et al.  Parallel and Deterministic Algorithms from MRFs: Surface Reconstruction , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Henri Nicolas,et al.  Region-based motion estimation using deterministic relaxation schemes for image sequence coding , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Michael Hötter,et al.  Object-oriented analysis-synthesis coding based on moving two-dimensional objects , 1990, Signal Process. Image Commun..

[4]  Peter C. Doerschuk,et al.  Cluster Expansions for the Deterministic Computation of Bayesian Estimators Based on Markov Random Fields , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  M. Kunt,et al.  Second-generation image-coding techniques , 1985, Proceedings of the IEEE.

[6]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Berkman Sahiner,et al.  Image reconstruction from projections under wavelet constraints , 1993, IEEE Trans. Signal Process..

[8]  Dominique Barba,et al.  Image segmentation by region-contour cooperation as a basis for efficient coding scheme , 1992, Other Conferences.